中文
相关论文

相关论文: Global Convergence of ADMM in Nonconvex Nonsmooth …

200 篇论文

This paper investigates solving convex composite optimization on an undirected network, where each node, privately endowed with a smooth component function and a nonsmooth one, is required to minimize the sum of all the component functions…

最优化与控制 · 数学 2021-08-13 Xuyang Wu , Jie Lu

The alternating direction method of multipliers (ADMM) has been applied successfully in a broad spectrum of areas. Moreover, it was shown in the literature that ADMM is closely related to the Douglas-Rachford operator-splitting method, and…

最优化与控制 · 数学 2024-01-10 Renyuan Ni

The Alternating Direction Method of Multipliers (ADMM) has gained a lot of attention for solving large-scale and objective-separable constrained optimization. However, the two-block variable structure of the ADMM still limits the practical…

最优化与控制 · 数学 2020-03-24 Kresimir Mihic , Mingxi Zhu , Yinyu Ye

The parallel alternating direction method of multipliers (ADMM) algorithm is widely recognized for its effectiveness in handling large-scale datasets stored in a distributed manner, making it a popular choice for solving statistical…

机器学习 · 统计学 2023-11-22 Xiaofei Wu , Zhimin Zhang , Zhenyu Cui

This paper proposes a proximal variant of the alternating direction method of multipliers (ADMM) for distributed optimization. Although the current versions of ADMM algorithm provide promising numerical results in producing solutions that…

最优化与控制 · 数学 2023-09-01 Reza Mirzaeifard , Naveen K. D. Venkategowda , Alexander Jung , Stefan Werner

The Alternating Direction Method of Multipliers (ADMM) is widely used for linearly constrained convex problems. It is proven to have an $o(1/\sqrt{K})$ nonergodic convergence rate and a faster $O(1/K)$ ergodic rate after ergodic averaging,…

数值分析 · 数学 2018-12-13 Huan Li , Zhouchen Lin

Many machine learning models, including those with non-smooth regularizers, can be formulated as consensus optimization problems, which can be solved by the alternating direction method of multipliers (ADMM). Many recent efforts have been…

机器学习 · 计算机科学 2018-02-27 Rui Zhu , Di Niu , Zongpeng Li

We propose new methods to speed up convergence of the Alternating Direction Method of Multipliers (ADMM), a common optimization tool in the context of large scale and distributed learning. The proposed method accelerates the speed of…

机器学习 · 计算机科学 2016-04-05 Changkyu Song , Sejong Yoon , Vladimir Pavlovic

This paper considers the distributed optimization of a sum of locally observable, non-convex functions. The optimization is performed over a multi-agent networked system, and each local function depends only on a subset of the variables. An…

最优化与控制 · 数学 2016-05-04 Sandeep Kumar , Rahul Jain , Ketan Rajawat

This dissertation explores block decomposable methods for large-scale optimization problems. It focuses on alternating direction method of multipliers (ADMM) schemes and block coordinate descent (BCD) methods. Specifically, it introduces a…

最优化与控制 · 数学 2026-01-15 Leandro Farias Maia

We propose a distributed algorithm based on Alternating Direction Method of Multipliers (ADMM) to minimize the sum of locally known convex functions using communication over a network. This optimization problem emerges in many applications…

最优化与控制 · 数学 2016-01-05 Ali Makhdoumi , Asuman Ozdaglar

In this paper, we develop a variant of the well-known Gauss-Newton (GN) method to solve a class of nonconvex optimization problems involving low-rank matrix variables. As opposed to the standard GN method, our algorithm allows one to handle…

最优化与控制 · 数学 2020-10-27 Quoc Tran-Dinh

As a well-known optimization framework, the Alternating Direction Method of Multipliers (ADMM) has achieved tremendous success in many classification and regression applications. Recently, it has attracted the attention of deep learning…

机器学习 · 计算机科学 2021-12-23 Junxiang Wang , Hongyi Li , Liang Zhao

This paper considers a class of structured fractional minimization problems. The numerator consists of a differentiable function, a simple nonconvex nonsmooth function, a concave nonsmooth function, and a convex nonsmooth function composed…

最优化与控制 · 数学 2025-04-01 Ganzhao Yuan

Large scale, non-convex optimization problems arising in many complex networks such as the power system call for efficient and scalable distributed optimization algorithms. Existing distributed methods are usually iterative and require…

最优化与控制 · 数学 2017-10-26 Junyao Guo , Gabriela Hug , Ozan Tonguz

The alternating direction method of multipliers (ADMM) is a versatile tool for solving a wide range of constrained optimization problems, with differentiable or non-differentiable objective functions. Unfortunately, its performance is…

机器学习 · 计算机科学 2017-07-20 Zheng Xu , Mario A. T. Figueiredo , Tom Goldstein

Many problems in machine learning and other fields can be (re)for-mulated as linearly constrained separable convex programs. In most of the cases, there are multiple blocks of variables. However, the traditional alternating direction method…

数值分析 · 计算机科学 2014-05-30 Zhouchen Lin , Risheng Liu , Huan Li

We propose a new relative-error inexact version of the alternating direction method of multipliers (ADMM) for convex optimization. We prove the asymptotic convergence of our main algorithm as well as pointwise and ergodic…

最优化与控制 · 数学 2024-09-17 M. Marques Alves , M. Geremia

The alternating direction method of multipliers (ADMM) is widely used for solving large-scale semidefinite programs (SDPs), yet on instances with multiple primal-dual optimal solution pairs, it often enters prolonged slow-convergence…

最优化与控制 · 数学 2026-03-04 Shucheng Kang , Heng Yang

This article reports an algorithm for multi-agent distributed optimization problems with a common decision variable, local linear equality and inequality constraints and set constraints with convergence rate guarantees.…

系统与控制 · 电气工程与系统科学 2022-11-17 Vivek Khatana , Murti V. Salapaka