中文
相关论文

相关论文: Convergence rate bounds for a proximal ADMM with o…

200 篇论文

Aiming at solving large-scale learning problems, this paper studies distributed optimization methods based on the alternating direction method of multipliers (ADMM). By formulating the learning problem as a consensus problem, the ADMM can…

分布式、并行与集群计算 · 计算机科学 2016-05-04 Tsung-Hui Chang , Mingyi Hong , Wei-Cheng Liao , Xiangfeng Wang

This paper presents a numerical solver for computing continuous trajectories in non-convex environments. Our approach relies on a customized implementation of the Alternating Direction Method of Multipliers (ADMM) built upon two key…

机器人学 · 计算机科学 2026-03-13 Lukas Pries , Jon Arrizabalaga , Zachary Manchester , Markus Ryll

Recently, there has been great interest in connections between continuous-time dynamical systems and optimization methods, notably in the context of accelerated methods for smooth and unconstrained problems. In this paper we extend this…

最优化与控制 · 数学 2023-01-25 Guilherme França , Daniel P. Robinson , René Vidal

The Alternating Direction Method of Multipliers (ADMM) has been proved to be effective for solving separable convex optimization subject to linear constraints. In this paper, we propose a Generalized Symmetric ADMM (GS-ADMM), which updates…

最优化与控制 · 数学 2018-12-11 Jianchao Bai , Jicheng Li , Fengmin Xu , Hongchao Zhang

This paper seeks to address how to solve non-smooth convex and strongly convex optimization problems with functional constraints. The introduced Mirror Descent (MD) method with adaptive stepsizes is shown to have a better convergence rate…

最优化与控制 · 数学 2017-05-08 Anastasia Bayandina

The alternating direction method of multipliers (ADMM) is a popular method for solving convex separable minimization problems with linear equality constraints. The generalization of the two-block ADMM to the three-block ADMM is not trivial…

最优化与控制 · 数学 2021-05-10 Yang Yang , Yuchao Tang , Jigen Peng

This paper investigates the distributed stochastic nonconvex and nonsmooth composite optimization problem. Existing stochastic typically rely on uniform step size strictly bounded by global network parameters, such as the maximum node…

最优化与控制 · 数学 2026-03-10 Yangming Zhang , Yongyang Xiong , Jinming Xu , Keyou You , Yang Shi

As an extension of the alternating direction method of multipliers (ADMM), the semi-proximal ADMM (sPADMM) has been widely used in various fields due to its flexibility and robustness. In this paper, we first show that the two-block sPADMM…

最优化与控制 · 数学 2025-05-28 Peng Liu , Liang Chen , Minru Bai

We consider a 3-block Alternating Direction Method of Multipliers (ADMM) for solving nonconvex nonseparable problems with a linear constraint. Inspired by \cite[Sun, Toh and Yang, \textit{SIAM Journal on Optimization}, 25 (2015),…

最优化与控制 · 数学 2025-07-21 Zekun Liu

Stochastic version of alternating direction method of multiplier (ADMM) and its variants (linearized ADMM, gradient-based ADMM) plays a key role for modern large scale machine learning problems. One example is the regularized empirical risk…

最优化与控制 · 数学 2020-03-10 Xiang Zhou , Huizhuo Yuan , Chris Junchi Li , Qingyun Sun

The parallel alternating direction method of multipliers (ADMM) algorithm is widely recognized for its effectiveness in handling large-scale datasets stored in a distributed manner, making it a popular choice for solving statistical…

机器学习 · 统计学 2023-11-22 Xiaofei Wu , Zhimin Zhang , Zhenyu Cui

The Alternating Direction Method of Multipliers (ADMM) has been studied for years. The traditional ADMM algorithm needs to compute, at each iteration, an (empirical) expected loss function on all training examples, resulting in a…

机器学习 · 统计学 2014-06-10 Peilin Zhao , Jinwei Yang , Tong Zhang , Ping Li

This article reports an algorithm for multi-agent distributed optimization problems with a common decision variable, local linear equality and inequality constraints and set constraints with convergence rate guarantees.…

系统与控制 · 电气工程与系统科学 2022-11-17 Vivek Khatana , Murti V. Salapaka

This dissertation explores block decomposable methods for large-scale optimization problems. It focuses on alternating direction method of multipliers (ADMM) schemes and block coordinate descent (BCD) methods. Specifically, it introduces a…

最优化与控制 · 数学 2026-01-15 Leandro Farias Maia

Mirror Descent (MD) is a well-known method of solving non-smooth convex optimization problems. This paper analyzes the stochastic variant of MD with adaptive stepsizes. Its convergence on average is shown to be faster than with the fixed…

最优化与控制 · 数学 2017-05-08 Anastasia Bayandina

The alternating direction method of multipliers (ADMM) algorithm is a powerful and flexible tool for complex optimization problems of the form $\min\{f(x)+g(y) : Ax+By=c\}$. ADMM exhibits robust empirical performance across a range of…

最优化与控制 · 数学 2024-02-08 Rina Foygel Barber , Emil Y. Sidky

This paper analyzes the iteration-complexity of a generalized alternating direction method of multipliers (G-ADMM) for solving linearly constrained convex problems. This ADMM variant, which was first proposed by Bertsekas and Eckstein,…

最优化与控制 · 数学 2017-05-18 V. A. Adona , M. L. N. Goncalves , J. G. Melo

This paper introduces a parallel and distributed extension to the alternating direction method of multipliers (ADMM) for solving convex problem: minimize $\sum_{i=1}^N f_i(x_i)$ subject to $\sum_{i=1}^N A_i x_i=c, x_i\in \mathcal{X}_i$. The…

最优化与控制 · 数学 2014-03-20 Wei Deng , Ming-Jun Lai , Zhimin Peng , Wotao Yin

In the present paper we propose a novel convergence analysis of the Alternating Direction Methods of Multipliers (ADMM), based on its equivalence with the overrelaxed Primal-Dual Hybrid Gradient (oPDHG) algorithm. We consider the smooth…

最优化与控制 · 数学 2017-01-19 Pauline Tan

We propose a distributed version of the Alternating Direction Method of Multipliers (ADMM) with linear updates for directed networks. We show that if the objective function of the minimization problem is smooth and strongly convex, our…

最优化与控制 · 数学 2023-09-21 Kiran Rokade , Rachel Kalpana Kalaimani