English
Related papers

Related papers: Managing Randomization in the Multi-Block Alternat…

200 papers

In the paper, we study the stochastic alternating direction method of multipliers (ADMM) for the nonconvex optimizations, and propose three classes of the nonconvex stochastic ADMM with variance reduction, based on different reduced…

Optimization and Control · Mathematics 2017-07-27 Feihu Huang , Songcan Chen , Zhaosong Lu

We consider a multi-block separable convex optimization problem with the linear constraints, where the objective function is the sum of m individual convex functions without overlapping variables. The linearized version of the generalized…

Optimization and Control · Mathematics 2022-04-19 He Jian , Zhang Bangzhong , Li Jinlin

In this paper, we analyze the convergence of the alternating direction method of multipliers (ADMM) for minimizing a nonconvex and possibly nonsmooth objective function, $\phi(x_0,\ldots,x_p,y)$, subject to coupled linear equality…

Optimization and Control · Mathematics 2018-05-31 Yu Wang , Wotao Yin , Jinshan Zeng

Many practical applications of optimal control are subject to real-time computational constraints. When applying model predictive control (MPC) in these settings, respecting timing constraints is achieved by limiting the number of…

Optimization and Control · Mathematics 2024-12-16 Anusha Srikanthan , Aren Karapetyan , Vijay Kumar , Nikolai Matni

The alternating direction method of multipliers (ADMM) is a powerful optimization solver in machine learning. Recently, stochastic ADMM has been integrated with variance reduction methods for stochastic gradient, leading to SAG-ADMM and…

Machine Learning · Computer Science 2016-10-18 Shuai Zheng , James T. Kwok

This paper presents a majorized alternating direction method of multipliers (ADMM) with indefinite proximal terms for solving linearly constrained $2$-block convex composite optimization problems with each block in the objective being the…

Optimization and Control · Mathematics 2015-06-24 Min Li , Defeng Sun , Kim-Chuan Toh

Multi-agent distributed consensus optimization problems arise in many signal processing applications. Recently, the alternating direction method of multipliers (ADMM) has been used for solving this family of problems. ADMM based distributed…

Systems and Control · Computer Science 2015-06-18 Tsung-Hui Chang , Mingyi Hong , Xiangfeng Wang

Parabolic optimal control problems with control constraints are generally challenging, from either theoretical analysis or algorithmic design perspectives. Conceptually, the well-known alternating direction method of multipliers (ADMM) can…

Optimization and Control · Mathematics 2020-05-05 Yongcun Song , Xiaoming Yuan , Hangrui Yue

The alternating direction method with multipliers (ADMM) has been one of most powerful and successful methods for solving various composite problems. The convergence of the conventional ADMM (i.e., 2-block) for convex objective functions…

Optimization and Control · Mathematics 2015-05-13 Fenghui Wang , Wenfei Cao , Zongben Xu

We present an Alternating Direction Method of Multipliers (ADMM) algorithm for solving optimization problems with an l_1 regularized least-squares cost function subject to recursive equality constraints. The considered optimization problem…

Systems and Control · Computer Science 2012-03-20 Mariette Annergren , Anders Hansson , Bo Wahlberg

The Alternating Direction Method of Multipliers (ADMM) is a widely used method for structured convex optimization, and its practical performance depends strongly on the choice of penalty and relaxation parameters. Motivated by settings such…

Optimization and Control · Mathematics 2026-04-30 Junan Lin , Paul J. Goulart , Luca Furieri

This paper investigates the cooperative planning and control problem for multiple connected autonomous vehicles (CAVs) in different scenarios. In the existing literature, most of the methods suffer from significant problems in computational…

Multiagent Systems · Computer Science 2021-01-05 Xiaoxue Zhang , Zilong Cheng , Jun Ma , Sunan Huang , Frank L. Lewis , Tong Heng Lee

Alternating Direction Method of Multipliers (ADMM) has been used successfully in many conventional machine learning applications and is considered to be a useful alternative to Stochastic Gradient Descent (SGD) as a deep learning optimizer.…

Optimization and Control · Mathematics 2021-07-07 Junxiang Wang , Fuxun Yu , Xiang Chen , Liang Zhao

This paper is devoted to the design of an efficient and convergent {semi-proximal} alternating direction method of multipliers (ADMM) for finding a solution of low to medium accuracy to convex quadratic conic programming and related…

Optimization and Control · Mathematics 2014-09-10 Xudong Li , Defeng Sun , Kim-Chuan Toh

Many machine learning models, including those with non-smooth regularizers, can be formulated as consensus optimization problems, which can be solved by the alternating direction method of multipliers (ADMM). Many recent efforts have been…

Machine Learning · Computer Science 2018-02-27 Rui Zhu , Di Niu , Zongpeng Li

Nonconvex and structured optimization problems arise in many engineering applications that demand scalable and distributed solution methods. The study of the convergence properties of these methods is in general difficult due to the…

Optimization and Control · Mathematics 2015-05-04 Sindri Magnússon , Pradeep Chathuranga Weeraddana , Michael G. Rabbat , Carlo Fischione

In this paper, we propose and analyze an inexact version of the symmetric proximal alternating direction method of multipliers (ADMM) for solving linearly constrained optimization problems. Basically, the method allows its first subproblem…

Optimization and Control · Mathematics 2020-06-05 Vando A. Adona , Max L. N. Gonçalves

In this paper, we study a class of non-convex optimization problems known as multi-affine quadratic equality constrained problems, which appear in various applications--from generating feasible force trajectories in robotic locomotion and…

Optimization and Control · Mathematics 2026-03-13 Yutong Chao , Michal Ciebielski , Jalal Etesami , Majid Khadiv

Accompanied with the rising popularity of compressed sensing, the Alternating Direction Method of Multipliers (ADMM) has become the most widely used solver for linearly constrained convex problems with separable objectives. In this work, we…

Numerical Analysis · Computer Science 2016-07-12 Canyi Lu , Jiashi Feng , Shuicheng Yan , Zhouchen Lin

Alternating Direction Method of Multipliers (ADMM) is a popular algorithm for distributed learning, where a network of nodes collaboratively solve a regularized empirical risk minimization by iterative local computation associated with…

Machine Learning · Computer Science 2020-05-19 Zonghao Huang , Yanmin Gong
‹ Prev 1 3 4 5 6 7 10 Next ›