English
Related papers

Related papers: An Adaptive Multiparameter Penalty Selection Metho…

200 papers

The alternating direction method of multipliers (ADMM) is a flexible method to solve a large class of convex minimization problems. Particular features are its unconditional convergence with respect to the involved step size and its direct…

Numerical Analysis · Mathematics 2017-04-21 Sören Bartels , Marijo Milicevic

This paper considers a convex optimization problem with cost and constraints that evolve over time. The function to be minimized is strongly convex and possibly non-differentiable, and variables are coupled through linear constraints. In…

Systems and Control · Electrical Eng. & Systems 2021-01-13 Yijian Zhang , Emiliano Dall'Anese , Mingyi Hong

Alternating Direction Method of Multipliers (ADMM) has become a widely used optimization method for convex problems, particularly in the context of data mining in which large optimization problems are often encountered. ADMM has several…

Machine Learning · Statistics 2019-07-11 Andre Goncalves , Xiaoli Liu , Arindam Banerjee

This paper introduces a novel approach to solving multi-block nonconvex composite optimization problems through a proximal linearized Alternating Direction Method of Multipliers (ADMM). This method incorporates an Increasing Penalization…

Optimization and Control · Mathematics 2025-04-01 Ganzhao Yuan

We expand the scope of the alternating direction method of multipliers (ADMM). Specifically, we show that ADMM, when employed to solve problems with multiaffine constraints that satisfy certain verifiable assumptions, converges to the set…

Optimization and Control · Mathematics 2019-10-24 Wenbo Gao , Donald Goldfarb , Frank E. Curtis

In this paper, we analyze the convergence of the alternating direction method of multipliers (ADMM) for minimizing a nonconvex and possibly nonsmooth objective function, $\phi(x_0,\ldots,x_p,y)$, subject to coupled linear equality…

Optimization and Control · Mathematics 2018-05-31 Yu Wang , Wotao Yin , Jinshan Zeng

The objective of this paper is to design an efficient and convergent alternating direction method of multipliers (ADMM) for finding a solution of medium accuracy to conic programming problems whose constraints consist of linear equalities,…

Optimization and Control · Mathematics 2014-12-02 Defeng Sun , Kim-Chuan Toh , Liuqin Yang

In this paper, we study a general optimization model, which covers a large class of existing models for many applications in imaging sciences. To solve the resulting possibly nonconvex, nonsmooth and non-Lipschitz optimization problem, we…

Optimization and Control · Mathematics 2016-09-30 Lei Yang , Ting Kei Pong , Xiaojun Chen

In this paper we propose an Alternating Direction Method of Multipliers (ADMM) algorithm for solving a Model Predictive Control (MPC) optimization problem, in which the system has state and input constraints and a nonlinear input map. The…

Optimization and Control · Mathematics 2018-07-30 Sebastian East , Mark Cannon

We discuss an online decentralized decision making problem where the agents are coupled with affine inequality constraints. Alternating Direction Method of Multipliers (ADMM) is used as the computation engine and we discuss the convergence…

Systems and Control · Electrical Eng. & Systems 2020-11-20 Yuxiao Chen , Mario Santillo , Mrdjan Jankovic , Aaron D. Ames

This paper considers the problem of distributed model fitting using the alternating directions method of multipliers (ADMM). ADMM splits the learning problem into several smaller subproblems, usually by partitioning the data samples. The…

Optimization and Control · Mathematics 2022-03-04 Dinesh Krishnamoorthy , Vyacheslav Kungurtsev

The alternating direction method of multipliers (ADMM) is one of the most widely used first-order optimisation methods in the literature owing to its simplicity, flexibility and efficiency. Over the years, numerous efforts are made to…

Optimization and Control · Mathematics 2019-12-02 Clarice Poon , Jingwei Liang

Parabolic optimal control problems with control constraints are generally challenging, from either theoretical analysis or algorithmic design perspectives. Conceptually, the well-known alternating direction method of multipliers (ADMM) can…

Optimization and Control · Mathematics 2020-05-05 Yongcun Song , Xiaoming Yuan , Hangrui Yue

Linearized alternating direction method of multipliers (ADMM) as an extension of ADMM has been widely used to solve linearly constrained problems in signal processing, machine leaning, communications, and many other fields. Despite its…

Optimization and Control · Mathematics 2017-11-02 Qinghua Liu , Xinyue Shen , Yuantao Gu

Many modern computer vision and machine learning applications rely on solving difficult optimization problems that involve non-differentiable objective functions and constraints. The alternating direction method of multipliers (ADMM) is a…

Computer Vision and Pattern Recognition · Computer Science 2017-04-11 Zheng Xu , Mario A. T. Figueiredo , Xiaoming Yuan , Christoph Studer , Tom Goldstein

Distributed radio interferometric calibration based on consensus optimization has been shown to improve the estimation of systematic errors in radio astronomical observations. The intrinsic continuity of systematic errors across frequency…

Instrumentation and Methods for Astrophysics · Physics 2017-10-17 Sarod Yatawatta , Faruk Diblen , Hanno Spreeuw

The alternating direction method of multipliers (ADMM) is widely used in solving structured convex optimization problems. Despite of its success in practice, the convergence properties of the standard ADMM for minimizing the sum of $N$…

Optimization and Control · Mathematics 2015-07-10 Tianyi Lin , Shiqian Ma , Shuzhong Zhang

The alternating direction method of multipliers (ADMM) has been recognized as a versatile approach for solving modern large-scale machine learning and signal processing problems efficiently. When the data size and/or the problem dimension…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-05-04 Tsung-Hui Chang , Wei-Cheng Liao , Mingyi Hong , Xiangfeng Wang

We consider three challenges in multi-block Alternating Direction Method of Multipliers (ADMM): building convergence conditions for ADMM with any block (variable) sequence, finding available block sequences to be fit for ADMM, and designing…

Systems and Control · Computer Science 2018-03-06 Jun Li , Hongfu Liu , Yue Wu , Yun Fu

In this paper we propose a corrected semi-proximal ADMM (alternating direction method of multipliers) for the general $p$-block $(p\!\ge 3)$ convex optimization problems with linear constraints, aiming to resolve the dilemma that almost all…

Optimization and Control · Mathematics 2015-02-12 Li Shen , Shaohua Pan