English
Related papers

Related papers: Random multi-block ADMM: an ALM based view for the…

200 papers

In this paper, we propose an inexact multi-block ADMM-type first-order method for solving a class of high-dimensional convex composite conic optimization problems to moderate accuracy. The design of this method combines an inexact 2-block…

Optimization and Control · Mathematics 2020-06-09 Liang Chen , Defeng Sun , Kim-Chuan Toh

In this paper, we formally analyze global convergence in the realm of distributed consensus optimization. Current solutions have explored such analysis, particularly focusing on consensus alternating direction method of multipliers (CADMM),…

Optimization and Control · Mathematics 2023-09-07 Xu Du , Jingzhe Wang , Xiaohua Zhou , Yijie Mao

Learning to Optimize (L2O) approaches, including algorithm unrolling, plug-and-play methods, and hyperparameter learning, have garnered significant attention and have been successfully applied to the Alternating Direction Method of…

Optimization and Control · Mathematics 2024-09-27 Ling Liang , Cameron Austin , Haizhao Yang

The alternating direction method of multipliers (ADMM) has been recognized as a versatile approach for solving modern large-scale machine learning and signal processing problems efficiently. When the data size and/or the problem dimension…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-05-04 Tsung-Hui Chang , Wei-Cheng Liao , Mingyi Hong , Xiangfeng Wang

As an extension of the alternating direction method of multipliers (ADMM), the semi-proximal ADMM (sPADMM) has been widely used in various fields due to its flexibility and robustness. In this paper, we first show that the two-block sPADMM…

Optimization and Control · Mathematics 2025-05-28 Peng Liu , Liang Chen , Minru Bai

This paper introduces two decomposition-based methods for two-block mixed-integer linear programs (MILPs), which aim to take advantage of separable structures of the original problem by solving a sequence of lower-dimensional MILPs. The…

Optimization and Control · Mathematics 2024-01-03 Kaizhao Sun , Mou Sun , Wotao Yin

This paper investigates the collision-free control problem for multi-agent systems. For such multi-agent systems, it is the typical situation where conventional methods using either the usual centralized model predictive control (MPC), or…

Multiagent Systems · Computer Science 2024-02-07 Zilong Cheng , Jun Ma , Wenxin Wang , Zicheng Zhu , Clarence W. de Silva , Tong Heng Lee

In this paper we study an unconventional inexact Augmented Lagrangian Method (ALM) for convex optimization problems, as first proposed by Bertsekas, wherein the penalty term is a potentially non-Euclidean norm raised to a power between one…

Optimization and Control · Mathematics 2025-10-02 Konstantinos A. Oikonomidis , Alexander Bodard , Emanuel Laude , Panagiotis Patrinos

Recently, many variance reduced stochastic alternating direction method of multipliers (ADMM) methods (e.g.\ SAG-ADMM, SDCA-ADMM and SVRG-ADMM) have made exciting progress such as linear convergence rates for strongly convex problems.…

Machine Learning · Computer Science 2017-07-12 Yuanyuan Liu , Fanhua Shang , James Cheng

This article investigates the convergence properties of a relative-type inexact preconditioned proximal augmented Lagrangian method (rip$^2$ALM) for convex nonlinear programming, a fundamental class of optimization problems with broad…

Optimization and Control · Mathematics 2026-03-31 Lei Yang , Jiayi Zhu , Ling Liang , Kim-Chuan Toh

In this paper we propose an Alternating Direction Method of Multipliers (ADMM) algorithm for solving a Model Predictive Control (MPC) optimization problem, in which the system has state and input constraints and a nonlinear input map. The…

Optimization and Control · Mathematics 2018-07-30 Sebastian East , Mark Cannon

Recently, there has been great interest in connections between continuous-time dynamical systems and optimization methods, notably in the context of accelerated methods for smooth and unconstrained problems. In this paper we extend this…

Optimization and Control · Mathematics 2023-01-25 Guilherme França , Daniel P. Robinson , René Vidal

This paper considers the problem of distributed model fitting using the alternating directions method of multipliers (ADMM). ADMM splits the learning problem into several smaller subproblems, usually by partitioning the data samples. The…

Optimization and Control · Mathematics 2022-03-04 Dinesh Krishnamoorthy , Vyacheslav Kungurtsev

We propose a distributed nonparametric algorithm for solving measure-valued optimization problems with additive objectives. Such problems arise in several contexts in stochastic learning and control including Langevin sampling from an…

Optimization and Control · Mathematics 2022-02-21 Iman Nodozi , Abhishek Halder

The alternating direction method of multipliers (ADMM) has emerged as a powerful technique for large-scale structured optimization. Despite many recent results on the convergence properties of ADMM, a quantitative characterization of the…

Optimization and Control · Mathematics 2016-11-17 Euhanna Ghadimi , André Teixeira , Iman Shames , Mikael Johansson

This paper introduces the Bi-linear consensus Alternating Direction Method of Multipliers (Bi-cADMM), aimed at solving large-scale regularized Sparse Machine Learning (SML) problems defined over a network of computational nodes.…

Machine Learning · Computer Science 2024-06-27 Alireza Olama , Andreas Lundell , Jan Kronqvist , Elham Ahmadi , Eduardo Camponogara

The alternating direction method of multipliers (ADMM) is a popular approach for solving optimization problems that are potentially non-smooth and with hard constraints. It has been applied to various computer graphics applications,…

Graphics · Computer Science 2019-09-04 Juyong Zhang , Yue Peng , Wenqing Ouyang , Bailin Deng

This paper presents a tutorial on the Consensus Alternating Direction Method of Multipliers (Consensus ADMM) for distributed optimization, with a specific focus on applications in multi-robot systems. In this tutorial, we derive the…

Optimization and Control · Mathematics 2024-10-08 Jushan Chen

This paper consists of a tutorial on the Augmented Lagrangian based Alternating Direction Inexact Newton method (ALADIN) and its application to distributed model predictive control (MPC). The focus is - for simplicity of presentation - on…

Optimization and Control · Mathematics 2022-04-05 Boris Houska , Jiahe Shi

The Alternating Direction Method of Multipliers (ADMM) provides a natural way of solving inverse problems with multiple partial differential equations (PDE) forward models and nonsmooth regularization. ADMM allows splitting these…

Numerical Analysis · Mathematics 2021-04-29 Luke Lozenski , Umberto Villa