English
Related papers

Related papers: Convergence of multi-block Bregman ADMM for noncon…

200 papers

We propose a distributed version of the Alternating Direction Method of Multipliers (ADMM) with linear updates for directed networks. We show that if the objective function of the minimization problem is smooth and strongly convex, our…

Optimization and Control · Mathematics 2023-09-21 Kiran Rokade , Rachel Kalpana Kalaimani

The alternating direction method of multipliers (ADMM) is one of the most widely used first-order optimisation methods in the literature owing to its simplicity, flexibility and efficiency. Over the years, numerous efforts are made to…

Optimization and Control · Mathematics 2019-12-02 Clarice Poon , Jingwei Liang

We propose a new relative-error inexact version of the alternating direction method of multipliers (ADMM) for convex optimization. We prove the asymptotic convergence of our main algorithm as well as pointwise and ergodic…

Optimization and Control · Mathematics 2024-09-17 M. Marques Alves , M. Geremia

We introduce and analyze BPALM and A-BPALM, two multi-block proximal alternating linearized minimization algorithms using Bregman distances for solving structured nonconvex problems. The objective function is the sum of a multi-block…

Optimization and Control · Mathematics 2021-12-20 Masoud Ahookhosh , Le Thi Khanh Hien , Nicolas Gillis , Panagiotis Patrinos

We develop a new consensus-based distributed algorithm for solving learning problems with feature partitioning and non-smooth convex objective functions. Such learning problems are not separable, i.e., the associated objective functions…

Signal Processing · Electrical Eng. & Systems 2022-08-25 Cristiano Gratton , Naveen K. D. Venkategowda , Reza Arablouei , Stefan Werner

Alternating Direction Method of Multipliers (ADMM) is a popular convex optimization algorithm, which can be employed for solving distributed consensus optimization problems. In this setting agents locally estimate the optimal solution of an…

Signal Processing · Electrical Eng. & Systems 2019-03-27 Layla Majzoobi , Farshad Lahouti , Vahid Shah-Mansouri

We investigate a class of general combinatorial graph problems, including MAX-CUT and community detection, reformulated as quadratic objectives over nonconvex constraints and solved via the alternating direction method of multipliers…

Optimization and Control · Mathematics 2018-05-29 Chuangchuang Sun , Yifan Sun , Ran Dai

In the fields of statistics, machine learning, image science, and related areas, there is an increasing demand for decentralized collection or storage of large-scale datasets, as well as distributed solution methods. To tackle this…

Optimization and Control · Mathematics 2024-01-17 Bowen Li , Bin Shi

This paper investigates the collision-free control problem for multi-agent systems. For such multi-agent systems, it is the typical situation where conventional methods using either the usual centralized model predictive control (MPC), or…

Multiagent Systems · Computer Science 2024-02-07 Zilong Cheng , Jun Ma , Wenxin Wang , Zicheng Zhu , Clarence W. de Silva , Tong Heng Lee

The Alternating Direction Method of Multipliers (ADMM) has been studied for years. The traditional ADMM algorithm needs to compute, at each iteration, an (empirical) expected loss function on all training examples, resulting in a…

Machine Learning · Statistics 2014-06-10 Peilin Zhao , Jinwei Yang , Tong Zhang , Ping Li

In the context of convex optimization problems in Hilbert spaces, we induce inertial effects into the classical ADMM numerical scheme and obtain in this way so-called inertial ADMM algorithms, the convergence properties of which we…

Optimization and Control · Mathematics 2014-04-18 Radu Ioan Bot , Ernö Robert Csetnek

This paper presents a numerical solver for computing continuous trajectories in non-convex environments. Our approach relies on a customized implementation of the Alternating Direction Method of Multipliers (ADMM) built upon two key…

Robotics · Computer Science 2026-03-13 Lukas Pries , Jon Arrizabalaga , Zachary Manchester , Markus Ryll

In this paper, we consider a multi-block generalized alternating direction method of multiplier (GADMM) algorithm for minimizing a linearly constrained separable nonconvex and possibly nonsmooth optimization problem. The GADMM generalizes…

Optimization and Control · Mathematics 2021-09-02 Maryam Yashtini

In this paper, we review the parallel and distributed optimization algorithms based on the alternating direction method of multipliers (ADMM) for solving "big data" optimization problems in modern communication networks. We first introduce…

Numerical Analysis · Computer Science 2015-04-09 Lanchao Liu , Zhu Han

The alternating direction method of multipliers (ADMM) has been widely adopted in low-rank approximation and low-order model identification tasks; however, the performance of nonconvex ADMM is highly reliant on the choice of penalty…

Optimization and Control · Mathematics 2023-09-11 Qingyuan Liu , Zhengchao Huang , Hao Ye , Dexian Huang , Chao Shang

The parallel alternating direction method of multipliers (ADMM) algorithm is widely recognized for its effectiveness in handling large-scale datasets stored in a distributed manner, making it a popular choice for solving statistical…

Machine Learning · Statistics 2023-11-22 Xiaofei Wu , Zhimin Zhang , Zhenyu Cui

We are presenting a modification of the well-known Alternating Direction Method of Multipliers (ADMM) algorithm with additional preconditioning that aims at solving convex optimisation problems with nonlinear operator constraints.…

Numerical Analysis · Mathematics 2020-02-13 Martin Benning , Florian Knoll , Carola-Bibiane Schönlieb , Tuomo Valkonen

In this paper, we study a constrained minimization problem that arise from materials science to determine the dislocation (line defect) structure of grain boundaries. The problems aims to minimize the energy of the grain boundary with…

Optimization and Control · Mathematics 2024-12-24 Yue Wu , Luchan Zhang , Yang Xiang

In this paper, we consider a prototypical convex optimization problem with multi-block variables and separable structures. By adding the Logarithmic Quadratic Proximal (LQP) regularizer with suitable proximal parameter to each of the first…

Numerical Analysis · Mathematics 2021-04-01 Jianchao Bai , Yuxue Ma , Hao Sun , Miao Zhang

From a dual perspective of the sparse representation model, Nam et al. proposed the cosparse analysis model. In this paper, we aim to investigate the convergence of the alternating direction method of multipliers (ADMM) for the cosparse…

Optimization and Control · Mathematics 2023-11-23 Zisheng Liu , Ting Zhang