English
Related papers

Related papers: ADMM for Efficient Deep Learning with Global Conve…

200 papers

This paper presents a numerical solver for computing continuous trajectories in non-convex environments. Our approach relies on a customized implementation of the Alternating Direction Method of Multipliers (ADMM) built upon two key…

Robotics · Computer Science 2026-03-13 Lukas Pries , Jon Arrizabalaga , Zachary Manchester , Markus Ryll

This paper introduces the Bi-linear consensus Alternating Direction Method of Multipliers (Bi-cADMM), aimed at solving large-scale regularized Sparse Machine Learning (SML) problems defined over a network of computational nodes.…

Machine Learning · Computer Science 2024-06-27 Alireza Olama , Andreas Lundell , Jan Kronqvist , Elham Ahmadi , Eduardo Camponogara

Due to the explosion in size and complexity of modern data sets and privacy concerns of data holders, it is increasingly important to be able to solve machine learning problems in distributed manners. The Alternating Direction Method of…

Networking and Internet Architecture · Computer Science 2021-04-27 Saeedeh Parsaeefard , Alberto Leon Garcia

We present ADMM-Softmax, an alternating direction method of multipliers (ADMM) for solving multinomial logistic regression (MLR) problems. Our method is geared toward supervised classification tasks with many examples and features. It…

Machine Learning · Computer Science 2019-07-12 Samy Wu Fung , Sanna Tyrväinen , Lars Ruthotto , Eldad Haber

This paper proposes a dual Riemannian alternating direction method of multipliers (ADMM) for solving low-rank semidefinite programs with unit diagonal constraints. We recast the ADMM subproblem as a Riemannian optimization problem over the…

Optimization and Control · Mathematics 2025-12-05 Jie Wang , Liangbing Hu , Bican Xia

Stochastic versions of the alternating direction method of multiplier (ADMM) and its variants play a key role in many modern large-scale machine learning problems. In this work, we introduce a unified algorithmic framework called…

Optimization and Control · Mathematics 2024-04-23 Chris Junchi Li

We discuss an online decentralized decision making problem where the agents are coupled with affine inequality constraints. Alternating Direction Method of Multipliers (ADMM) is used as the computation engine and we discuss the convergence…

Systems and Control · Electrical Eng. & Systems 2020-11-20 Yuxiao Chen , Mario Santillo , Mrdjan Jankovic , Aaron D. Ames

We address the problem of solving convex optimization problems with many convex constraints in a distributed setting. Our approach is based on an extension of the alternating direction method of multipliers (ADMM) that recently gained a lot…

Optimization and Control · Mathematics 2018-04-09 Joachim Giesen , Sören Laue

In this paper, we introduce a unified framework for studying various cloud traffic management problems, ranging from geographical load balancing to backbone traffic engineering. We first abstract these real-world problems as a…

Networking and Internet Architecture · Computer Science 2016-02-04 Chen Feng , Hong Xu , Baochun Li

We consider the sequence acceleration problem for the alternating direction method-of-multipliers (ADMM) applied to a class of equality-constrained problems with strongly convex quadratic objectives, which frequently arise as the Newton…

Optimization and Control · Mathematics 2020-04-28 Richard Y. Zhang , Jacob K. White

We present a flexible Alternating Direction Method of Multipliers (F-ADMM) algorithm for solving optimization problems involving a strongly convex objective function that is separable into $n \geq 2$ blocks, subject to (non-separable)…

Optimization and Control · Mathematics 2015-03-24 Daniel P. Robinson , Rachael E. H. Tappenden

The alternating direction method of multipliers (ADMM) is one of the most widely used first-order optimisation methods in the literature owing to its simplicity, flexibility and efficiency. Over the years, numerous efforts are made to…

Optimization and Control · Mathematics 2019-12-02 Clarice Poon , Jingwei Liang

The alternating direction method with multipliers (ADMM) has been one of most powerful and successful methods for solving various convex or nonconvex composite problems that arise in the fields of image & signal processing and machine…

Optimization and Control · Mathematics 2014-12-08 Fenghui Wang , Zongben Xu , Hong-Kun Xu

The alternating direction method of multipliers (ADMM) has been popular for solving many signal processing problems, convex or nonconvex. In this paper, we study an asynchronous implementation of the ADMM for solving a nonconvex nonsmooth…

Information Theory · Computer Science 2014-12-19 Mingyi Hong

Non-convex constrained optimizations are ubiquitous in robotic applications such as multi-agent navigation, UAV trajectory optimization, and soft robot simulation. For this problem class, conventional optimizers suffer from small step sizes…

Optimization and Control · Mathematics 2025-10-08 Zherong Pan , Kui Wu

An inexact accelerated stochastic Alternating Direction Method of Multipliers (AS-ADMM) scheme is developed for solving structured separable convex optimization problems with linear constraints. The objective function is the sum of a…

Optimization and Control · Mathematics 2020-10-27 Jianchao Bai , William W. Hager , Hongchao Zhang

This paper introduces a parallel and distributed extension to the alternating direction method of multipliers (ADMM) for solving convex problem: minimize $\sum_{i=1}^N f_i(x_i)$ subject to $\sum_{i=1}^N A_i x_i=c, x_i\in \mathcal{X}_i$. The…

Optimization and Control · Mathematics 2014-03-20 Wei Deng , Ming-Jun Lai , Zhimin Peng , Wotao Yin

In this paper, we study a class of non-convex optimization problems known as multi-affine quadratic equality constrained problems, which appear in various applications--from generating feasible force trajectories in robotic locomotion and…

Optimization and Control · Mathematics 2026-03-13 Yutong Chao , Michal Ciebielski , Jalal Etesami , Majid Khadiv

The alternating direction method of multipliers (ADMM) has been successfully applied to solve structured convex optimization problems due to its superior practical performance. The convergence properties of the 2-block ADMM have been…

Optimization and Control · Mathematics 2018-01-19 Tianyi Lin , Shiqian Ma , Shuzhong Zhang

This work presents a new method for online selection of multiple penalty parameters for the alternating direction method of multipliers (ADMM) algorithm applied to optimization problems with multiple constraints or functionals with block…

Image and Video Processing · Electrical Eng. & Systems 2026-04-21 Luke Lozenski , Michael T. McCann , Brendt Wohlberg