English
Related papers

Related papers: An ADMM algorithm for solving a proximal bound-con…

200 papers

This paper introduces a novel approach to solving multi-block nonconvex composite optimization problems through a proximal linearized Alternating Direction Method of Multipliers (ADMM). This method incorporates an Increasing Penalization…

Optimization and Control · Mathematics 2025-04-01 Ganzhao Yuan

In this paper, we develop an efficient decoder via the proximal alternating direction method of multipliers (proximal-ADMM) technique for nonbinary linear block codes in the Galois field. Its main contents are as follows: first, exploiting…

Information Theory · Computer Science 2020-10-20 Yongchao Wang , Jing Bai

We present a systematic weight pruning framework of deep neural networks (DNNs) using the alternating direction method of multipliers (ADMM). We first formulate the weight pruning problem of DNNs as a constrained nonconvex optimization…

Machine Learning · Computer Science 2018-04-24 Tianyun Zhang , Shaokai Ye , Yipeng Zhang , Yanzhi Wang , Makan Fardad

We study several versions of the alternating direction method of multipliers (ADMM) for solving the convex problem of finding the distance between two ellipsoids and the nonconvex problem of finding the distance between the boundaries of…

Optimization and Control · Mathematics 2021-07-06 M. V. Dolgopolik

We present a powerful and easy-to-implement iterative algorithm for solving large-scale optimization problems that involve $L_1$/total-variation (TV) regularization. The method is based on combining the Alternating Directions Method of…

Optimization and Control · Mathematics 2016-02-23 Musa Maharramov , Stewart A. Levin

The linearly constrained convex composite programming problems whose objective function contains two blocks with each block being the form of nonsmooth+smooth arises frequently in multiple fields of applications. If both of the smooth terms…

Optimization and Control · Mathematics 2021-11-25 Congying Qin , Yunhai Xiao , Peili Li

We propose a bilinear decomposition for the Burer-Monteiro method and combine it with the standard Alternating Direction Method of Multipliers algorithm for semidefinite programming. Bilinear decomposition reduces the degree of the…

Optimization and Control · Mathematics 2023-02-09 Yuwen Chen , Paul Goulart

In this paper, we propose a novel distributed alternating direction method of multipliers (ADMM) algorithm with synergetic communication and computation, called SCCD-ADMM, to reduce the total communication and computation cost of the…

Signal Processing · Electrical Eng. & Systems 2020-09-30 Zhuojun Tian , Zhaoyang Zhang , Jue Wang , Xiaoming Chen , Wei Wang , Huaiyu Dai

Stochastic gradient descent (SGD) and its many variants are the widespread optimization algorithms for training deep neural networks. However, SGD suffers from inevitable drawbacks, including vanishing gradients, lack of theoretical…

Machine Learning · Computer Science 2024-01-09 Zeinab Ebrahimi , Gustavo Batista , Mohammad Deghat

Aiming at solving large-scale learning problems, this paper studies distributed optimization methods based on the alternating direction method of multipliers (ADMM). By formulating the learning problem as a consensus problem, the ADMM can…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-05-04 Tsung-Hui Chang , Mingyi Hong , Wei-Cheng Liao , Xiangfeng Wang

We consider a class of Riemannian optimization problems where the objective is the sum of a smooth function and a nonsmooth function, considered in the ambient space. This class of problems finds important applications in machine learning…

Optimization and Control · Mathematics 2024-11-27 Jiaxiang Li , Shiqian Ma , Tejes Srivastava

We develop two new variants of alternating direction methods of multipliers (ADMM) and two parallel primal-dual decomposition algorithms to solve a wide range class of constrained convex optimization problems. Our approach relies on a novel…

Optimization and Control · Mathematics 2018-06-15 Quoc Tran-Dinh , Yuzixuan Zhu

This paper presents a numerical solver for computing continuous trajectories in non-convex environments. Our approach relies on a customized implementation of the Alternating Direction Method of Multipliers (ADMM) built upon two key…

Robotics · Computer Science 2026-03-13 Lukas Pries , Jon Arrizabalaga , Zachary Manchester , Markus Ryll

This paper addresses a quadratic problem with assignment constraints, an NP-hard combinatorial optimization problem arisen from facility location, multiple-input multiple-output detection, and maximum mean discrepancy calculation et al. The…

Optimization and Control · Mathematics 2025-12-15 Lijun Xie , Ran Gu , Xin Liu

In distributed optimization and federated learning, asynchronous alternating direction method of multipliers (ADMM) serves as an attractive option for large-scale optimization, data privacy, straggler nodes and variety of objective…

Machine Learning · Computer Science 2025-08-19 Sagar Shrestha

Alternating Direction Method of Multipliers (ADMM) is a popular convex optimization algorithm, which can be employed for solving distributed consensus optimization problems. In this setting agents locally estimate the optimal solution of an…

Signal Processing · Electrical Eng. & Systems 2019-03-27 Layla Majzoobi , Farshad Lahouti , Vahid Shah-Mansouri

Accompanied with the rising popularity of compressed sensing, the Alternating Direction Method of Multipliers (ADMM) has become the most widely used solver for linearly constrained convex problems with separable objectives. In this work, we…

Numerical Analysis · Computer Science 2016-07-12 Canyi Lu , Jiashi Feng , Shuicheng Yan , Zhouchen Lin

We present an algorithm based on the alternating direction method of multipliers (ADMM) for solving nonlinear matrix decompositions (NMD). Given an input matrix $X \in \mathbb{R}^{m \times n}$ and a factorization rank $r \ll \min(m, n)$,…

Signal Processing · Electrical Eng. & Systems 2025-12-23 Atharva Awari , Nicolas Gillis , Arnaud Vandaele

The Alternating Direction Method of Multipliers (ADMM) is a widely used method for structured convex optimization, and its practical performance depends strongly on the choice of penalty and relaxation parameters. Motivated by settings such…

Optimization and Control · Mathematics 2026-04-30 Junan Lin , Paul J. Goulart , Luca Furieri

We propose an algorithm for solving bound-constrained mathematical programs with complementarity constraints on the variables. Each iteration of the algorithm involves solving a linear program with complementarity constraints in order to…

Optimization and Control · Mathematics 2022-01-14 Christian Kirches , Jeffrey Larson , Sven Leyffer , Paul Manns