English
Related papers

Related papers: Simultaneous activity and attenuation estimation i…

200 papers

The alternating direction method of multipliers (ADMM) is a flexible method to solve a large class of convex minimization problems. Particular features are its unconditional convergence with respect to the involved step size and its direct…

Numerical Analysis · Mathematics 2017-04-21 Sören Bartels , Marijo Milicevic

As a well-known optimization framework, the Alternating Direction Method of Multipliers (ADMM) has achieved tremendous success in many classification and regression applications. Recently, it has attracted the attention of deep learning…

Machine Learning · Computer Science 2021-12-23 Junxiang Wang , Hongyi Li , Liang Zhao

The problem of direction of arrival (DOA) estimation has been studied for decades as an essential technology in enabling radar, wireless communications, and array signal processing related applications. In this paper, the DOA estimation…

Signal Processing · Electrical Eng. & Systems 2022-03-22 Peng Chen , Zhimin Chen , Zhenxin Cao , Xianbin Wang

This paper proposes and analyzes a dampened proximal alternating direction method of multipliers (DP.ADMM) for solving linearly-constrained nonconvex optimization problems where the smooth part of the objective function is nonseparable.…

Optimization and Control · Mathematics 2023-01-05 Weiwei Kong , Renato D. C. Monteiro

In this paper, we devise a sparse array design algorithm for adaptive beamforming. Our strategy is based on finding a sparse beamformer weight to maximize the output signal-to-interference-plus-noise ratio (SINR). The proposed method…

Signal Processing · Electrical Eng. & Systems 2023-10-17 Huiping Huang , Hing Cheung So , Abdelhak M. Zoubir

We present a flexible Alternating Direction Method of Multipliers (F-ADMM) algorithm for solving optimization problems involving a strongly convex objective function that is separable into $n \geq 2$ blocks, subject to (non-separable)…

Optimization and Control · Mathematics 2015-03-24 Daniel P. Robinson , Rachael E. H. Tappenden

Alternating Direction Method of Multipliers (ADMM) is a popular algorithm for distributed learning, where a network of nodes collaboratively solve a regularized empirical risk minimization by iterative local computation associated with…

Machine Learning · Computer Science 2020-05-19 Zonghao Huang , Yanmin Gong

Spike and slab priors play a key role in inducing sparsity for sparse signal recovery. The use of such priors results in hard non-convex and mixed integer programming problems. Most of the existing algorithms to solve the optimization…

Methodology · Statistics 2019-04-02 Fekadu L. Bayisa , Zhiyong Zhou , Ottmar Cronie , Jun Yu

This paper proposes a parallel optimization algorithm for cooperative automation of large-scale connected vehicles. The task of cooperative automation is formulated as a centralized optimization problem taking the whole decision space of…

Systems and Control · Computer Science 2018-08-01 Zhitao Wang , Yang Zheng , Shengbo Eben Li , Keyou You , Keqiang Li

This work studies the linear convergence of an accelerated scheme of the Alternating Direction Method of Multipliers (ADMM) for strongly convex and Lipschitz-smooth problems. We use the methodology of expressing the accelerated ADMM as a…

Optimization and Control · Mathematics 2025-12-08 Meisam Tavakoli , Fabian Jakob , Guido Carnevale , Giuseppe Notarstefano , Andrea Iannelli

One of the crucial issues in federated learning is how to develop efficient optimization algorithms. Most of the current ones require full device participation and/or impose strong assumptions for convergence. Different from the widely-used…

Optimization and Control · Mathematics 2023-09-26 Shenglong Zhou , Geoffrey Ye Li

Multi-agent distributed optimization over a network minimizes a global objective formed by a sum of local convex functions using only local computation and communication. We develop and analyze a quantized distributed algorithm based on the…

Optimization and Control · Mathematics 2016-11-17 Shengyu Zhu , Mingyi Hong , Biao Chen

We consider a class of distributed optimization problem where the objective function consists of a sum of strongly convex and smooth functions and a (possibly nonsmooth) convex regularizer. A multi-agent network is assumed, where each agent…

Optimization and Control · Mathematics 2021-10-01 Yichuan Li , Yonghai Gong , Nikolaos M. Freris , Petros Voulgaris , Dusan Stipanovic

From a dual perspective of the sparse representation model, Nam et al. proposed the cosparse analysis model. In this paper, we aim to investigate the convergence of the alternating direction method of multipliers (ADMM) for the cosparse…

Optimization and Control · Mathematics 2023-11-23 Zisheng Liu , Ting Zhang

A lift-and-permute scheme of alternating direction method of multipliers (ADMM) is proposed for linearly constrained convex programming. It contains not only the newly developed balanced augmented Lagrangian method and its dual-primal…

Optimization and Control · Mathematics 2022-03-31 Shiru Li , Yong Xia , Tao Zhang

The alternating direction method of multipliers (ADMM) has been widely adopted in low-rank approximation and low-order model identification tasks; however, the performance of nonconvex ADMM is highly reliant on the choice of penalty…

Optimization and Control · Mathematics 2023-09-11 Qingyuan Liu , Zhengchao Huang , Hao Ye , Dexian Huang , Chao Shang

The alternating direction method of multipliers (ADMM) is a powerful optimization solver in machine learning. Recently, stochastic ADMM has been integrated with variance reduction methods for stochastic gradient, leading to SAG-ADMM and…

Machine Learning · Computer Science 2016-10-18 Shuai Zheng , James T. Kwok

To meet the ever growing demand for both high throughput and uniform coverage in future wireless networks, dense network deployment will be ubiquitous, for which co- operation among the access points is critical. Considering the…

Information Theory · Computer Science 2014-05-14 Yuanming Shi , Jun Zhang , Khaled B. Letaief

Stochastic alternating direction method of multipliers (SADMM) is a popular method for solving nonconvex nonsmooth optimization in various applications. However, it typically requires an empirical selection of the static batch size for…

Optimization and Control · Mathematics 2026-01-23 Jiachen Jin , Kangkang Deng , Boyu Wang , Hongxia Wang

Numerous problems in machine learning are formulated as optimization with manifold constraints. In this paper, we propose the Manifold alternating directions method of multipliers (MADMM), an extension of the classical ADMM scheme for…

Optimization and Control · Mathematics 2015-05-29 Artiom Kovnatsky , Klaus Glashoff , Michael M. Bronstein