English
Related papers

Related papers: Quantized Consensus by the ADMM: Probabilistic ver…

200 papers

The paper presents a distributed model predictive control (DMPC) scheme for continuous-time nonlinear systems based on the alternating direction method of multipliers (ADMM). A stopping criterion in the ADMM algorithm limits the iterations…

Optimization and Control · Mathematics 2017-06-30 Anja Bestler , Knut Graichen

Non-convex quadratically constrained quadratic programming (QCQP) problems have numerous applications in signal processing, machine learning, and wireless communications, albeit the general QCQP is NP-hard, and several interesting special…

Optimization and Control · Mathematics 2016-09-21 Kejun Huang , Nicholas D. Sidiropoulos

This paper studies efficient distributed optimization methods for multi-agent networks. Specifically, we consider a convex optimization problem with a globally coupled linear equality constraint and local polyhedra constraints, and develop…

Systems and Control · Computer Science 2016-11-15 Tsung-Hui Chang

Alternating Direction Method of Multipliers (ADMM) is a popular algorithm for distributed learning, where a network of nodes collaboratively solve a regularized empirical risk minimization by iterative local computation associated with…

Machine Learning · Computer Science 2020-05-19 Zonghao Huang , Yanmin Gong

In this paper, we consider the unconstrained distributed optimization problem, in which the exchange of information in the network is captured by a directed graph topology, thus, nodes can only communicate with their neighbors.…

Systems and Control · Electrical Eng. & Systems 2023-12-07 Apostolos I. Rikos , Wei Jiang , Themistoklis Charalambous , Karl H. Johansson

We propose a distributed version of the Alternating Direction Method of Multipliers (ADMM) with linear updates for directed networks. We show that if the objective function of the minimization problem is smooth and strongly convex, our…

Optimization and Control · Mathematics 2023-09-21 Kiran Rokade , Rachel Kalpana Kalaimani

In this paper, we discuss a family of robust, high-dimensional regression models for quantile and composite quantile regression, both with and without an adaptive lasso penalty for variable selection. We reformulate these quantile…

Computation · Statistics 2020-06-29 Matthew Pietrosanu , Jueyu Gao , Linglong Kong , Bei Jiang , Di Niu

We consider the problems of computing the average degree and the size of a given network in a distributed fashion under quantized communication. We present two distributed algorithms which rely on quantized operation (i.e., nodes process…

Systems and Control · Electrical Eng. & Systems 2022-11-30 Apostolos I. Rikos , Themistoklis Charalambous , Christoforos N. Hadjicostis , Karl H. Johansson

We consider distributed iterative algorithms for the averaging problem over time-varying topologies. Our focus is on the convergence time of such algorithms when complete (unquantized) information is available, and on the degradation of…

Optimization and Control · Mathematics 2009-01-14 Angelia Nedić , Alex Olshevsky , Asuman Ozdaglar , John Tsitsiklis

The alternating direction method of multipliers (ADMM) has recently been recognized as a promising approach for large-scale machine learning models. However, very few results study ADMM from the aspect of communication costs, especially…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-11-25 Yu Ye , Hao Chen , Zheng Ma , Ming Xiao

In this article, we propose a communication-efficient decentralized machine learning (ML) algorithm, coined quantized group ADMM (Q-GADMM). To reduce the number of communication links, every worker in Q-GADMM communicates only with two…

Machine Learning · Computer Science 2025-01-22 Anis Elgabli , Jihong Park , Amrit S. Bedi , Chaouki Ben Issaid , Mehdi Bennis , Vaneet Aggarwal

The Alternating Direction Method of Multipliers (ADMM) has gained a lot of attention for solving large-scale and objective-separable constrained optimization. However, the two-block variable structure of the ADMM still limits the practical…

Optimization and Control · Mathematics 2020-03-24 Kresimir Mihic , Mingxi Zhu , Yinyu Ye

In this paper, we propose a novel distributed alternating direction method of multipliers (ADMM) algorithm with synergetic communication and computation, called SCCD-ADMM, to reduce the total communication and computation cost of the…

Signal Processing · Electrical Eng. & Systems 2020-09-30 Zhuojun Tian , Zhaoyang Zhang , Jue Wang , Xiaoming Chen , Wei Wang , Huaiyu Dai

Consensus planning is a method for coordinating decision making across complex systems and organizations, including complex supply chain optimization pipelines. It arises when large interdependent distributed agents (systems) share common…

Optimization and Control · Mathematics 2025-11-25 Alvaro Maggiar , Lee Dicker , Michael Mahoney

The alternating direction method of multipliers (ADMM) has been recognized as a versatile approach for solving modern large-scale machine learning and signal processing problems efficiently. When the data size and/or the problem dimension…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-05-04 Tsung-Hui Chang , Wei-Cheng Liao , Mingyi Hong , Xiangfeng Wang

In this paper, we study the randomized distributed coordinate descent algorithm with quantized updates. In the literature, the iteration complexity of the randomized distributed coordinate descent algorithm has been characterized under the…

Machine Learning · Statistics 2017-01-23 Mostafa El Gamal , Lifeng Lai

By coordinating terminal smart devices or microprocessors to engage in cooperative computation to achieve systemlevel targets, distributed optimization is incrementally favored by both engineering and computer science. The well-known…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-08-24 Yu Yang , Xiaohong Guan , Qing-Shan Jia , Liang Yu , Bolun Xu , Costas J. Spanos

Latency is inherent in almost all real-world networked applications. In this paper, we propose a distributed allocation strategy over multi-agent networks with delayed communications. The state of each agent (or node) represents its share…

Systems and Control · Electrical Eng. & Systems 2022-08-31 Mohammadreza Doostmohammadian , Wei Jiang , Themistoklis Charalambous

This paper investigates distributed resource allocation optimization over directed graphs with limited communication bandwidth. We develop a novel distributed algorithm that integrates the centralized Proximal Jacobian Alternating Direction…

Optimization and Control · Mathematics 2026-04-17 Xu Du , Boyu Han , Ivano Notarnicola , Karl H. Johansson , Apostolos I. Rikos

This paper introduces a dual-regularized ADMM approach to distributed, time-varying optimization. The proposed algorithm is designed in a prediction-correction framework, in which the computing nodes predict the future local costs based on…

Optimization and Control · Mathematics 2024-05-07 Nicola Bastianello , Andrea Simonetto , Ruggero Carli