English
Related papers

Related papers: A Brief Tutorial on Consensus ADMM for Distributed…

200 papers

The present work introduces the hybrid consensus alternating direction method of multipliers (H-CADMM), a novel framework for optimization over networks which unifies existing distributed optimization approaches, including the centralized…

Optimization and Control · Mathematics 2018-05-10 Meng Ma , Athanasios N. Nikolakopoulos , Georgios B. Giannakis

Truss robots, or robots that consist of extensible links connected at universal joints, are often designed with modular physical components but require centralized control techniques. This paper presents a distributed control technique for…

Robotics · Computer Science 2021-08-17 Nathan S. Usevitch , Trevor Halsted , Zachary M. Hammond , Allison M. Okamura , Mac Schwager

Big data, including applications with high security requirements, are often collected and stored on multiple heterogeneous devices, such as mobile devices, drones and vehicles. Due to the limitations of communication costs and security…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-10-05 Hao Chen , Yu Ye , Ming Xiao , Mikael Skoglund , H. Vincent Poor

One of the crucial issues in federated learning is how to develop efficient optimization algorithms. Most of the current ones require full device participation and/or impose strong assumptions for convergence. Different from the widely-used…

Optimization and Control · Mathematics 2023-09-26 Shenglong Zhou , Geoffrey Ye Li

Large scale, non-convex optimization problems arising in many complex networks such as the power system call for efficient and scalable distributed optimization algorithms. Existing distributed methods are usually iterative and require…

Optimization and Control · Mathematics 2017-10-26 Junyao Guo , Gabriela Hug , Ozan Tonguz

This paper investigates solving convex composite optimization on an undirected network, where each node, privately endowed with a smooth component function and a nonsmooth one, is required to minimize the sum of all the component functions…

Optimization and Control · Mathematics 2021-08-13 Xuyang Wu , Jie Lu

This paper presents a novel accelerated distributed algorithm for unconstrained consensus optimization over static undirected networks. The proposed algorithm combines the benefits of acceleration from momentum, the robustness of the…

Optimization and Control · Mathematics 2024-05-15 Eduardo Sebastián , Mauro Franceschelli , Andrea Gasparri , Eduardo Montijano , Carlos Sagüés

Alternating Direction Method of Multipliers (ADMM) is a popular method for solving large-scale Machine Learning problems. Stochastic ADMM was proposed to reduce the per iteration computational complexity, which is more suitable for big data…

Numerical Analysis · Computer Science 2023-04-25 Chao Zhang , Zebang Shen , Hui Qian , Tengfei Zhou , Jianya Zhou , Jianying Zhou

This paper focuses on distributed learning-based control of decentralized multi-agent systems where the agents' dynamics are modeled by Gaussian Processes (GPs). Two fundamental problems are considered: the optimal design of experiment for…

Systems and Control · Electrical Eng. & Systems 2021-04-06 Viet-Anh Le , Truong X. Nghiem

In this paper, we propose a novel distributed alternating direction method of multipliers (ADMM) algorithm with synergetic communication and computation, called SCCD-ADMM, to reduce the total communication and computation cost of the…

Signal Processing · Electrical Eng. & Systems 2020-09-30 Zhuojun Tian , Zhaoyang Zhang , Jue Wang , Xiaoming Chen , Wei Wang , Huaiyu Dai

Nonconvex and structured optimization problems arise in many engineering applications that demand scalable and distributed solution methods. The study of the convergence properties of these methods is in general difficult due to the…

Optimization and Control · Mathematics 2015-05-04 Sindri Magnússon , Pradeep Chathuranga Weeraddana , Michael G. Rabbat , Carlo Fischione

In distributed optimization and federated learning, asynchronous alternating direction method of multipliers (ADMM) serves as an attractive option for large-scale optimization, data privacy, straggler nodes and variety of objective…

Machine Learning · Computer Science 2025-08-19 Sagar Shrestha

In this paper, we propose the primal-dual method of multipliers (PDMM) for distributed optimization over a graph. In particular, we optimize a sum of convex functions defined over a graph, where every edge in the graph carries a linear…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-02-06 G. Zhang , R. Heusdens

This paper investigates the collision-free control problem for multi-agent systems. For such multi-agent systems, it is the typical situation where conventional methods using either the usual centralized model predictive control (MPC), or…

Multiagent Systems · Computer Science 2024-02-07 Zilong Cheng , Jun Ma , Wenxin Wang , Zicheng Zhu , Clarence W. de Silva , Tong Heng Lee

Alternating direction method of multipliers (ADMM) is a popular first-order method owing to its simplicity and efficiency. However, similar to other proximal splitting methods, the performance of ADMM degrades significantly when the scale…

Optimization and Control · Mathematics 2021-08-11 Fengmiao Bian , Jingwei Liang , Xiaoqun Zhang

In this paper, we propose a distributed Newton method for consensus optimization. Our approach outperforms state-of-the-art methods, including ADMM. The key idea is to exploit the sparsity of the dual Hessian and recast the computation of…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-06-22 Rasul Tutunov , Haitham Bou Ammar , Ali Jadbabaie

Many modern computer vision and machine learning applications rely on solving difficult optimization problems that involve non-differentiable objective functions and constraints. The alternating direction method of multipliers (ADMM) is a…

Computer Vision and Pattern Recognition · Computer Science 2017-04-11 Zheng Xu , Mario A. T. Figueiredo , Xiaoming Yuan , Christoph Studer , Tom Goldstein

Consider a set of networked agents endowed with private cost functions and seeking to find a consensus on the minimizer of the aggregate cost. A new class of random asynchronous distributed optimization methods is introduced. The methods…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-03-13 Franck Iutzeler , Pascal Bianchi , Philippe Ciblat , Walid Hachem

In this paper, we review the parallel and distributed optimization algorithms based on the alternating direction method of multipliers (ADMM) for solving "big data" optimization problems in modern communication networks. We first introduce…

Numerical Analysis · Computer Science 2015-04-09 Lanchao Liu , Zhu Han

This paper presents a distributed, optimal, communication-aware trajectory planning algorithm for multi-robot systems. Building on prior work, it addresses the multi-robot communication-aware trajectory planning problem using a general…

Robotics · Computer Science 2024-08-12 Jeppe Heini Mikkelsen , Roberto Galeazzi , Matteo Fumagalli