English
Related papers

Related papers: Communication-Efficient Distributed Asynchronous A…

200 papers

The alternating direction method of multipliers (ADMM) is one of the most widely used first-order optimisation methods in the literature owing to its simplicity, flexibility and efficiency. Over the years, numerous efforts are made to…

Optimization and Control · Mathematics 2019-12-02 Clarice Poon , Jingwei Liang

The present work introduces the hybrid consensus alternating direction method of multipliers (H-CADMM), a novel framework for optimization over networks which unifies existing distributed optimization approaches, including the centralized…

Optimization and Control · Mathematics 2018-05-10 Meng Ma , Athanasios N. Nikolakopoulos , Georgios B. Giannakis

Linearized alternating direction method of multipliers (ADMM) as an extension of ADMM has been widely used to solve linearly constrained problems in signal processing, machine leaning, communications, and many other fields. Despite its…

Optimization and Control · Mathematics 2017-11-02 Qinghua Liu , Xinyue Shen , Yuantao Gu

In this paper we address distributed learning problems over peer-to-peer networks. In particular, we focus on the challenges of quantized communications, asynchrony, and stochastic gradients that arise in this set-up. We first discuss how…

Optimization and Control · Mathematics 2025-09-04 Nicola Bastianello , Apostolos I. Rikos , Karl H. Johansson

In this paper, we propose a communication- and computation-efficient algorithm to solve a convex consensus optimization problem defined over a decentralized network. A remarkable existing algorithm to solve this problem is the alternating…

Optimization and Control · Mathematics 2020-04-09 Weiyu Li , Yaohua Liu , Zhi Tian , Qing Ling

Due to massive amounts of data distributed across multiple locations, distributed machine learning has attracted a lot of research interests. Alternating Direction Method of Multipliers (ADMM) is a powerful method of designing distributed…

Machine Learning · Computer Science 2020-12-10 Jiahao Ding , Xiaoqi Qin , Wenjun Xu , Yanmin Gong , Chi Zhang , Miao Pan

The recent deployment of distributed battery units in prosumer premises offer new opportunities for providing aggregated flexibility services to both distribution system operators and balance responsible parties. The optimization problem…

The alternating direction method of multipliers (ADMM) is commonly used for distributed model fitting problems, but its performance and reliability depend strongly on user-defined penalty parameters. We study distributed ADMM methods that…

Machine Learning · Computer Science 2017-06-21 Zheng Xu , Gavin Taylor , Hao Li , Mario Figueiredo , Xiaoming Yuan , Tom Goldstein

Alternating direction method of multipliers (ADMM) is a popular first-order method owing to its simplicity and efficiency. However, similar to other proximal splitting methods, the performance of ADMM degrades significantly when the scale…

Optimization and Control · Mathematics 2021-08-11 Fengmiao Bian , Jingwei Liang , Xiaoqun Zhang

We propose an alternating direction method of multipliers (ADMM)-based algorithm for coordinating the charge and discharge of electric vehicles (EVs) to manage grid voltages while minimizing EV time-of-use energy costs. We prove that by…

Optimization and Control · Mathematics 2022-07-27 Abhishek Bhardwaj , Wilhiam de Carvalho , Nanduni Nimalsiri , Elizabeth Ratnam , Norak Rin

We present a novel framework, namely AADMM, for acceleration of linearized alternating direction method of multipliers (ADMM). The basic idea of AADMM is to incorporate a multi-step acceleration scheme into linearized ADMM. We demonstrate…

Optimization and Control · Mathematics 2014-02-13 Yuyuan Ouyang , Yunmei Chen , Guanghui Lan , Eduardo Pasiliao

This paper presents a distributed, optimal, communication-aware trajectory planning algorithm for multi-robot systems. Building on prior work, it addresses the multi-robot communication-aware trajectory planning problem using a general…

Robotics · Computer Science 2024-08-12 Jeppe Heini Mikkelsen , Roberto Galeazzi , Matteo Fumagalli

Latency is inherent in almost all real-world networked applications. In this paper, we propose a distributed allocation strategy over multi-agent networks with delayed communications. The state of each agent (or node) represents its share…

Systems and Control · Electrical Eng. & Systems 2022-08-31 Mohammadreza Doostmohammadian , Wei Jiang , Themistoklis Charalambous

We address the problem of solving convex optimization problems with many convex constraints in a distributed setting. Our approach is based on an extension of the alternating direction method of multipliers (ADMM) that recently gained a lot…

Optimization and Control · Mathematics 2018-04-09 Joachim Giesen , Sören Laue

As problems in machine learning, smartgrid dispatch, and IoT coordination problems have grown, distributed and fully-decentralized optimization models have gained attention for providing computational scalability to optimization tools.…

Optimization and Control · Mathematics 2018-05-30 Eric Munsing , Scott Moura

Cooperative control is crucial for the effective operation of dynamical multi-agent systems. Especially for distributed control schemes, it is essential to exchange data between the agents. This becomes a privacy threat if the data is…

Systems and Control · Electrical Eng. & Systems 2024-12-19 Philipp Binfet , Janis Adamek , Nils Schlüter , Moritz Schulze Darup

In this paper, we propose a communication-efficiently decentralized machine learning framework that solves a consensus optimization problem defined over a network of inter-connected workers. The proposed algorithm, Censored and Quantized…

Machine Learning · Computer Science 2021-01-13 Chaouki Ben Issaid , Anis Elgabli , Jihong Park , Mehdi Bennis , Mérouane Debbah

In this work, we study a generic network cost minimization problem, in which every node has a local decision vector to determine. Each node incurs a cost depending on its decision vector and each link also incurs a cost depending on the…

Optimization and Control · Mathematics 2017-02-27 Xuanyu Cao , K. J. Ray Liu

Federated learning (FL) leverages client-server communications to train global models on decentralized data. However, communication noise or errors can impair model accuracy. To address this problem, we propose a novel FL algorithm that…

Machine Learning · Computer Science 2025-12-15 Ehsan Lari , Reza Arablouei , Vinay Chakravarthi Gogineni , Stefan Werner

Federated systems enable collaborative training on highly heterogeneous data through model personalization, which can be facilitated by employing multi-task learning algorithms. However, significant variation in device computing…