English
Related papers

Related papers: Distributed synchronous and asynchronous algorithm…

200 papers

Many problems of interest for cyber-physical network systems can be formulated as Mixed Integer Linear Programs in which the constraints are distributed among the agents. In this paper we propose a distributed algorithm to solve this class…

Optimization and Control · Mathematics 2017-12-06 Andrea Testa , Alessandro Rucco , Giuseppe Notarstefano

Distributed optimization is the standard way of speeding up machine learning training, and most of the research in the area focuses on distributed first-order, gradient-based methods. Yet, there are settings where some…

Machine Learning · Computer Science 2025-11-03 Matin Ansaripour , Shayan Talaei , Giorgi Nadiradze , Dan Alistarh

This paper extends algorithms that remove the fixed point bias of decentralized gradient descent to solve the more general problem of distributed optimization over subspace constraints. Leveraging the integral quadratic constraint…

Optimization and Control · Mathematics 2022-10-31 Dennis J. Marquis , Dany Abou Jaoude , Mazen Farhood , Craig A. Woolsey

Computing the optimal solution to a spatial filtering problems in a Wireless Sensor Network can incur large bandwidth and computational requirements if an approach relying on data centralization is used. The so-called distributed adaptive…

Signal Processing · Electrical Eng. & Systems 2023-03-01 Charles Hovine , Alexander Bertrand

Distributed algorithms for solving additive or consensus optimization problems commonly rely on first-order or proximal splitting methods. These algorithms generally come with restrictive assumptions and at best enjoy a linear convergence…

Optimization and Control · Mathematics 2017-05-11 Sina Khoshfetrat Pakazad , Christian A. Naesseth , Fredrik Lindsten , Anders Hansson

In this paper, we consider nonconvex decentralised optimisation and learning over a network of distributed agents. We develop an ADMM algorithm based on the Randomised Block Coordinate Douglas-Rachford splitting method which enables agents…

Optimization and Control · Mathematics 2025-07-31 Behnam Mafakheri , Jonathan H. Manton , Iman Shames

The purpose of this paper is to introduce two new classes of accelerated distributed proximal conjugate gradient algorithms for multi-agent constrained optimization problems; given as minimization of a function decomposed as a sum of M…

Optimization and Control · Mathematics 2024-06-21 Anteneh Getachew Gebrie

Many statistical learning problems can be posed as minimization of a sum of two convex functions, one typically a composition of non-smooth and linear functions. Examples include regression under structured sparsity assumptions. Popular…

Machine Learning · Statistics 2021-07-19 Seyoon Ko , Donghyeon Yu , Joong-Ho Won

In dual decomposition, the dual to an optimization problem with a specific structure is solved in distributed fashion using (sub)gradient and recently also fast gradient methods. The traditional dual decomposition suffers from two main…

Optimization and Control · Mathematics 2014-04-08 Pontus Giselsson

Motivated by broad applications in various fields of engineering, we study a network resource allocation problem where the goal is to optimally allocate a fixed quantity of resources over a network of nodes. We consider large scale networks…

Optimization and Control · Mathematics 2018-08-06 Thinh T. Doan , Carolyn L. Beck

This papers studies multi-agent (convex and \emph{nonconvex}) optimization over static digraphs. We propose a general distributed \emph{asynchronous} algorithmic framework whereby i) agents can update their local variables as well as…

Optimization and Control · Mathematics 2019-09-12 Ye Tian , Ying Sun , Gesualdo Scutari

This paper studies a constrained optimization problem over networked systems with an undirected and connected communication topology. The algorithm proposed in this work utilizes singular perturbation, dynamic average consensus, and saddle…

Optimization and Control · Mathematics 2017-10-24 Phuong Huu Hoang , Hyo-Sung Ahn

We introduce a general mathematical framework for distributed algorithms, and a monotonicity property frequently satisfied in application. These properties are leveraged to provide finite-time guarantees for converging algorithms, suited…

Systems and Control · Electrical Eng. & Systems 2020-07-31 James Melbourne , Govind Saraswat , Vivek Khatana , Sourav Patel , Murti V. Salapaka

Distributed control algorithms are known to reduce overall computation time compared to centralized control algorithms. However, they can result in inconsistent solutions leading to the violation of safety-critical constraints. Inconsistent…

Systems and Control · Electrical Eng. & Systems 2024-11-26 Julius Beerwerth , Maximilian Kloock , Bassam Alrifaee

We propose a regularized saddle-point algorithm for convex networked optimization problems with resource allocation constraints. Standard distributed gradient methods suffer from slow convergence and require excessive communication when…

Systems and Control · Computer Science 2012-08-16 Andrea Simonetto , Tamas Keviczky , Mikael Johansson

This thesis explores a particular class of distributed optimization methods for various separable resource allocation problems, which are of high interest in a wide array of multi-agent settings. A distinctly motivating application for this…

Systems and Control · Electrical Eng. & Systems 2021-03-26 Tor Anderson

The paper addresses large-scale, convex optimization problems that need to be solved in a distributed way by agents communicating according to a random time-varying graph. Specifically, the goal of the network is to minimize the sum of…

Optimization and Control · Mathematics 2020-10-28 Andrea Camisa , Francesco Farina , Ivano Notarnicola , Giuseppe Notarstefano

We present and analyze a central cutting surface algorithm for general semi-infinite convex optimization problems, and use it to develop a novel algorithm for distributionally robust optimization problems in which the uncertainty set…

Optimization and Control · Mathematics 2014-08-14 Sanjay Mehrotra , David Papp

We provide a unifying framework for distributed convex optimization over time-varying networks, in the presence of constraints and uncertainty, features that are typically treated separately in the literature. We adopt a proximal…

Optimization and Control · Mathematics 2017-05-24 Kostas Margellos , Alessandro Falsone , Simone Garatti , Maria Prandini

The distributed dual ascent is an established algorithm to solve strongly convex multi-agent optimization problems with separable cost functions, in the presence of coupling constraints. In this paper, we study its asynchronous counterpart.…

Optimization and Control · Mathematics 2021-05-05 Mattia Bianchi , Wicak Ananduta , Sergio Grammatico