English
Related papers

Related papers: Distributed Adaptive Gradient Optimization Algorit…

200 papers

In this letter, we study distributed optimization, where a network of agents, abstracted as a directed graph, collaborates to minimize the average of locally-known convex functions. Most of the existing approaches over directed graphs are…

Optimization and Control · Mathematics 2018-06-08 Ran Xin , Usman A. Khan

Distributed optimization has a rich history. It has demonstrated its effectiveness in many machine learning applications, etc. In this paper we study a subclass of distributed optimization, namely decentralized optimization in a non-smooth…

Optimization and Control · Mathematics 2023-12-05 Aleksandr Lobanov , Andrew Veprikov , Georgiy Konin , Aleksandr Beznosikov , Alexander Gasnikov , Dmitry Kovalev

In this paper, we propose a novel distributed data-driven optimization scheme. In detail, we focus on the so-called aggregative framework, a scenario in which a set of agents aim to cooperatively minimize the sum of local costs, each…

Optimization and Control · Mathematics 2026-01-27 Riccardo Brumali , Guido Carnevale , Giuseppe Notarstefano

In this paper we propose several novel distributed gradient-based temporal difference algorithms for multi-agent off-policy learning of linear approximation of the value function in Markov decision processes with strict information…

Machine Learning · Computer Science 2021-04-20 Milos S. Stankovic , Marko Beko , Srdjan S. Stankovic

We study distributed big-data nonconvex optimization in multi-agent networks. We consider the (constrained) minimization of the sum of a smooth (possibly) nonconvex function, i.e., the agents' sum-utility, plus a convex (possibly) nonsmooth…

Optimization and Control · Mathematics 2018-09-03 Ivano Notarnicola , Ying Sun , Gesualdo Scutari , Giuseppe Notarstefano

The goal of decentralized optimization over a network is to optimize a global objective formed by a sum of local (possibly nonsmooth) convex functions using only local computation and communication. It arises in various application domains,…

Optimization and Control · Mathematics 2015-03-17 John Duchi , Alekh Agarwal , Martin Wainwright

This paper considers the problem of designing accelerated gradient-based algorithms for optimization and saddle-point problems. The class of objective functions is defined by a generalized sector condition. This class of functions contains…

Optimization and Control · Mathematics 2020-11-17 Dennis Gramlich , Christian Ebenbauer , Carsten W. Scherer

In the distributed optimization problem for a multi-agent system, each agent knows a local function and must find a minimizer of the sum of all agents' local functions by performing a combination of local gradient evaluations and…

Optimization and Control · Mathematics 2022-06-16 Bryan Van Scoy , Laurent Lessard

We study distributed multiagent optimization over (directed, time-varying) graphs. We consider the minimization of $F+G$ subject to convex constraints, where $F$ is the smooth strongly convex sum of the agent's losses and $G$ is a nonsmooth…

Optimization and Control · Mathematics 2020-10-13 Ying Sun , Amir Daneshmand , Gesualdo Scutari

We develop a distributed stochastic gradient descent algorithm for solving non-convex optimization problems under the assumption that the local objective functions are twice continuously differentiable with Lipschitz continuous gradients…

Optimization and Control · Mathematics 2019-08-20 Jemin George , Tao Yang , He Bai , Prudhvi Gurram

First order optimization algorithms play a major role in large scale machine learning. A new class of methods, called adaptive algorithms, were recently introduced to adjust iteratively the learning rate for each coordinate. Despite great…

Machine Learning · Computer Science 2019-10-01 André Belotto da Silva , Maxime Gazeau

In this paper, we study distributed big-data nonconvex optimization in multi-agent networks. We consider the (constrained) minimization of the sum of a smooth (possibly) nonconvex function, i.e., the agents' sum-utility, plus a convex…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-05-03 Ivano Notarnicola , Ying Sun , Gesualdo Scutari , Giuseppe Notarstefano

We present a hybrid systems framework for multi-agent optimization in which agents execute computations in continuous time and communicate in discrete time. The optimization algorithm is a hybrid version of parallelized coordinate descent.…

Optimization and Control · Mathematics 2021-10-04 Katherine Hendrickson , Dawn Hustig-Schultz , Matthew Hale , Ricardo G. Sanfelice

In this paper, a class of convex feasibility problems (CFPs) are studied for multi-agent systems through local interactions. The objective is to search a feasible solution to the convex inequalities with some set constraints in a…

Systems and Control · Computer Science 2016-12-16 Kaihong Lu , Gangshan Jing , Long Wang

We consider a generic decentralized constrained optimization problem over static, directed communication networks, where each agent has exclusive access to only one convex, differentiable, local objective term and one convex constraint set.…

Optimization and Control · Mathematics 2023-11-09 Firooz Shahriari-Mehr , Ashkan Panahi

This paper considers the problem of multi-agent distributed optimization. In this problem, there are multiple agents in the system, and each agent only knows its local cost function. The objective for the agents is to collectively compute a…

Optimization and Control · Mathematics 2020-03-31 Kushal Chakrabarti , Nirupam Gupta , Nikhil Chopra

This paper proposes a novel family of primal-dual-based distributed algorithms for smooth, convex, multi-agent optimization over networks that uses only gradient information and gossip communications. The algorithms can also employ…

Optimization and Control · Mathematics 2020-03-04 Jinming Xu , Ye Tian , Ying Sun , Gesualdo Scutari

This paper deals with a network of computing agents aiming to solve an online optimization problem in a distributed fashion, i.e., by means of local computation and communication, without any central coordinator. We propose the gradient…

Optimization and Control · Mathematics 2023-09-13 Guido Carnevale , Francesco Farina , Ivano Notarnicola , Giuseppe Notarstefano

In this paper, we study convex optimization problems where agents of a network cooperatively minimize the global objective function which consists of multiple local objective functions. Different from most of the existing works, the local…

Optimization and Control · Mathematics 2024-10-30 Huaqing Li , Lifeng Zheng , Zheng Wang , Yu Yan , Liping Feng , Jing Guo

We provide a unifying framework for distributed convex optimization over time-varying networks, in the presence of constraints and uncertainty, features that are typically treated separately in the literature. We adopt a proximal…

Optimization and Control · Mathematics 2017-05-24 Kostas Margellos , Alessandro Falsone , Simone Garatti , Maria Prandini