English
Related papers

Related papers: Decentralized convex optimization over time-varyin…

200 papers

We consider the problem of decentralized optimization over time-varying directed networks. The network nodes can access only their local objectives, and aim to collaboratively minimize a global function by exchanging messages with their…

Systems and Control · Electrical Eng. & Systems 2021-12-03 Yiyue Chen , Abolfazl Hashemi , Haris Vikalo

We consider the problem of decentralized optimization where a collection of agents, each having access to a local cost function, communicate over a time-varying directed network and aim to minimize the sum of those functions. In practice,…

Systems and Control · Electrical Eng. & Systems 2021-09-01 Yiyue Chen , Abolfazl Hashemi , Haris Vikalo

We study strongly convex distributed optimization problems where a set of agents are interested in solving a separable optimization problem collaboratively. In this paper, we propose and study a two time-scale decentralized gradient descent…

Optimization and Control · Mathematics 2022-08-16 Hadi Reisizadeh , Behrouz Touri , Soheil Mohajer

This paper considers a distributed convex optimization problem over a time-varying multi-agent network, where each agent has its own decision variables that should be set so as to minimize its individual objective subject to local…

Optimization and Control · Mathematics 2018-05-22 Chuanye Gu , Zhiyou Wu , Jueyou Li , Yaning Guo

Distributed optimization is an important direction of research in modern optimization theory. Its applications include large scale machine learning, distributed signal processing and many others. The paper studies decentralized min-max…

Optimization and Control · Mathematics 2023-09-08 Nhat Trung Nguyen , Alexander Rogozin , Dmitry Metelev , Alexander Gasnikov

Decentralized optimization with time-varying networks is an emerging paradigm in machine learning. It saves remarkable communication overhead in large-scale deep training and is more robust in wireless scenarios especially when nodes are…

Machine Learning · Computer Science 2022-11-02 Xinmeng Huang , Kun Yuan

The paper addresses large-scale, convex optimization problems that need to be solved in a distributed way by agents communicating according to a random time-varying graph. Specifically, the goal of the network is to minimize the sum of…

Optimization and Control · Mathematics 2020-10-28 Andrea Camisa , Francesco Farina , Ivano Notarnicola , Giuseppe Notarstefano

This paper considers a distributed convex optimization problem with inequality constraints over time-varying unbalanced digraphs, where the cost function is a sum of local objectives, and each node of the graph only knows its local…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-12-30 Pei Xie , Keyou You , Roberto Tempo , Shiji Song , Cheng Wu

We consider a decentralized optimization problem for networks affected by communication delays. Examples of such networks include collaborative machine learning, sensor networks, and multi-agent systems. To mimic communication delays, we…

Machine Learning · Computer Science 2024-10-03 Tomas Ortega , Hamid Jafarkhani

This paper studies the distributed optimization problem with possibly nonidentical local constraints, where its global objective function is composed of $N$ convex functions. The aim is to solve the considered optimization problem in a…

Optimization and Control · Mathematics 2022-08-26 Hongzhe Liu , Wenwu Yu , Guanghui Wen , Wei Xing Zheng

In this paper, we develop a distributed algorithm for solving a class of distributed convex optimization problems where the local objective functions can be a general nonsmooth function, and all equalities and inequalities are network-wide…

Optimization and Control · Mathematics 2026-04-14 Yeong-Ung Kim , Hyo-Sung Ahn

We consider decentralized time-varying stochastic optimization problems where each of the functions held by the nodes has a finite sum structure. Such problems can be efficiently solved using variance reduction techniques. Our aim is to…

We propose an algorithm for distributed optimization over time-varying communication networks. Our algorithm uses an optimized ratio between the number of rounds of communication and gradient evaluations to achieve fast convergence. The…

Optimization and Control · Mathematics 2020-01-08 Bryan Van Scoy , Laurent Lessard

Distributed Optimization is an increasingly important subject area with the rise of multi-agent control and optimization. We consider a decentralized stochastic optimization problem where the agents on a graph aim to asynchronously optimize…

Optimization and Control · Mathematics 2021-10-22 Vyacheslav Kungurtsev , Mahdi Morafah , Tara Javidi , Gesualdo Scutari

We consider a decentralized convex unconstrained optimization problem, where the cost function can be decomposed into a sum of strongly convex and smooth functions, associated with individual agents, interacting over a static or…

Optimization and Control · Mathematics 2023-12-12 Dmitry Metelev , Aleksandr Beznosikov , Alexander Rogozin , Alexander Gasnikov , Anton Proskurnikov

We consider decentralized optimization problems where one aims to minimize a sum of convex smooth objective functions distributed between nodes in the network. The links in the network can change from time to time. For the setting when the…

Optimization and Control · Mathematics 2023-01-30 Dmitriy Metelev , Alexander Rogozin , Dmitry Kovalev , Alexander Gasnikov

We develop algorithms that find and track the optimal solution trajectory of time-varying convex optimization problems which consist of local and network-related objectives. The algorithms are derived from the prediction-correction…

Optimization and Control · Mathematics 2016-11-08 Andrea Simonetto , Alec Koppel , Aryan Mokhtari , Geert Leus , Alejandro Ribeiro

This paper considers nonconvex distributed constrained optimization over networks, modeled as directed (possibly time-varying) graphs. We introduce the first algorithmic framework for the minimization of the sum of a smooth nonconvex…

Optimization and Control · Mathematics 2018-09-05 Gesualdo Scutari , Ying Sun

Decentralized optimization strategies are helpful for various applications, from networked estimation to distributed machine learning. This paper studies finite-sum minimization problems described over a network of nodes and proposes a…

Systems and Control · Electrical Eng. & Systems 2024-08-06 Mohammadreza Doostmohammadian , Zulfiya R. Gabidullina , Hamid R. Rabiee

We consider the task of minimizing the sum of convex functions stored in a decentralized manner across the nodes of a communication network. This problem is relatively well-studied in the scenario when the objective functions are smooth, or…

Optimization and Control · Mathematics 2024-05-29 Dmitry Kovalev , Ekaterina Borodich , Alexander Gasnikov , Dmitrii Feoktistov
‹ Prev 1 2 3 10 Next ›