English
Related papers

Related papers: Distributed Stochastic Optimization With Unbounded…

200 papers

This paper proposes a novel class of distributed continuous-time coordination algorithms to solve network optimization problems whose cost function is a sum of local cost functions associated to the individual agents. We establish the…

Optimization and Control · Mathematics 2014-08-25 Solmaz S. Kia , Jorge Cortes , Sonia Martinez

We propose an algorithm for distributed optimization over time-varying communication networks. Our algorithm uses an optimized ratio between the number of rounds of communication and gradient evaluations to achieve fast convergence. The…

Optimization and Control · Mathematics 2020-01-08 Bryan Van Scoy , Laurent Lessard

We consider a discrete-time model of continuous-time distributed optimization over dynamic directed-graphs (digraphs) with applications to distributed learning. Our optimization algorithm works over general strongly connected dynamic…

Optimization and Control · Mathematics 2024-03-27 Mohammadreza Doostmohammadian , Wei Jiang , Muwahida Liaquat , Alireza Aghasi , Houman Zarrabi

We analyze the convergence of gradient-based optimization algorithms that base their updates on delayed stochastic gradient information. The main application of our results is to the development of gradient-based distributed optimization…

Optimization and Control · Mathematics 2011-05-02 Alekh Agarwal , John C. Duchi

In this paper, we study the problem of distributed multi-agent optimization over a network, where each agent possesses a local cost function that is smooth and strongly convex. The global objective is to find a common solution that…

Optimization and Control · Mathematics 2019-08-02 Shi Pu , Angelia Nedić

Distributed consensus optimization has received considerable attention in recent years; several distributed consensus-based algorithms have been proposed for (nonsmooth) convex and (smooth) nonconvex objective functions. However, the…

Optimization and Control · Mathematics 2019-11-05 Vyacheslav Kungurtsev

Many large-scale constrained optimization problems can be formulated as bilevel distributed optimization tasks over undirected networks, where agents collaborate to minimize a global cost function while adhering to constraints, relying only…

Optimization and Control · Mathematics 2025-11-25 Ajay Tak , Mayank Baranwal

In this paper, we propose a novel solution for the distributed unconstrained optimization problem where the total cost is the summation of time-varying local cost functions of a group networked agents. The objective is to track the optimal…

Optimization and Control · Mathematics 2022-12-20 Amir-Salar Esteki , Solmaz S. Kia

We study the distributed optimization problem over a graphon with a continuum of nodes, which is regarded as the limit of the distributed networked optimization as the number of nodes goes to infinity. Each node has a private local cost…

Systems and Control · Electrical Eng. & Systems 2025-10-02 Yan Chen , Tao Li , Xiaofeng Zong

We study a standard distributed optimization framework where $N$ networked nodes collaboratively minimize the sum of their local convex costs. The main body of existing work considers the described problem when the underling network is…

Optimization and Control · Mathematics 2018-03-22 Anit Kumar Sahu , Dusan Jakovetic , Dragana Bajovic , Soummya Kar

This technical note studies the distributed optimization problem of a sum of nonsmooth convex cost functions with local constraints. At first, we propose a novel distributed continuous-time projected algorithm, in which each agent knows its…

Optimization and Control · Mathematics 2016-11-29 Xianlin Zeng , Peng Yi , Yiguang Hong

In this work, we consider the problem of a network of agents collectively minimizing a sum of convex functions. The agents in our setting can only access their local objective functions and exchange information with their immediate…

Optimization and Control · Mathematics 2019-10-01 Charikleia Iakovidou , Ermin Wei

This paper studies a class of distributed optimization problems with coupled equality constraints in networked systems. Many existing distributed algorithms rely on solving local subproblems via the $\operatorname{argmin}$ operator in each…

Optimization and Control · Mathematics 2025-11-26 Chenyang Qiu , Zongli Lin

We address the problem of distributed convex unconstrained optimization over networks characterized by asynchronous and possibly lossy communications. We analyze the case where the global cost function is the sum of locally coupled local…

Optimization and Control · Mathematics 2020-10-06 Marco Todescato , Nicoletta Bof , Guido Cavraro , Ruggero Carli , Luca Schenato

We consider the problem of regularized regression in a network of communication-constrained devices. Each node has local data and objectives, and the goal is for the nodes to optimize a global objective. We develop a distributed…

Optimization and Control · Mathematics 2016-03-22 Neil McGlohon , Stacy Patterson

We consider discrete-time distributed averaging algorithms over multi-agent networks with measurement noises and time-varying random graph flows. Each agent updates its state by relative states between neighbours with both additive and…

Social and Information Networks · Computer Science 2017-02-14 Tao Li , Jiexiang Wang

Decentralized optimization strategies are helpful for various applications, from networked estimation to distributed machine learning. This paper studies finite-sum minimization problems described over a network of nodes and proposes a…

Systems and Control · Electrical Eng. & Systems 2024-08-06 Mohammadreza Doostmohammadian , Zulfiya R. Gabidullina , Hamid R. Rabiee

Motivated by machine learning applications in networks of sensors, internet-of-things (IoT) devices, and autonomous agents, we propose techniques for distributed stochastic convex learning from high-rate data streams. The setup involves a…

Machine Learning · Statistics 2019-06-11 Matthew Nokleby , Waheed U. Bajwa

In this paper, we propose a new framework to study distributed optimization problems with stochastic gradients by employing a multi-agent system with continuous-time dynamics. Here the goal of the agents is to cooperatively minimize the sum…

Systems and Control · Electrical Eng. & Systems 2026-02-10 Jianhua Sun , Kaihong Lu , Xin Yu

In this paper, we consider the unconstrained distributed optimization problem, in which the exchange of information in the network is captured by a directed graph topology, thus, nodes can only communicate with their neighbors.…

Systems and Control · Electrical Eng. & Systems 2023-12-07 Apostolos I. Rikos , Wei Jiang , Themistoklis Charalambous , Karl H. Johansson