English
Related papers

Related papers: A Distributed Stochastic Gradient Tracking Method

200 papers

We study nonconvex distributed optimization in multiagent networks where the communications between nodes is modeled as a time-varying sequence of arbitrary digraphs. We introduce a novel broadcast-based distributed algorithmic framework…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-12-16 Ying Sun , Gesualdo Scutari , Daniel Palomar

This paper considers a distributed multi-agent optimization problem, with the global objective consisting of the sum of local objective functions of the agents. The agents solve the optimization problem using local computation and…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-11-07 Shripad Gade , Nitin H. Vaidya

The article discusses distributed gradient-descent algorithms for computing local and global minima in nonconvex optimization. For local optimization, we focus on distributed stochastic gradient descent (D-SGD)--a simple network-based…

Optimization and Control · Mathematics 2020-09-17 Brian Swenson , Soummya Kar , H. Vincent Poor , José M. F. Moura , Aaron Jaech

We consider decentralized optimization problems in which a number of agents collaborate to minimize the average of their local functions by exchanging over an underlying communication graph. Specifically, we place ourselves in an…

Optimization and Control · Mathematics 2023-03-20 Yu-Guan Hsieh , Yassine Laguel , Franck Iutzeler , Jérôme Malick

We study distributed optimization algorithms for minimizing the average of convex functions. The applications include empirical risk minimization problems in statistical machine learning where the datasets are large and have to be stored on…

Optimization and Control · Mathematics 2016-01-07 Jason D. Lee , Qihang Lin , Tengyu Ma , Tianbao Yang

We study non-convex distributed optimization problems where a set of agents collaboratively solve a separable optimization problem that is distributed over a time-varying network. The existing methods to solve these problems rely on (at…

Optimization and Control · Mathematics 2022-04-26 Hadi Reisizadeh , Behrouz Touri , Soheil Mohajer

Distributed optimization has gained significant attention in recent years, primarily fueled by the availability of a large amount of data and privacy-preserving requirements. This paper presents a fixed-time convergent optimization…

Systems and Control · Computer Science 2022-05-30 Kunal Garg , Mayank Baranwal

In this report, we study decentralized stochastic optimization to minimize a sum of smooth and strongly convex cost functions when the functions are distributed over a directed network of nodes. In contrast to the existing work, we use…

Machine Learning · Computer Science 2020-07-24 Muhammad I. Qureshi , Ran Xin , Soummya Kar , Usman A. Khan

Many real-world multi-agent systems exhibit nonlinear dynamics and complex inter-agent interactions. As these systems increase in scale, the main challenges arise from achieving scalability and handling nonconvexity. To address these…

Optimization and Control · Mathematics 2025-10-22 Taehyun Yoon , Augustinos D. Saravanos , Evangelos A. Theodorou

Distributed estimation that recruits potentially large groups of humans to collect data about a phenomenon of interest has emerged as a paradigm applicable to a broad range of detection and estimation tasks. However, it also presents a…

Signal Processing · Electrical Eng. & Systems 2020-01-28 Kewei Chen , Donya Ghavidel , Vijay Gupta , Yih-Fang Huang

In this paper, we consider distributed optimization problems over a multi-agent network, where each agent can only partially evaluate the objective function, and it is allowed to exchange messages with its immediate neighbors. Differently…

Optimization and Control · Mathematics 2019-02-22 Davood Hajinezhad , Mingyi Hong , Alfredo Garcia

The goal of decentralized optimization over a network is to optimize a global objective formed by a sum of local (possibly nonsmooth) convex functions using only local computation and communication. It arises in various application domains,…

Optimization and Control · Mathematics 2015-03-17 John Duchi , Alekh Agarwal , Martin Wainwright

In this paper, we investigate the distributed shortest distance optimization problem for a multi-agent network to cooperatively minimize the sum of the quadratic distances from some convex sets, where each set is only associated with one…

Systems and Control · Computer Science 2016-02-04 Youcheng Lou , Yiguang Hong , Shouyang Wang

Distributed stochastic optimization has drawn great attention recently due to its effectiveness in solving large-scale machine learning problems. Though numerous algorithms have been proposed and successfully applied to general practical…

Optimization and Control · Mathematics 2023-12-15 Kun Huang , Xiao Li , Shi Pu

This study presents a distributed gradient-based approach to solve system optimal dynamic traffic assignment (SODTA) formulated based on the cell transmission model. The algorithm distributes SODTA into local sub-problems, who find optimal…

Optimization and Control · Mathematics 2021-12-30 Mehrzad Mehrabipour , Ali Hajbabaie

This paper investigates privacy issues in distributed resource allocation over directed networks, where each agent holds a private cost function and optimizes its decision subject to a global coupling constraint through local interaction…

Systems and Control · Electrical Eng. & Systems 2025-07-08 Wei Huo , Xiaomeng Chen , Lingying Huang , Karl Henrik Johansson , Ling Shi

In this paper, we consider the problem of distributed online convex optimization, where a group of agents collaborate to track the global minimizers of a sum of time-varying objective functions in an online manner. Specifically, we propose…

Optimization and Control · Mathematics 2020-10-14 Yan Zhang , Robert J. Ravier , Vahid Tarokh , Michael M. Zavlanos

We study decentralized asynchronous multiagent optimization over networks, modeled as static (possibly directed) graphs. The optimization problem consists of minimizing a (possibly nonconvex) smooth function--the sum of the agents' local…

Optimization and Control · Mathematics 2020-02-03 Ye Tian , Ying Sun , Gesualdo Scutari

We propose a regularized saddle-point algorithm for convex networked optimization problems with resource allocation constraints. Standard distributed gradient methods suffer from slow convergence and require excessive communication when…

Systems and Control · Computer Science 2012-08-16 Andrea Simonetto , Tamas Keviczky , Mikael Johansson

This paper proposes a differentially private gradient-tracking-based distributed stochastic optimization algorithm over directed graphs. In particular, privacy noises are incorporated into each agent's state and tracking variable to…

Systems and Control · Electrical Eng. & Systems 2026-04-15 Jialong Chen , Jimin Wang , Ji-Feng Zhang
‹ Prev 1 8 9 10 Next ›