English
Related papers

Related papers: A dual ascent algorithm for asynchronous distribut…

200 papers

Distributed optimization algorithms have been studied extensively in the literature; however, underlying most algorithms is a linear consensus scheme, i.e. averaging variables from neighbors via doubly stochastic matrices. We consider…

Optimization and Control · Mathematics 2023-03-14 Hsu Kao , Vijay Subramanian

The distributed convex optimization problem over the multi-agent system is considered in this paper, and it is assumed that each agent possesses its own cost function and communicates with its neighbours over a sequence of time-varying…

Optimization and Control · Mathematics 2022-02-03 Cong Wang , Shengyuan Xu , Deming Yuan , Baoyong Zhang , Zhengqiang Zhang

This paper presents the formulation and analysis of a novel distributed maximum likelihood algorithm that utilizes a first-order optimization scheme. The proposed approach utilizes a static average consensus algorithm to reach agreement on…

Optimization and Control · Mathematics 2018-03-09 Jemin George

In this paper, we determine the optimal convergence rates for strongly convex and smooth distributed optimization in two settings: centralized and decentralized communications over a network. For centralized (i.e. master/slave) algorithms,…

Optimization and Control · Mathematics 2017-04-10 Kevin Scaman , Francis Bach , Sébastien Bubeck , Yin Tat Lee , Laurent Massoulié

We consider a decentralized stochastic learning problem where data points are distributed among computing nodes communicating over a directed graph. As the model size gets large, decentralized learning faces a major bottleneck that is the…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-12-23 Hossein Taheri , Aryan Mokhtari , Hamed Hassani , Ramtin Pedarsani

This paper considers a distributed stochastic strongly convex optimization, where agents connected over a network aim to cooperatively minimize the average of all agents' local cost functions. Due to the stochasticity of gradient estimation…

Optimization and Control · Mathematics 2020-02-17 Jinlong Lei , Peng Yi , Jie Chen , Yiguang Hong

In this paper, we propose a framework under which the decentralized optimization algorithms suggested in \cite{JKJJ,MA, NO,NO2} can be treated in a unified manner. More precisely, we show that the distributed subgradient descent algorithms…

Optimization and Control · Mathematics 2021-08-05 Woocheol Choi , Doheon Kim , Seok-Bae Yun

Switching between finitely many continuous-time autonomous steepest descent dynamics for convex functions is considered. Convergence of complete solutions to common minimizers of the convex functions, if such minimizers exist, is shown. The…

Optimization and Control · Mathematics 2018-08-06 Rafal Goebel , Ricardo Sanfelice

To solve distributed optimization efficiently with various constraints and nonsmooth functions, we propose a distributed mirror descent algorithm with embedded Bregman damping, as a generalization of conventional distributed…

Optimization and Control · Mathematics 2021-08-30 Guanpu Chen , Weijian Li , Gehui Xu , Yiguang Hong

Motivated by machine learning applications in networks of sensors, internet-of-things (IoT) devices, and autonomous agents, we propose techniques for distributed stochastic convex learning from high-rate data streams. The setup involves a…

Machine Learning · Statistics 2019-06-11 Matthew Nokleby , Waheed U. Bajwa

There has been a growing effort in studying the distributed optimization problem over a network. The objective is to optimize a global function formed by a sum of local functions, using only local computation and communication. Literature…

Optimization and Control · Mathematics 2017-05-02 Guannan Qu , Na Li

In multicenter research, individual-level data are often protected against sharing across sites. To overcome the barrier of data sharing, many distributed algorithms, which only require sharing aggregated information, have been developed.…

Methodology · Statistics 2021-03-25 Rui Duan , Yang Ning , Yong Chen

This paper investigates the distributed optimal output consensus problem of second-order uncertain nonlinear multi-agent systems over weight-unbalanced directed networks. Under the standard assumption that local cost functions are strongly…

Optimization and Control · Mathematics 2022-02-11 Jin Zhang , Lu Liu , Haibo Ji

Directed acyclic graphs provide a fundamental tool for representing directed dependence structures in multivariate network data, and are widely used to model financial and economic networks. However, accurate and interpretable estimation…

Methodology · Statistics 2026-05-26 Huihang Liu , Wenhui Li , Xinyu Zhang

We study the average consensus problem of multi-agent systems for general network topologies with unidirectional information flow. We propose two (linear) distributed algorithms, deterministic and gossip, respectively for the cases where…

Systems and Control · Computer Science 2012-03-13 Kai Cai , Hideaki Ishii

The paper investigates the distributed estimation problem under low bit rate communications. Based on the signal-comparison (SC) consensus protocol under binary-valued communications, a new consensus+innovations type distributed estimation…

Systems and Control · Electrical Eng. & Systems 2025-03-25 Jieming Ke , Xiaodong Lu , Yanlong Zhao , Ji-Feng Zhang

In this paper, we study the asymptotic properties of distributed consensus algorithms over switching directed random networks. More specifically, we focus on consensus algorithms over independent and identically distributed, directed…

Multiagent Systems · Computer Science 2009-10-21 Victor M. Preciado , Alireza Tahbaz-Salehi , Ali Jadbabaie

This paper aims at addressing distributed averaging problems for signed networks in the presence of general directed topologies that are represented by signed digraphs. A new class of improved Laplacian potential functions is proposed by…

Optimization and Control · Mathematics 2020-08-14 Mingjun Du , Deyuan Meng , Zheng-Guang Wu

Various distributed optimization methods have been developed for solving problems which have simple local constraint sets and whose objective function is the sum of local cost functions of distributed agents in a network. Motivated by…

Systems and Control · Computer Science 2016-11-17 Tsung-Hui Chang , Angelia Nedić , Anna Scaglione

In this paper, a distributed velocity-constrained consensus problem is studied for discrete-time multi-agent systems, where each agent's velocity is constrained to lie in a nonconvex set. A distributed constrained control algorithm is…

Optimization and Control · Mathematics 2020-03-05 Peng Lin , Wei Ren , Huijun Gao