English
Related papers

Related papers: Decentralized convex optimization over time-varyin…

200 papers

This paper considers a distributed stochastic strongly convex optimization, where agents connected over a network aim to cooperatively minimize the average of all agents' local cost functions. Due to the stochasticity of gradient estimation…

Optimization and Control · Mathematics 2020-02-17 Jinlong Lei , Peng Yi , Jie Chen , Yiguang Hong

In this paper we consider a distributed convex optimization problem over time-varying undirected networks. We propose a dual method, primarily averaged network dual ascent (PANDA), that is proven to converge R-linearly to the optimal point…

Optimization and Control · Mathematics 2018-10-16 Marie Maros , Joakim Jaldén

This paper studies distributed continuous-time optimization for time-varying quadratic cost functions with uncertain parameters. We first propose a centralized adaptive optimization algorithm using partial information of the cost function.…

Systems and Control · Electrical Eng. & Systems 2024-07-30 Liangze Jiang , Zheng-Guang Wu , Lei Wang

In this paper, we study unconstrained distributed optimization strongly convex problems, in which the exchange of information in the network is captured by a directed graph topology over digital channels that have limited capacity (and…

Systems and Control · Electrical Eng. & Systems 2023-09-12 Apostolos I. Rikos , Wei Jiang , Themistoklis Charalambous , Karl H. Johansson

This paper proposes distributed discrete-time algorithms to cooperatively solve an additive cost optimization problem in multi-agent networks. The striking feature lies in the use of only the sign of relative state information between…

Systems and Control · Computer Science 2018-12-11 Jiaqi Zhang , Keyou You , Tamer Başar

This technical note studies the distributed optimization problem of a sum of nonsmooth convex cost functions with local constraints. At first, we propose a novel distributed continuous-time projected algorithm, in which each agent knows its…

Optimization and Control · Mathematics 2016-11-29 Xianlin Zeng , Peng Yi , Yiguang Hong

We study distributed stochastic convex optimization under the delayed gradient model where the server nodes perform parameter updates, while the worker nodes compute stochastic gradients. We discuss, analyze, and experiment with a setup…

Machine Learning · Statistics 2015-08-21 Suvrit Sra , Adams Wei Yu , Mu Li , Alexander J. Smola

This paper considers the problem of designing a dynamical system to solve constrained optimization problems in a distributed way and in an anytime fashion (i.e., such that the feasible set is forward invariant). For problems with separable…

Optimization and Control · Mathematics 2023-09-07 Pol Mestres , Jorge Cortés

In this paper, we consider the problem of optimally coordinating the response of a group of distributed energy resources (DERs) so they collectively meet the electric power demanded by a collection of loads, while minimizing the total…

Systems and Control · Electrical Eng. & Systems 2020-05-05 Madi Zholbaryssov , Christoforos N. Hadjicostis , Alejandro D. Dominguez-Garcia

Inspired by recent advances in distributed algorithms for approximating Wasserstein barycenters, we propose a novel distributed algorithm for this problem. The main novelty is that we consider time-varying computational networks, which are…

Optimization and Control · Mathematics 2023-07-26 Olga Yufereva , Michael Persiianov , Pavel Dvurechensky , Alexander Gasnikov , Dmitry Kovalev

We consider the question of averaging on a graph that has one sparse cut separating two subgraphs that are internally well connected. While there has been a large body of work devoted to algorithms for distributed averaging, nearly all…

Distributed, Parallel, and Cluster Computing · Computer Science 2008-05-01 Hariharan Narayanan

Decentralized learning has emerged as a powerful approach for handling large datasets across multiple machines in a communication-efficient manner. However, such methods often face scalability limitations, as increasing the number of…

Machine Learning · Computer Science 2025-06-03 Ofri Eisen , Ron Dorfman , Kfir Y. Levy

Decentralized optimization enables multiple devices to learn a global machine learning model while each individual device only has access to its local dataset. By avoiding the need for training data to leave individual users' devices, it…

Machine Learning · Computer Science 2026-04-22 Ziqin Chen , Zuang Wang , Yongqiang Wang

Distributed stochastic non-convex optimization problems have recently received attention due to the growing interest of signal processing, computer vision, and natural language processing communities in applications deployed over…

Systems and Control · Electrical Eng. & Systems 2024-10-14 Yiyue Chen , Abolfazl Hashemi , Haris Vikalo

In this paper, we study the decentralized optimization problem of minimizing a finite sum of continuously differentiable and possibly nonconvex functions over a fixed-connected undirected network. We propose a unified decentralized…

Optimization and Control · Mathematics 2026-04-14 Hao Wu , Liping Wang

Real-time visual analysis tasks, like tracking and recognition, require swift execution of computationally intensive algorithms. Visual sensor networks can be enabled to perform such tasks by augmenting the sensor network with processing…

Computer Vision and Pattern Recognition · Computer Science 2017-05-24 Emil Eriksson , György Dán , Viktoria Fodor

Distributed algorithms have been playing an increasingly important role in many applications such as machine learning, signal processing, and control. Significant research efforts have been devoted to developing and analyzing new algorithms…

Machine Learning · Computer Science 2022-11-03 Xinwei Zhang , Mingyi Hong , Nicola Elia

The links between optimal control of dynamical systems and neural networks have proved beneficial both from a theoretical and from a practical point of view. Several researchers have exploited these links to investigate the stability of…

Optimization and Control · Mathematics 2019-02-08 Panos Parpas , Corey Muir

We consider a multi agent optimization problem where a set of agents collectively solves a global optimization problem with the objective function given by the sum of locally known convex functions. We focus on the case when information…

Optimization and Control · Mathematics 2016-03-14 Ali Makhdoumi , Asuman Ozdaglar

Adaptive networks are suitable for decentralized inference tasks, e.g., to monitor complex natural phenomena. Recent research works have intensively studied distributed optimization problems in the case where the nodes have to estimate a…

Multiagent Systems · Computer Science 2023-07-19 Jie Chen , Cédric Richard , Ali. H. Sayed