English
Related papers

Related papers: Distributed Big-Data Optimization via Block-Iterat…

200 papers

This paper considers distributed optimization for minimizing the average of local nonconvex cost functions, by using local information exchange over undirected communication networks. To reduce the required communication capacity, we…

Optimization and Control · Mathematics 2025-03-03 Lei Xu , Xinlei Yi , Jiayue Sun , Yang Shi , Karl H. Johansson , Tao Yang

We consider problems where agents in a network seek a common quantity, measured independently and periodically by each agent through a local time-varying process. Numerous solvers addressing such problems have been developed in the past,…

Optimization and Control · Mathematics 2024-03-08 Navneet Agrawal , Renato L. G. Cavalcante , Sławomir Stańczak

In this paper, a time-varying distributed convex optimization problem is studied for continuous-time multi-agent systems. Control algorithms are designed for the cases of single-integrator and double-integrator dynamics. Two discontinuous…

Optimization and Control · Mathematics 2016-09-07 Salar Rahili , Wei Ren

A wider selection of step sizes is explored for the distributed subgradient algorithm for multi-agent optimization problems, for both time-invariant and time-varying communication topologies. The square summable requirement of the step…

Optimization and Control · Mathematics 2016-02-02 Peng Wang , Wei Ren

In this two-part work, we propose an algorithmic framework for solving non-convex problems whose objective function is the sum of a number of smooth component functions plus a convex (possibly non-smooth) or/and smooth (possibly non-convex)…

Optimization and Control · Mathematics 2019-07-24 Sandeep Kumar , Ketan Rajawat , Daniel P. Palomar

This paper fully studies distributed optimal consensus problem in non-directed dynamical networks. We consider a group of networked agents that are supposed to rendezvous at the optimal point of a collective convex objective function. Each…

Optimization and Control · Mathematics 2017-12-22 Amir Adibzadeh , Amir A. Suratgar , Mohammad B. Menhaja , Mohsen Zamani

In this paper, we consider distributed optimization problems where the goal is to minimize a sum of objective functions over a multi-agent network. We focus on the case when the inter-agent communication is described by a…

Optimization and Control · Mathematics 2018-06-08 Chenguang Xi , Ran Xin , Usman A. Khan

This paper considers distributed online nonconvex optimization with time-varying inequality constraints over a network of agents, where the nonconvex local loss and convex local constraint functions can vary arbitrarily across iterations.…

Optimization and Control · Mathematics 2025-11-19 Kunpeng Zhang , Lei Xu , Xinlei Yi , Guanghui Wen , Ming Cao , Karl H. Johansson , Tianyou Chai , Tao Yang

Bilevel optimization has been applied to a wide variety of machine learning models, and numerous stochastic bilevel optimization algorithms have been developed in recent years. However, most existing algorithms restrict their focus on the…

Machine Learning · Computer Science 2023-03-28 Hongchang Gao , Bin Gu , My T. Thai

In this paper, the distributed resource allocation problem on strongly connected and weight-balanced digraphs is investigated, where the decisions of each agent are restricted to satisfy the coupled network resource constraints and…

Optimization and Control · Mathematics 2022-03-10 Xiaohong Nian , Fan Li , Dongxin Liu

This paper investigates the distributed fixed point seeking problem of sum-separable stochastic operators over the multi-agent network. Based on inexact Krasnosel'ski\u{\i}--Mann iterations, the communication-efficient distributed algorithm…

Optimization and Control · Mathematics 2026-05-22 Fan Li , Lei Xu , Xinlei Yi , Guanghui Wen , Yang Shi , Tao Yang

We study diffusion and consensus based optimization of a sum of unknown convex objective functions over distributed networks. The only access to these functions is through stochastic gradient oracles, each of which is only available at a…

Numerical Analysis · Computer Science 2015-09-01 N. Denizcan Vanli , Muhammed O. Sayin , Suleyman S. Kozat

We consider distributed online convex optimization problems, where the distributed system consists of various computing units connected through a time-varying communication graph. In each time step, each computing unit selects a constrained…

Machine Learning · Computer Science 2019-12-23 Deming Yuan , Alexandre Proutiere , Guodong Shi

This work studies multi-agent sharing optimization problems with the objective function being the sum of smooth local functions plus a convex (possibly non-smooth) function coupling all agents. This scenario arises in many machine learning…

Optimization and Control · Mathematics 2020-06-17 Sulaiman A. Alghunaim , Ming Yan , Ali H. Sayed

This paper studies distributed algorithms for the extended monotropic optimization problem, which is a general convex optimization problem with a certain separable structure. The considered objective function is the sum of local convex…

Optimization and Control · Mathematics 2016-08-04 Xianlin Zeng , Peng Yi , Yiguang Hong , Lihua Xie

Distributed learning and adaptation have received significant interest and found wide-ranging applications in machine learning and signal processing. While various approaches, such as shared-memory optimization, multi-task learning, and…

Signal Processing · Electrical Eng. & Systems 2024-12-03 Pourya Behmandpoor , Marc Moonen , Panagiotis Patrinos

In Part I of this paper, we proposed and analyzed a novel algorithmic framework for the minimization of a nonconvex (smooth) objective function, subject to nonconvex constraints, based on inner convex approximations. This Part II is devoted…

Information Theory · Computer Science 2017-04-05 Gesualdo Scutari , Francisco Facchinei , Lorenzo Lampariello , Peiran Song , Stefania Sardellitti

It is always a challenging task to service sudden events in non-convex and uncertain environments, and multi-agent coverage control provides a powerful theoretical framework to investigate the deployment problem of mobile robotic networks…

Optimization and Control · Mathematics 2022-09-07 Chao Zhai , Pengyang Fan

This work studies nonconvex distributed constrained optimization over stochastic communication networks. We revisit the distributed dual averaging algorithm, which is known to converge for convex problems. We start from the centralized…

Optimization and Control · Mathematics 2022-11-15 Changxin Liu , Xuyang Wu , Xinlei Yi , Yang Shi , Karl H. Johansson

In this paper, a distributed convex optimization problem with swarm tracking behavior is studied for continuous-time multi-agent systems. The agents' task is to drive their center to track an optimal trajectory which minimizes the sum of…

Optimization and Control · Mathematics 2015-07-20 Salar Rahili , Wei Ren , Sheida Ghapani