English
Related papers

Related papers: The Barzilai-Borwein Method for Distributed Optimi…

200 papers

This paper studies efficient distributed optimization methods for multi-agent networks. Specifically, we consider a convex optimization problem with a globally coupled linear equality constraint and local polyhedra constraints, and develop…

Systems and Control · Computer Science 2016-11-15 Tsung-Hui Chang

We consider a convex unconstrained optimization problem that arises in a network of agents whose goal is to cooperatively optimize the sum of the individual agent objective functions through local computations and communications. For this…

Optimization and Control · Mathematics 2008-03-11 Angelia Nedić , Alex Olshevsky , Asuman Ozdaglar , John N. Tsitsiklis

This paper aims to address distributed optimization problems over directed and time-varying networks, where the global objective function consists of a sum of locally accessible convex objective functions subject to a feasible set…

Optimization and Control · Mathematics 2020-07-14 Xiuxian Li , Gang Feng , Lihua Xie

In this paper, we propose a new non-monotone conjugate gradient method for solving unconstrained nonlinear optimization problems. We first modify the non-monotone line search method by introducing a new trigonometric function to calculate…

Optimization and Control · Mathematics 2022-11-15 Sajad Fathi Hafshejani , Daya Gaur , Shahadat Hossain , Robert Benkoczi

Nonlinear conjugate gradient methods have recently garnered significant attention within the multiobjective optimization community. These methods aim to maintain consistency in conjugate parameters with their single-objective optimization…

Optimization and Control · Mathematics 2024-05-15 Jian Chen , Liping Tang. Xinmin Yang

This paper investigates a distributed optimization problem under edge agreements, where each agent in the network is also subject to local convex constraints. Generalized from the concept of consensus, a group of edge agreements represents…

Optimization and Control · Mathematics 2024-09-04 Zehui Lu , Shaoshuai Mou

Multi-agent distributed optimization over a network minimizes a global objective formed by a sum of local convex functions using only local computation and communication. We develop and analyze a quantized distributed algorithm based on the…

Optimization and Control · Mathematics 2016-11-17 Shengyu Zhu , Mingyi Hong , Biao Chen

In this paper, we analyze the convergence of a distributed Robbins-Monro algorithm for both constrained and unconstrained optimization in multi-agent systems. The algorithm searches for local minima of a (nonconvex) objective function which…

Information Theory · Computer Science 2011-04-20 Pascal Bianchi , Jérémie Jakubowicz

Distributed stochastic optimization, arising in the crossing and integration of traditional stochastic optimization, distributed computing and storage, and network science, has advantages of high efficiency and a low per-iteration…

Optimization and Control · Mathematics 2025-05-20 Jinhui Hu , Guo Chen , Huaqing Li , Zixiang Shen , Weidong Zhang

In this paper, we consider distributed optimization problems over a multi-agent network, where each agent can only partially evaluate the objective function, and it is allowed to exchange messages with its immediate neighbors. Differently…

Optimization and Control · Mathematics 2019-02-22 Davood Hajinezhad , Mingyi Hong , Alfredo Garcia

This paper investigates the distributed optimal output consensus problem of heterogeneous linear multi-agent systems over weight-unbalanced directed networks. A novel distributed continuous-time state feedback controller is proposed to…

Optimization and Control · Mathematics 2022-09-02 Jin Zhang , Lu Liu , Haibo Ji , Xinghu Wang

In this paper, we study robust distributed sub-optimal coordination of linear agents subject to input nonlinearities. Inspired by the robust agreement literature, we formulate a bounded distributed sub-optimal coordination problem, in which…

Systems and Control · Electrical Eng. & Systems 2026-04-21 Takumi Namba

Distributed optimization advances centralized machine learning methods by enabling parallel and decentralized learning processes over a network of computing nodes. This work provides an accelerated consensus-based distributed algorithm for…

Systems and Control · Electrical Eng. & Systems 2025-07-01 Mohammadreza Doostmohammadian , Hamid R. Rabiee

This paper considers distributed optimization problems, where each agent cooperatively minimizes the sum of local objective functions through the communication with its neighbors. The widely adopted distributed gradient method in solving…

Optimization and Control · Mathematics 2025-08-19 Yeming Xu , Ziyuan Guo , Kaihong Lu , Huanshui Zhang

This paper studies the problem of distributed multi-agent Bayesian optimization with both coupled black-box constraints and known affine constraints. A primal-dual distributed algorithm is proposed that achieves similar regret/violation…

Machine Learning · Computer Science 2023-10-03 Wenjie Xu , Yuning Jiang , Bratislav Svetozarevic , Colin N. Jones

We present distributed algorithms that can be used by multiple agents to align their estimates with a particular value over a network with time-varying connectivity. Our framework is general in that this value can represent a consensus…

Optimization and Control · Mathematics 2010-04-20 Angelia Nedić , Asuman Ozdaglar , Pablo A. Parrilo

In this paper, we study distributed stochastic optimization to minimize a sum of smooth and strongly-convex local cost functions over a network of agents, communicating over a strongly-connected graph. Assuming that each agent has access to…

Machine Learning · Computer Science 2019-04-11 Ran Xin , Anit Kumar Sahu , Usman A. Khan , Soummya Kar

A wider selection of step sizes is explored for the distributed subgradient algorithm for multi-agent optimization problems, for both time-invariant and time-varying communication topologies. The square summable requirement of the step…

Optimization and Control · Mathematics 2016-02-02 Peng Wang , Wei Ren

Motivated by broad applications in various fields of engineering, we study a network resource allocation problem where the goal is to optimally allocate a fixed quantity of resources over a network of nodes. We consider large scale networks…

Optimization and Control · Mathematics 2018-08-06 Thinh T. Doan , Carolyn L. Beck

The regularized Barzilai-Borwein (RBB) method represents a promising gradient-based optimization algorithm. In this paper, by splitting the gradient into two parts and analyzing the dynamical system of difference equations governing the…

Optimization and Control · Mathematics 2025-12-29 Xin Xu