English
Related papers

Related papers: A Decentralized Multi-Objective Optimization Algor…

200 papers

Distributed algorithms have been playing an increasingly important role in many applications such as machine learning, signal processing, and control. Significant research efforts have been devoted to developing and analyzing new algorithms…

Machine Learning · Computer Science 2022-11-03 Xinwei Zhang , Mingyi Hong , Nicola Elia

We study distributed stochastic nonconvex optimization in multi-agent networks. We introduce a novel algorithmic framework for the distributed minimization of the sum of the expected value of a smooth (possibly nonconvex) function (the…

Signal Processing · Electrical Eng. & Systems 2020-05-13 Paolo Di Lorenzo , Simone Scardapane

Decentralized optimization is a powerful paradigm that finds applications in engineering and learning design. This work studies decentralized composite optimization problems with non-smooth regularization terms. Most existing gradient-based…

Optimization and Control · Mathematics 2019-10-29 Sulaiman A. Alghunaim , Kun Yuan , Ali H. Sayed

This papers studies multi-agent (convex and \emph{nonconvex}) optimization over static digraphs. We propose a general distributed \emph{asynchronous} algorithmic framework whereby i) agents can update their local variables as well as…

Optimization and Control · Mathematics 2019-09-12 Ye Tian , Ying Sun , Gesualdo Scutari

Multiobjective optimization plays an increasingly important role in modern applications, where several criteria are often of equal importance. The task in multiobjective optimization and multiobjective optimal control is therefore to…

Decentralized optimization is gaining increased traction due to its widespread applications in large-scale machine learning and multi-agent systems. The same mechanism that enables its success, i.e., information sharing among participating…

Optimization and Control · Mathematics 2024-02-07 Yongqiang Wang , Angelia Nedic

Motivated by economic dispatch and linearly-constrained resource allocation problems, this paper proposes a novel Distributed Approx-Newton algorithm that approximates the standard Newton optimization method. A main property of this…

Numerical Analysis · Computer Science 2017-03-24 Tor Anderson , Chin-Yao Chang , Sonia Martinez

In this paper, we study the decentralized optimization problem of minimizing a finite sum of continuously differentiable and possibly nonconvex functions over a fixed-connected undirected network. We propose a unified decentralized…

Optimization and Control · Mathematics 2026-04-14 Hao Wu , Liping Wang

Many large-scale constrained optimization problems can be formulated as bilevel distributed optimization tasks over undirected networks, where agents collaborate to minimize a global cost function while adhering to constraints, relying only…

Optimization and Control · Mathematics 2025-11-25 Ajay Tak , Mayank Baranwal

Autonomous navigation often requires the simultaneous optimization of multiple objectives. The most common approach scalarizes these into a single cost function using a weighted sum, but this method is unable to find all possible trade-offs…

Robotics · Computer Science 2026-04-07 Krishna Kalavadia , Shamak Dutta , Yash Vardhan Pant , Stephen L. Smith

Motivated by applications in machine learning and statistics, we study distributed optimization problems over a network of processors, where the goal is to optimize a global objective composed of a sum of local functions. In these problems,…

Optimization and Control · Mathematics 2019-05-14 Thinh T. Doan , Carolyn L. Beck , R. Srikant

This paper provides a novel framework for solving multiobjective discrete optimization problems with an arbitrary number of objectives. Our framework formulates these problems as network models, in that enumerating the Pareto frontier…

Optimization and Control · Mathematics 2018-09-06 David Bergman , Merve Bodur , Carlos Cardonha , Andre A. Cire

This paper studies the optimal resource allocation problem within a multi-agent network composed of both autonomous agents and humans. The main challenge lies in the globally coupled constraints that link the decisions of autonomous agents…

Systems and Control · Electrical Eng. & Systems 2025-04-04 Yichen Yao , Ryan Mbagna Nanko , Yue Wang , Xuan Wang

Reaching agreement despite noise in communication is a fundamental problem in multi-agent systems. Here we study this problem under an idealized model, where it is assumed that agents can sense the general tendency in the system. More…

Computer Science and Game Theory · Computer Science 2023-01-09 Amos Korman , Robin Vacus

We consider distributed optimization where the objective function is spread among different devices, each sending incremental model updates to a central server. To alleviate the communication bottleneck, recent work proposed various schemes…

Optimization and Control · Mathematics 2019-04-11 Samuel Horváth , Dmitry Kovalev , Konstantin Mishchenko , Sebastian Stich , Peter Richtárik

Decentralized optimization is crucial for multi-agent systems, with significant concerns about communication efficiency and privacy. This paper explores the role of efficient communication in decentralized stochastic gradient descent…

Systems and Control · Electrical Eng. & Systems 2025-06-10 Wei Huo , Changxin Liu , Kemi Ding , Karl Henrik Johansson , Ling Shi

This paper presents a special type of distributed optimization problems, where the summation of agents' local cost functions (i.e., global cost function) is convex, but each individual can be non-convex. Unlike most distributed optimization…

Optimization and Control · Mathematics 2021-08-16 Yipeng Pang , Guoqiang Hu

We consider a class of popular distributed non-convex optimization problems, in which agents connected by a network $\mathcal{G}$ collectively optimize a sum of smooth (possibly non-convex) local objective functions. We address the…

Optimization and Control · Mathematics 2020-01-08 Haoran Sun , Mingyi Hong

This paper connects discrete optimal transport to a certain class of multi-objective optimization problems. In both settings, the decision variables can be organized into a matrix. In the multi-objective problem, the notion of Pareto…

Optimization and Control · Mathematics 2017-12-04 Johannes M. Schumacher

Adaptive networks are suitable for decentralized inference tasks, e.g., to monitor complex natural phenomena. Recent research works have intensively studied distributed optimization problems in the case where the nodes have to estimate a…

Multiagent Systems · Computer Science 2023-07-19 Jie Chen , Cédric Richard , Ali. H. Sayed