English
Related papers

Related papers: Distributed Newton-like Algorithms and Learning fo…

200 papers

We study distributed optimization in a cooperative multi-agent setting, where agents have to agree on the usage of shared resources and can communicate via a time-varying network to this purpose. Each agent has its own decision variables…

Optimization and Control · Mathematics 2017-04-20 Alessandro Falsone , Kostas Margellos , Simone Garatti , Maria Prandini

Distributed optimization and learning has recently garnered great attention due to its wide applications in sensor networks, smart grids, machine learning, and so forth. Despite rapid development, existing distributed optimization and…

Machine Learning · Computer Science 2024-03-04 Ziqin Chen , Yongqiang Wang

Optimal transport is a framework that facilitates the most efficient allocation of a limited amount of resources. However, the most efficient allocation scheme does not necessarily preserve the most fairness. In this paper, we establish a…

Optimization and Control · Mathematics 2021-04-01 Jason Hughes , Juntao Chen

We study distributed estimation and learning problems in a networked environment where agents exchange information to estimate unknown statistical properties of random variables from their privately observed samples. The agents can…

Machine Learning · Computer Science 2024-04-02 Marios Papachristou , M. Amin Rahimian

Constrained submodular set function maximization problems often appear in multi-agent decision-making problems with a discrete feasible set. A prominent example is the problem of multi-agent mobile sensor placement over a discrete domain.…

Optimization and Control · Mathematics 2021-08-02 Navid Rezazadeh , Solmaz S. Kia

Resource allocation is a fundamental problem in Industrial Internet of Things (IIoT) systems, in which devices work together under limited communication bandwidth to complete diverse tasks. This paper proposes a communication-efficient…

Optimization and Control · Mathematics 2026-05-26 Yuzhu Duan , Ziwen Yang , Xiaoming Duan , Shanying Zhu

There is growing interest in large-scale machine learning and optimization over decentralized networks, e.g. in the context of multi-agent learning and federated learning. Due to the imminent need to alleviate the communication burden, the…

Machine Learning · Statistics 2020-09-02 Boyue Li , Shicong Cen , Yuxin Chen , Yuejie Chi

In this paper, we consider distributed optimization problems over a multi-agent network, where each agent can only partially evaluate the objective function, and it is allowed to exchange messages with its immediate neighbors. Differently…

Optimization and Control · Mathematics 2019-02-22 Davood Hajinezhad , Mingyi Hong , Alfredo Garcia

We review distributed algorithms for transmitting data ($n$ real numbers) under a broadcast communication model, as well as for maximum finding and for sorting. Our interest is in the basics of recursive formulas and corresponding…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-12-16 Steven Finch

Distributed optimization methods have been extensively applied for the optimization of electric power distribution systems, especially for grid-edge coordination. Existing distributed optimization algorithms applied to power distribution…

Systems and Control · Electrical Eng. & Systems 2022-12-12 Rabayet Sadnan , Nathan Gray , Anjan Bose , Anamika Dubey

In the distributed optimization problem for a multi-agent system, each agent knows a local function and must find a minimizer of the sum of all agents' local functions by performing a combination of local gradient evaluations and…

Optimization and Control · Mathematics 2022-06-16 Bryan Van Scoy , Laurent Lessard

This paper studies distributed algorithms for the extended monotropic optimization problem, which is a general convex optimization problem with a certain separable structure. The considered objective function is the sum of local convex…

Optimization and Control · Mathematics 2016-08-04 Xianlin Zeng , Peng Yi , Yiguang Hong , Lihua Xie

In domains such as health care and finance, shortage of labeled data and computational resources is a critical issue while developing machine learning algorithms. To address the issue of labeled data scarcity in training and deployment of…

Machine Learning · Computer Science 2018-10-16 Otkrist Gupta , Ramesh Raskar

We study optimization algorithms for the finite sum problems frequently arising in machine learning applications. First, we propose novel variants of stochastic gradient descent with a variance reduction property that enables linear…

Machine Learning · Computer Science 2017-07-06 Jakub Konečný

In several smart city applications, multiple resources must be allocated among competing agents that are coupled through such shared resources and are constrained --- either through limitations of communication infrastructure or privacy…

Systems and Control · Computer Science 2023-10-19 Syed Eqbal Alam , Robert Shorten , Fabian Wirth , Jia Yuan Yu

The paper addresses large-scale, convex optimization problems that need to be solved in a distributed way by agents communicating according to a random time-varying graph. Specifically, the goal of the network is to minimize the sum of…

Optimization and Control · Mathematics 2020-10-28 Andrea Camisa , Francesco Farina , Ivano Notarnicola , Giuseppe Notarstefano

We study non-convex distributed optimization problems where a set of agents collaboratively solve a separable optimization problem that is distributed over a time-varying network. The existing methods to solve these problems rely on (at…

Optimization and Control · Mathematics 2022-04-26 Hadi Reisizadeh , Behrouz Touri , Soheil Mohajer

Next-generation communication networks are envisioned to extensively utilize storage-enabled caching units to alleviate unfavorable surges of data traffic by pro-actively storing anticipated highly popular contents across geographically…

Networking and Internet Architecture · Computer Science 2019-02-20 Alireza Sadeghi , Antonio G. Marques , Georgios B. Giannakis

Methods for distributed optimization have received significant attention in recent years owing to their wide applicability in various domains. A distributed optimization method typically consists of two key components: communication and…

Optimization and Control · Mathematics 2018-06-04 Albert S. Berahas , Raghu Bollapragada , Nitish Shirish Keskar , Ermin Wei

Distributed optimization finds applications in large-scale machine learning, data processing and classification over multi-agent networks. In real-world scenarios, the communication network of agents may encounter latency that may affect…

Systems and Control · Electrical Eng. & Systems 2025-10-06 Mohammadreza Doostmohammadian , Narahari Kasagatta Ramesh , Alireza Aghasi