English
Related papers

Related papers: Understanding A Class of Decentralized and Federat…

200 papers

Machine learning algorithms are undoubtedly one of the most popular algorithms in recent years, and neural networks have demonstrated unprecedented precision. In daily life, different communities may have different user characteristics,…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-05-24 Yang ChaoQun

In this paper, we propose a novel distributed data-driven optimization scheme. In detail, we focus on the so-called aggregative framework, a scenario in which a set of agents aim to cooperatively minimize the sum of local costs, each…

Optimization and Control · Mathematics 2026-01-27 Riccardo Brumali , Guido Carnevale , Giuseppe Notarstefano

We consider the distributed optimization problem for a multi-agent system. Here, multiple agents cooperatively optimize an objective by sharing information through a communication network and performing computations. In this tutorial, we…

Optimization and Control · Mathematics 2023-09-21 Bryan Van Scoy , Laurent Lessard

Arrival of multicore systems has enforced a new scenario in computing, the parallel and distributed algorithms are fast replacing the older sequential algorithms, with many challenges of these techniques. The distributed algorithms provide…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-11-13 Rajendra Purohit , K R Chowdhary , S D Purohit

This paper presents a distributed algorithm applicable to a wide range of practical multi-robot applications. In such multi-robot applications, the user-defined objectives of the mission can be cast as a general optimization problem,…

Robotics · Computer Science 2021-12-28 Athanasios Ch. Kapoutsis , Savvas A. Chatzichristofis , Elias B. Kosmatopoulos

Resource allocation and scheduling in multi-agent systems present challenges due to complex interactions and decentralization. This survey paper provides a comprehensive analysis of distributed algorithms for addressing the distributed…

Motivated by applications in machine learning and statistics, we study distributed optimization problems over a network of processors, where the goal is to optimize a global objective composed of a sum of local functions. In these problems,…

Optimization and Control · Mathematics 2019-05-14 Thinh T. Doan , Carolyn L. Beck , R. Srikant

Decentralized optimization is crucial for multi-agent systems, with significant concerns about communication efficiency and privacy. This paper explores the role of efficient communication in decentralized stochastic gradient descent…

Systems and Control · Electrical Eng. & Systems 2025-06-10 Wei Huo , Changxin Liu , Kemi Ding , Karl Henrik Johansson , Ling Shi

Distributed optimization and learning algorithms are designed to operate over large scale networks enabling processing of vast amounts of data effectively and efficiently. One of the main challenges for ensuring a smooth learning process in…

Systems and Control · Electrical Eng. & Systems 2026-01-21 Apostolos I. Rikos , Nicola Bastianello , Themistoklis Charalambous , Karl H. Johansson

In this paper, we design algorithms to protect swarm-robotics applications against sensor denial-of-service (DoS) attacks on robots. We focus on applications requiring the robots to jointly select actions, e.g., which trajectory to follow,…

Robotics · Computer Science 2022-03-21 Lifeng Zhou , Vasileios Tzoumas , George J. Pappas , Pratap Tokekar

We present a distributed optimization algorithm for solving online personalized optimization problems over a network of computing and communicating nodes, each of which linked to a specific user. The local objective functions are assumed to…

Systems and Control · Electrical Eng. & Systems 2021-04-15 Ivano Notarnicola , Andrea Simonetto , Francesco Farina , Giuseppe Notarstefano

A variety of problems in distributed control involve a networked system of autonomous agents cooperating to carry out some complex task in a decentralized fashion, e.g., orienting a flock of drones, or aggregating data from a network of…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-05-01 Bernadette Charron-Bost , Patrick Lambein-Monette

Implementing a component-based system in a distributed way so that it ensures some global constraints is a challenging problem. We consider here abstract specifications consisting of a composition of components and a controller given in the…

Distributed, Parallel, and Cluster Computing · Computer Science 2010-07-30 Imene Ben-Hafaiedh , Susanne Graf , Hammadi Khairallah

Stochastic multi-level compositional optimization problems cover many new machine learning paradigms, e.g., multi-step model-agnostic meta-learning, which require efficient optimization algorithms for large-scale data. This paper studies…

Machine Learning · Computer Science 2024-06-03 Hongchang Gao

In this research we use a decentralized computing approach to allocate and schedule tasks on a massively distributed grid. Using emergent properties of multi-agent systems, the algorithm dynamically creates and dissociates clusters to serve…

Neural and Evolutionary Computing · Computer Science 2015-09-23 Soumya Banerjee , Joshua Hecker

Over the past few years, the federated learning ($\texttt{FL}$) community has witnessed a proliferation of new $\texttt{FL}$ algorithms. However, our understating of the theory of $\texttt{FL}$ is still fragmented, and a thorough, formal…

Machine Learning · Computer Science 2025-05-23 Saber Malekmohammadi , Kiarash Shaloudegi , Zeou Hu , Yaoliang Yu

Embedded distributed inference of Neural Networks has emerged as a promising approach for deploying machine-learning models on resource-constrained devices in an efficient and scalable manner. The inference task is distributed across a…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-07 Federico Nicolás Peccia , Oliver Bringmann

We consider the problem of solving a distributed optimization problem using a distributed computing platform, where the communication in the network is limited: each node can only communicate with its neighbours and the channel has a…

Systems and Control · Computer Science 2015-04-10 Ye Pu , Melanie N. Zeilinger , Colin N. Jones

We discuss the distributed matching scheme in accelerators where control of transverse beam phase space, oscillation, and transport is accomplished by flexible distribution of focusing elements beyond dedicated matching sections. Besides…

Accelerator Physics · Physics 2018-08-07 Yu-Chiu Chao

Time distributed optimization is an implementation strategy that can significantly reduce the computational burden of model predictive control by exploiting its robustness to incomplete optimization. When using this strategy, optimization…

Optimization and Control · Mathematics 2020-04-14 Dominic Liao-McPherson , Marco Nicotra , Ilya Kolmanovsky