English
Related papers

Related papers: Exact and Approximate Heterogeneous Bayesian Decen…

200 papers

The decentralized optimization paradigm assumes that each term of a finite-sum objective is privately stored by the corresponding agent. Agents are only allowed to communicate with their neighbors in the communication graph. We consider the…

Optimization and Control · Mathematics 2023-09-07 Demyan Yarmoshik , Alexander Rogozin , Alexander Gasnikov

The problem of decentralized sequential change detection is considered, where an abrupt change occurs in an area monitored by a number of sensors; the sensors transmit their data to a fusion center, subject to bandwidth and energy…

Statistics Theory · Mathematics 2013-11-12 Georgios Fellouris , George V. Moustakides

Decentralized control of cooperative systems captures the operation of a group of decision makers that share a single global objective. The difficulty in solving optimally such problems arises when the agents lack full observability of the…

Artificial Intelligence · Computer Science 2011-07-04 C. V. Goldman , S. Zilberstein

Communication efficiency has been widely recognized as the bottleneck for large-scale decentralized machine learning applications in multi-agent or federated environments. To tackle the communication bottleneck, there have been many efforts…

Machine Learning · Computer Science 2022-10-17 Haoyu Zhao , Boyue Li , Zhize Li , Peter Richtárik , Yuejie Chi

The world is full of systems of distributed agents, collaborating and competing in complex ways: firms and workers specialise within economies, neurons adapt their tuning across brain circuits, and species compete and coexist within…

Neural and Evolutionary Computing · Computer Science 2026-04-10 Guillhem Artis , Danyal Akarca , Jascha Achterberg

Many safety-critical real-world problems, such as autonomous driving and collaborative robots, are of a distributed multi-agent nature. To optimize the performance of these systems while ensuring safety, we can cast them as distributed…

Systems and Control · Electrical Eng. & Systems 2025-08-20 Abdullah Tokmak , Thomas B. Schön , Dominik Baumann

This paper proposes a new architecture for multi-agent systems to cover an unknowingly distributed fast, safely, and decentralizedly. The inter-agent communication is organized by a directed graph with fixed topology, and we model agent…

Systems and Control · Electrical Eng. & Systems 2023-07-11 Hossein Rastgoftar

In this correspondence we study the problem of channel-aware decision fusion when the sensor detection probability is not known at the decision fusion center. Several alternatives proposed in the literature are compared and new fusion rules…

Information Theory · Computer Science 2016-03-11 Domenico Ciuonzo , Pierluigi Salvo Rossi

One of the key challenges in decentralized and federated learning is to design algorithms that efficiently deal with highly heterogeneous data distributions across agents. In this paper, we revisit the analysis of the popular Decentralized…

Machine Learning · Computer Science 2022-10-24 Batiste Le Bars , Aurélien Bellet , Marc Tommasi , Erick Lavoie , Anne-Marie Kermarrec

This paper is devoted to distributed continuous-time and discrete-time optimization problems with nonuniform convex constraint sets and nonuniform stepsizes for general differentiable convex objective functions. The communication graphs are…

Optimization and Control · Mathematics 2020-03-03 Peng Lin , Wei Ren , Chunhua Yang , Weihua Gui

Distributed estimation in the context of sensor networks is considered, where distributed agents are given a set of sensor measurements, and are tasked with estimating a target variable. A subset of sensors are assumed to be faulty. The…

Signal Processing · Electrical Eng. & Systems 2022-12-26 Marian Temprana Alonso , Farhad Shirani , S. Sitharama Iyengar

With the rapid growth in the volume of data sets, models, and devices in the domain of deep learning, there is increasing attention on large-scale distributed deep learning. In contrast to traditional distributed deep learning, the…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-10 Feng Liang , Zhen Zhang , Haifeng Lu , Victor C. M. Leung , Yanyi Guo , Xiping Hu

We propose a distributed solution for a constrained convex optimization problem over a network of clustered agents each consisted of a set of subagents. The communication range of the clustered agents is such that they can form a connected…

Multiagent Systems · Computer Science 2021-04-06 Hossein Moradian , Solmaz S. Kia

We present a framework combining hierarchical and multi-agent deep reinforcement learning approaches to solve coordination problems among a multitude of agents using a semi-decentralized model. The framework extends the multi-agent learning…

Artificial Intelligence · Computer Science 2017-12-25 Saurabh Kumar , Pararth Shah , Dilek Hakkani-Tur , Larry Heck

Federated Learning (FL) has emerged as a transformative approach for enabling distributed machine learning while preserving user privacy, yet it faces challenges like communication inefficiencies and reliance on centralized infrastructures,…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-29 Sai Puppala , Ismail Hossain , Md Jahangir Alam , Sajedul Talukder , Zahidur Talukder , Syed Bahauddin

In segmentation problems, inference on change-point position and model selection are two difficult issues due to the discrete nature of change-points. In a Bayesian context, we derive exact, non-asymptotic, explicit and tractable formulae…

Computation · Statistics 2015-12-31 Guillem Rigaill , Emilie Lebarbier , Stéphane Robin

We consider a decentralized stochastic learning problem where data points are distributed among computing nodes communicating over a directed graph. As the model size gets large, decentralized learning faces a major bottleneck that is the…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-12-23 Hossein Taheri , Aryan Mokhtari , Hamed Hassani , Ramtin Pedarsani

Learning from distributed data without accessing them is undoubtedly a challenging and non-trivial task. Nevertheless, the necessity for distributed training of a statistical model has been increasing, due to the privacy concerns of local…

Machine Learning · Statistics 2024-08-02 Seok-Ju Hahn

We consider the problem of distributed learning, where a network of agents collectively aim to agree on a hypothesis that best explains a set of distributed observations of conditionally independent random processes. We propose a…

Optimization and Control · Mathematics 2017-04-12 Angelia Nedić , Alex Olshevsky , César A. Uribe

This paper investigates the autonomous synchronization problem for discrete-time heterogeneous multiagent systems. The synchronization problem is transformed into the asymptotic decoupling problem of stable modes in a class of discrete-time…

Multiagent Systems · Computer Science 2026-05-07 Wei Hu , Quanyi Liang