English
Related papers

Related papers: Communication-Constrained Private Decentralized On…

200 papers

We study the problem of distributed cooperative learning, where a group of agents seeks to agree on a set of hypotheses that best describes a sequence of private observations. In the scenario where the set of hypotheses is large, we propose…

Machine Learning · Computer Science 2021-09-22 Mohammad Taha Toghani , César A. Uribe

This paper studies a constrained optimization problem over networked systems with an undirected and connected communication topology. The algorithm proposed in this work utilizes singular perturbation, dynamic average consensus, and saddle…

Optimization and Control · Mathematics 2017-10-24 Phuong Huu Hoang , Hyo-Sung Ahn

This work provides tight upper- and lower-bounds for the problem of mean estimation under $\epsilon$-differential privacy in the local model, when the input is composed of $n$ i.i.d. drawn samples from a normal distribution with variance…

Data Structures and Algorithms · Computer Science 2019-04-12 Marco Gaboardi , Ryan Rogers , Or Sheffet

In this paper, we address two practical challenges of distributed learning in multi-agent network systems, namely personalization and resilience. Personalization is the need of heterogeneous agents to learn local models tailored to their…

Multiagent Systems · Computer Science 2026-01-01 Luca Ballotta , Nicola Bastianello , Riccardo M. G. Ferrari , Karl H. Johansson

We propose a general privacy-preserving optimization-based framework for real-time environments without requiring trusted data curators. In particular, we introduce a noisy stochastic gradient descent algorithm for online statistical…

Methodology · Statistics 2025-06-11 Jinhan Xie , Enze Shi , Bei Jiang , Linglong Kong , Xuming He

This paper fully studies distributed optimal consensus problem in non-directed dynamical networks. We consider a group of networked agents that are supposed to rendezvous at the optimal point of a collective convex objective function. Each…

Optimization and Control · Mathematics 2017-12-22 Amir Adibzadeh , Amir A. Suratgar , Mohammad B. Menhaja , Mohsen Zamani

Federated learning (FL) is a distributed machine learning technique designed to preserve data privacy and security, and it has gained significant importance due to its broad range of applications. This paper addresses the problem of optimal…

Statistics Theory · Mathematics 2025-01-16 Tony Cai , Abhinav Chakraborty , Lasse Vuursteen

We discuss the problem of decentralized multi-agent reinforcement learning (MARL) in this work. In our setting, the global state, action, and reward are assumed to be fully observable, while the local policy is protected as privacy by each…

Multiagent Systems · Computer Science 2021-11-02 Kuo Li , Qing-Shan Jia

Decentralized min-max optimization allows multi-agent systems to collaboratively solve global min-max optimization problems by facilitating the exchange of model updates among neighboring agents, eliminating the need for a central server.…

Machine Learning · Computer Science 2025-08-12 Yueyang Quan , Chang Wang , Shengjie Zhai , Minghong Fang , Zhuqing Liu

The collection and analysis of user data drives improvements in the app and web ecosystems, but comes with risks to privacy. This paper examines discrete distribution estimation under local privacy, a setting wherein service providers can…

Machine Learning · Statistics 2016-06-16 Peter Kairouz , Keith Bonawitz , Daniel Ramage

In this paper we consider the problem of privacy preservation in the static average consensus problem. This problem normally is solved by proposing privacy preservation augmentations for the popular first order Laplacian-based algorithm.…

Multiagent Systems · Computer Science 2020-12-09 Amir-Salar Esteki , Solmaz S. Kia

In this work we study the problem of unconstrained convex-optimization in a fully distributed multi-agent setting which includes asynchronous computation and lossy communication. In particular, we extend a recently proposed algorithm named…

Optimization and Control · Mathematics 2017-07-31 Nicoletta Bof , Ruggero Carli , Giuseppe Notarstefano , Luca Schenato , Damiano Varagnolo

We consider decentralized optimization problems where one aims to minimize a sum of convex smooth objective functions distributed between nodes in the network. The links in the network can change from time to time. For the setting when the…

Optimization and Control · Mathematics 2023-01-30 Dmitriy Metelev , Alexander Rogozin , Dmitry Kovalev , Alexander Gasnikov

Despite significant advances on distributed continuous-time optimization of multi-agent networks, there is still lack of an efficient algorithm to achieve the goal of distributed optimization at a pre-specified time. Herein, we design a…

Optimization and Control · Mathematics 2021-06-23 Jialing Zhou , Yuezu Lv , Changyun Wen , Guanghui Wen

A crucial challenge in decentralized systems is state estimation in the presence of unknown inputs, particularly within heterogeneous sensor networks with dynamic topologies. While numerous consensus algorithms have been introduced, they…

Systems and Control · Electrical Eng. & Systems 2024-12-13 Zida Wu , Ankur Mehta

Large-scale machine learning systems often involve data distributed across a collection of users. Federated learning algorithms leverage this structure by communicating model updates to a central server, rather than entire datasets. In this…

Machine Learning · Statistics 2022-07-19 Alberto Bietti , Chen-Yu Wei , Miroslav Dudík , John Langford , Zhiwei Steven Wu

We derive fundamental limitations on the performances of intrinsic averaging algorithms in open multi-agent systems, which are systems subject to random arrivals and departures of agents. Each agent holds a value, and their goal is to…

Multiagent Systems · Computer Science 2019-09-12 Charles Monnoyer de Galland , Julien M. Hendrickx

We consider a private discrete distribution estimation problem with one-bit communication constraint. The privacy constraints are imposed with respect to the local differential privacy and the maximal leakage. The estimation error is…

Information Theory · Computer Science 2023-10-18 Seung-Hyun Nam , Vincent Y. F. Tan , Si-Hyeon Lee

We address the problem of distributed uncon- strained convex optimization under separability assumptions, i.e., the framework where each agent of a network is endowed with a local private multidimensional convex cost, is subject to…

Optimization and Control · Mathematics 2015-11-06 Damiano Varagnolo , Filippo Zanella , Angelo Cenedese , Gianluigi Pillonetto , Luca Schenato

Decentralized state estimation in a communication-constrained sensor network is considered. The exchanged estimates are dimension-reduced to reduce the communication load using a linear mapping to a lower-dimensional space. The mean squared…

Systems and Control · Electrical Eng. & Systems 2023-12-13 Robin Forsling , Fredrik Gustafsson , Zoran Sjanic , Gustaf Hendeby