English
Related papers

Related papers: Communication-Constrained Private Decentralized On…

200 papers

We consider the problem of mean estimation under user-level local differential privacy, where $n$ users are contributing through their local pool of data samples. Previous work assume that the number of data samples is the same across…

Methodology · Statistics 2024-10-15 Corentin Pla , Hugo Richard , Maxime Vono

In this paper, we consider the privacy preservation problem in both discrete- and continuous-time average consensus algorithms with strongly connected and balanced graphs, against either internal honest-but-curious agents or external…

Systems and Control · Electrical Eng. & Systems 2021-09-07 Yi Xiong , Zhongkui Li

Differential Privacy (DP) is the current gold-standard for ensuring privacy for statistical queries. Estimation problems under DP constraints appearing in the literature have largely focused on providing equal privacy to all users. We…

Machine Learning · Computer Science 2025-04-22 Syomantak Chaudhuri , Thomas A. Courtade

This paper considers a distributed multi-agent optimization problem, with the global objective consisting of the sum of local objective functions of the agents. The agents solve the optimization problem using local computation and…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-11-07 Shripad Gade , Nitin H. Vaidya

Distributed optimization finds applications in large-scale machine learning, data processing and classification over multi-agent networks. In real-world scenarios, the communication network of agents may encounter latency that may affect…

Systems and Control · Electrical Eng. & Systems 2025-10-06 Mohammadreza Doostmohammadian , Narahari Kasagatta Ramesh , Alireza Aghasi

In the intricate dance of multi-agent systems, achieving average consensus is not just vital--it is the backbone of their functionality. In conventional average consensus algorithms, all agents reach an agreement by individual calculations…

Multiagent Systems · Computer Science 2024-12-12 Huqiang Cheng , Mengying Xie , Xiaowei Yang , Qingguo Lü , Huaqing Li

We study distributed estimation and learning problems in a networked environment where agents exchange information to estimate unknown statistical properties of random variables from their privately observed samples. The agents can…

Machine Learning · Computer Science 2024-04-02 Marios Papachristou , M. Amin Rahimian

In distributed optimization and iterative consensus literature, a standard problem is for $N$ agents to minimize a function $f$ over a subset of Euclidean space, where the cost function is expressed as a sum $\sum f_i$. In this paper, we…

Cryptography and Security · Computer Science 2014-01-14 Zhenqi Huang , Sayan Mitra , Nitin Vaidya

This paper introduces a novel continuous-time dynamic average consensus algorithm for networks whose interaction is described by a strongly connected and weight-balanced directed graph. The proposed distributed algorithm allows agents to…

Optimization and Control · Mathematics 2014-01-28 Solmaz S. Kia , Jorge Cortes , Sonia Martinez

We consider cooperative multi-agent consensus optimization problems over both static and time-varying communication networks, where only local communications are allowed. The objective is to minimize the sum of agent-specific possibly…

Optimization and Control · Mathematics 2017-06-27 Erfan Yazdandoost Hamedani , Necdet Serhat Aybat

Decentralized optimization is crucial for multi-agent systems, with significant concerns about communication efficiency and privacy. This paper explores the role of efficient communication in decentralized stochastic gradient descent…

Systems and Control · Electrical Eng. & Systems 2025-06-10 Wei Huo , Changxin Liu , Kemi Ding , Karl Henrik Johansson , Ling Shi

We consider a convex unconstrained optimization problem that arises in a network of agents whose goal is to cooperatively optimize the sum of the individual agent objective functions through local computations and communications. For this…

Optimization and Control · Mathematics 2008-03-11 Angelia Nedić , Alex Olshevsky , Asuman Ozdaglar , John N. Tsitsiklis

We propose a new decentralized average consensus algorithm with compressed communication that scales linearly with the network size n. We prove that the proposed method converges to the average of the initial values held locally by the…

Optimization and Control · Mathematics 2021-09-16 Mohammad Taha Toghani , César A. Uribe

Many applications of machine learning, such as human health research, involve processing private or sensitive information. Privacy concerns may impose significant hurdles to collaboration in scenarios where there are multiple sites holding…

Machine Learning · Computer Science 2021-02-24 Hafiz Imtiaz , Jafar Mohammadi , Anand D. Sarwate

We analyze convergence of decentralized cooperative online estimation algorithms by a network of multiple nodes via information exchanging in an uncertain environment. Each node has a linear observation of an unknown parameter with randomly…

Signal Processing · Electrical Eng. & Systems 2020-12-08 Jiexiang Wang , Tao Li , Xiwei Zhang

Many resource allocation problems can be formulated as an optimization problem whose constraints contain sensitive information about participating users. This paper concerns solving this kind of optimization problem in a distributed manner…

Optimization and Control · Mathematics 2016-11-17 Shuo Han , Ufuk Topcu , George J. Pappas

This paper investigates the differentially private bipartite consensus algorithm over signed networks. The proposed algorithm protects each agent's sensitive information by adding noise with time-varying variances to the…

Systems and Control · Electrical Eng. & Systems 2023-04-04 Jimin Wang , Jieming Ke , Ji-Feng Zhang

We address nonconvex learning problems over undirected networks. In particular, we focus on the challenge of designing an algorithm that is both communication-efficient and that guarantees the privacy of the agents' data. The first goal is…

Machine Learning · Computer Science 2026-04-06 Xiaoxing Ren , Yuwen Ma , Nicola Bastianello , Karl H. Johansson , Thomas Parisini , Andreas A. Malikopoulos

We study the fundamental task of estimating the median of an underlying distribution from a finite number of samples, under pure differential privacy constraints. We focus on distributions satisfying the minimal assumption that they have a…

Statistics Theory · Mathematics 2020-11-13 Christos Tzamos , Emmanouil-Vasileios Vlatakis-Gkaragkounis , Ilias Zadik

This paper proposes a new distributed nonconvex stochastic optimization algorithm that can achieve privacy protection, communication efficiency and convergence simultaneously. Specifically, each node adds general privacy noises to its local…

Systems and Control · Electrical Eng. & Systems 2025-08-06 Jialong Chen , Jimin Wang , Ji-Feng Zhang