English
Related papers

Related papers: A Communication-efficient Local Differentially Pri…

200 papers

With artificial intelligence systems becoming ubiquitous in our society, its designers will soon have to start to consider its social dimension, as many of these systems will have to interact among them to work efficiently. With this in…

Artificial Intelligence · Computer Science 2020-06-23 Santiago Cuervo , Marco Alzate

We design a scalable algorithm to privately generate location heatmaps over decentralized data from millions of user devices. It aims to ensure differential privacy before data becomes visible to a service provider while maintaining high…

Cryptography and Security · Computer Science 2022-06-28 Eugene Bagdasaryan , Peter Kairouz , Stefan Mellem , Adrià Gascón , Kallista Bonawitz , Deborah Estrin , Marco Gruteser

In this paper, to effectively prevent information leakage, we propose a novel framework based on the concept of differential privacy (DP), in which artificial noises are added to the parameters at the clients side before aggregating,…

Machine Learning · Computer Science 2019-11-11 Kang Wei , Jun Li , Ming Ding , Chuan Ma , Howard H. Yang , Farokhi Farhad , Shi Jin , Tony Q. S. Quek , H. Vincent Poor

We consider the federated frequency estimation problem, where each user holds a private item $X_i$ from a size-$d$ domain and a server aims to estimate the empirical frequency (i.e., histogram) of $n$ items with $n \ll d$. Without any…

Information Theory · Computer Science 2022-11-21 Wei-Ning Chen , Ayfer Özgür , Graham Cormode , Akash Bharadwaj

We consider training machine learning models using Training data located on multiple private and geographically-scattered servers with different privacy settings. Due to the distributed nature of the data, communicating with all…

Machine Learning · Computer Science 2020-06-30 Farhad Farokhi , Nan Wu , David Smith , Mohamed Ali Kaafar

Privacy-aware multiagent systems must protect agents' sensitive data while simultaneously ensuring that agents accomplish their shared objectives. Towards this goal, we propose a framework to privatize inter-agent communications in…

Multiagent Systems · Computer Science 2023-01-24 Bo Chen , Calvin Hawkins , Mustafa O. Karabag , Cyrus Neary , Matthew Hale , Ufuk Topcu

This work tackles the challenges of data heterogeneity and communication limitations in decentralized federated learning. We focus on creating a collaboration graph that guides each client in selecting suitable collaborators for training…

Machine Learning · Computer Science 2024-06-11 Salma Kharrat , Marco Canini , Samuel Horvath

Decentralized optimization problems consist of multiple agents connected by a network. The agents have each local cost function, and the goal is to minimize the sum of the functions cooperatively. It requires the agents communicate with…

Optimization and Control · Mathematics 2021-11-12 Jimyeong Kim , Woocheol Choi

This paper focuses on decentralized composite optimization over networks without a central coordinator. We propose a novel decentralized symmetric ADMM algorithm that incorporates multiple communication rounds within each iteration, derived…

Optimization and Control · Mathematics 2026-03-06 Jinrui Huang , Xueqin Wang , Dong Liu , Jingguo Lan , Runxiong Wu

There is growing interest in large-scale machine learning and optimization over decentralized networks, e.g. in the context of multi-agent learning and federated learning. Due to the imminent need to alleviate the communication burden, the…

Machine Learning · Statistics 2020-09-02 Boyue Li , Shicong Cen , Yuxin Chen , Yuejie Chi

We introduce a practical and scalable algorithm (PALMA) for solving one of the fundamental problems of multi-agent systems -- finding matches and allocations -- in unboundedly large settings (e.g., resource allocation in urban environments,…

Multiagent Systems · Computer Science 2022-03-15 Panayiotis Danassis , Aleksei Triastcyn , Boi Faltings

In modern large-scale systems with sensor networks and IoT devices it is essential to collaboratively solve complex problems while utilizing network resources efficiently. In our paper we present three distributed optimization algorithms…

Systems and Control · Electrical Eng. & Systems 2025-04-24 Apostolos I. Rikos , Wei Jiang , Themistoklis Charalambous , Karl H. Johansson

In large-scale systems there are fundamental challenges when centralised techniques are used for task allocation. The number of interactions is limited by resource constraints such as on computation, storage, and network communication. We…

Artificial Intelligence · Computer Science 2022-05-12 Niall Creech , Natalia Criado Pacheco , Simon Miles

Federated learning is a distributed learning setting where the main aim is to train machine learning models without having to share raw data but only what is required for learning. To guarantee training data privacy and high-utility models,…

Machine Learning · Computer Science 2025-03-26 Mikko A. Heikkilä

This paper is mainly devoted to the distributed second-order multi-agent optimization problem with unbalanced and directed networks. To deal with this problem, a new distributed algorithm is proposed based on the local neighbor information…

Systems and Control · Electrical Eng. & Systems 2020-05-05 Lipo Mo , Haokun Hu , Yongguang Yu , Guojian Ren

We address differential privacy for fully distributed optimization subject to a shared inequality constraint. By co-designing the distributed optimization mechanism and the differential-privacy noise injection mechanism, we propose the…

Optimization and Control · Mathematics 2024-04-04 Yongqiang Wang , Angelia Nedic

We address distributed learning problems over undirected networks. Specifically, we focus on designing a novel ADMM-based algorithm that is jointly computation- and communication-efficient. Our design guarantees computational efficiency by…

Machine Learning · Computer Science 2026-01-21 Xiaoxing Ren , Nicola Bastianello , Karl H. Johansson , Thomas Parisini

This paper is devoted to distributed continuous-time and discrete-time optimization problems with nonuniform convex constraint sets and nonuniform stepsizes for general differentiable convex objective functions. The communication graphs are…

Optimization and Control · Mathematics 2020-03-03 Peng Lin , Wei Ren , Chunhua Yang , Weihua Gui

Distributed optimization finds many applications in machine learning, signal processing, and control systems. In these real-world applications, the constraints of communication networks, particularly limited bandwidth, necessitate…

Systems and Control · Electrical Eng. & Systems 2024-10-29 Mohammadreza Doostmohammadian , Sérgio Pequito

We consider a platform's problem of collecting data from privacy sensitive users to estimate an underlying parameter of interest. We formulate this question as a Bayesian-optimal mechanism design problem, in which an individual can share…

Computer Science and Game Theory · Computer Science 2023-09-07 Alireza Fallah , Ali Makhdoumi , Azarakhsh Malekian , Asuman Ozdaglar