English
Related papers

Related papers: A Communication-efficient Local Differentially Pri…

200 papers

In a multi-agent system, agents can cooperatively learn a model from data by exchanging their estimated model parameters, without the need to exchange the locally available data used by the agents. This strategy, often called federated…

Machine Learning · Computer Science 2023-05-09 Halil Yigit Oksuz , Fabio Molinari , Henning Sprekeler , Jörg Raisch

We consider the problem of collaborative personalized mean estimation under a privacy constraint in an environment of several agents continuously receiving data according to arbitrary unknown agent-specific distributions. In particular, we…

Machine Learning · Computer Science 2024-12-02 Yauhen Yakimenka , Chung-Wei Weng , Hsuan-Yin Lin , Eirik Rosnes , Jörg Kliewer

We consider a federated data analytics problem in which a server coordinates the collaborative data analysis of multiple users with privacy concerns and limited communication capability. The commonly adopted compression schemes introduce…

Cryptography and Security · Computer Science 2024-02-02 Richeng Jin , Zhonggen Su , Caijun Zhong , Zhaoyang Zhang , Tony Quek , Huaiyu Dai

Security concerns in large-scale networked environments are becoming increasingly critical. To further improve the algorithm security from the design perspective of decentralized optimization algorithms, we introduce a new measure: Privacy…

Optimization and Control · Mathematics 2024-12-16 Luqing Wang , Luyao Guo , Shaofu Yang , Xinli Shi

This paper proposes a differentially private gradient-tracking-based distributed stochastic optimization algorithm over directed graphs. In particular, privacy noises are incorporated into each agent's state and tracking variable to…

Systems and Control · Electrical Eng. & Systems 2026-04-15 Jialong Chen , Jimin Wang , Ji-Feng Zhang

Deep reinforcement learning algorithms have recently been used to train multiple interacting agents in a centralised manner whilst keeping their execution decentralised. When the agents can only acquire partial observations and are faced…

Machine Learning · Computer Science 2020-01-27 Emanuele Pesce , Giovanni Montana

We present a distributed optimization protocol that preserves statistical privacy of agents' local cost functions against a passive adversary that corrupts some agents in the network. The protocol is a composition of a distributed ``{\em…

Cryptography and Security · Computer Science 2021-01-01 Nirupam Gupta , Shripad Gade , Nikhil Chopra , Nitin H. Vaidya

We study distributed composite optimization over networks: agents minimize a sum of smooth (strongly) convex functions, the agents' sum-utility, plus a nonsmooth (extended-valued) convex one. We propose a general unified algorithmic…

Optimization and Control · Mathematics 2021-08-04 Jinming Xu , Ye Tian , Ying Sun , Gesualdo Scutari

Designing policies for a network of agents is typically done by formulating an optimization problem where each agent has access to state measurements of all the other agents in the network. Such policy designs with centralized information…

Optimization and Control · Mathematics 2024-05-02 Georgios Darivianakis , Angelos Georghiou , Soroosh Shafiee , John Lygeros

Analyzing data owned by several parties while achieving a good trade-off between utility and privacy is a key challenge in federated learning and analytics. In this work, we introduce a novel relaxation of local differential privacy (LDP)…

Machine Learning · Computer Science 2022-03-08 Edwige Cyffers , Aurélien Bellet

In decentralized cooperative multi-agent reinforcement learning, agents can aggregate information from one another to learn policies that maximize a team-average objective function. Despite the willingness to cooperate with others, the…

Systems and Control · Electrical Eng. & Systems 2022-07-27 Martin Figura , Yixuan Lin , Ji Liu , Vijay Gupta

Federated Learning (FL) is a paradigm for large-scale distributed learning which faces two key challenges: (i) efficient training from highly heterogeneous user data, and (ii) protecting the privacy of participating users. In this work, we…

Machine Learning · Computer Science 2023-01-06 Maxence Noble , Aurélien Bellet , Aymeric Dieuleveut

The diversity and quantity of data warehouses, gathering data from distributed devices such as mobile devices, can enhance the success and robustness of machine learning algorithms. Federated learning enables distributed participants to…

Machine Learning · Computer Science 2022-03-10 Shuo Wang , Surya Nepal , Kristen Moore , Marthie Grobler , Carsten Rudolph , Alsharif Abuadbba

Federated learning has emerged as a powerful framework for analysing distributed data, yet two challenges remain pivotal: heterogeneity across sites and privacy of local data. In this paper, we address both challenges within a federated…

Machine Learning · Computer Science 2026-04-07 Mengchu Li , Ye Tian , Yang Feng , Yi Yu

This paper addresses the problem of differentially private distributed optimization under limited communication, where each agent aims to keep their cost function private while minimizing the sum of all agents' cost functions. In response,…

Optimization and Control · Mathematics 2023-04-05 Antai Xie , Xinlei Yi , Xiaofan Wang , Ming Cao , Xiaoqiang Ren

Federated learning (FL) is a new paradigm that enables many clients to jointly train a machine learning (ML) model under the orchestration of a parameter server while keeping the local data not being exposed to any third party. However, the…

Machine Learning · Computer Science 2022-04-27 Yiwei Li , Shuai Wang , Tsung-Hui Chang , Chong-Yung Chi

We study differentially private distributed optimization under communication constraints. A server using SGD for optimization aggregates the client-side local gradients for model updates using distributed mean estimation (DME). We develop a…

Machine Learning · Computer Science 2023-02-23 Antonious M. Girgis , Suhas Diggavi

We present a federated, asynchronous, and $(\varepsilon, \delta)$-differentially private algorithm for PCA in the memory-limited setting. Our algorithm incrementally computes local model updates using a streaming procedure and adaptively…

Machine Learning · Computer Science 2020-10-26 Andreas Grammenos , Rodrigo Mendoza-Smith , Jon Crowcroft , Cecilia Mascolo

Despite significant advances on distributed continuous-time optimization of multi-agent networks, there is still lack of an efficient algorithm to achieve the goal of distributed optimization at a pre-specified time. Herein, we design a…

Optimization and Control · Mathematics 2021-06-23 Jialing Zhou , Yuezu Lv , Changyun Wen , Guanghui Wen

Federated learning is a promising framework for learning over decentralized data spanning multiple regions. This approach avoids expensive central training data aggregation cost and can improve privacy because distributed sites do not have…

Machine Learning · Computer Science 2021-01-01 Beomyeol Jeon , S. M. Ferdous , Muntasir Raihan Rahman , Anwar Walid