English
Related papers

Related papers: Interaction is necessary for distributed learning …

200 papers

Despite recent progress in enhancing the privacy of federated learning (FL) via differential privacy (DP), the trade-off of DP between privacy protection and performance is still underexplored for real-world medical scenario. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Meirui Jiang , Yuan Zhong , Anjie Le , Xiaoxiao Li , Qi Dou

User-level differential privacy (DP) provides certifiable privacy guarantees to the information that is specific to any user's data in federated learning. Existing methods that ensure user-level DP come at the cost of severe accuracy…

Machine Learning · Computer Science 2022-03-22 Anda Cheng , Peisong Wang , Xi Sheryl Zhang , Jian Cheng

While modern machine learning models rely on increasingly large training datasets, data is often limited in privacy-sensitive domains. Generative models trained with differential privacy (DP) on sensitive data can sidestep this challenge,…

Machine Learning · Statistics 2024-01-02 Tim Dockhorn , Tianshi Cao , Arash Vahdat , Karsten Kreis

In the era of big data, the need to expand the amount of data through data sharing to improve model performance has become increasingly compelling. As a result, effective collaborative learning models need to be developed with respect to…

Machine Learning · Computer Science 2020-11-17 Huiwen Wu , Cen Chen , Li Wang

We address nonconvex learning problems over undirected networks. In particular, we focus on the challenge of designing an algorithm that is both communication-efficient and that guarantees the privacy of the agents' data. The first goal is…

Machine Learning · Computer Science 2026-04-06 Xiaoxing Ren , Yuwen Ma , Nicola Bastianello , Karl H. Johansson , Thomas Parisini , Andreas A. Malikopoulos

We consider a setup in which confidential i.i.d. samples $X_1,\dotsc,X_n$ from an unknown finite-support distribution $\boldsymbol{p}$ are passed through $n$ copies of a discrete privatization channel (a.k.a. mechanism) producing outputs…

Machine Learning · Computer Science 2018-11-30 Adriano Pastore , Michael Gastpar

Federated Learning (FL) is a paradigm for large-scale distributed learning which faces two key challenges: (i) efficient training from highly heterogeneous user data, and (ii) protecting the privacy of participating users. In this work, we…

Machine Learning · Computer Science 2023-01-06 Maxence Noble , Aurélien Bellet , Aymeric Dieuleveut

Distributed stochastic gradient descent is an important subroutine in distributed learning. A setting of particular interest is when the clients are mobile devices, where two important concerns are communication efficiency and the privacy…

Machine Learning · Statistics 2018-05-29 Naman Agarwal , Ananda Theertha Suresh , Felix Yu , Sanjiv Kumar , H. Brendan Mcmahan

We consider the problem of minimizing a convex risk with stochastic subgradients guaranteeing $\epsilon$-locally differentially private ($\epsilon$-LDP). While it has been shown that stochastic optimization is possible with $\epsilon$-LDP…

Machine Learning · Computer Science 2019-11-22 Kwang-Sung Jun , Francesco Orabona

In times of epidemics, swift reaction is necessary to mitigate epidemic spreading. For this reaction, localized approaches have several advantages, limiting necessary resources and reducing the impact of interventions on a larger scale.…

Machine Learning · Computer Science 2026-01-15 Raouf Kerkouche , Henrik Zunker , Mario Fritz , Martin J. Kühn

Sensitive statistics are often collected across sets of users, with repeated collection of reports done over time. For example, trends in users' private preferences or software usage may be monitored via such reports. We study the…

Machine Learning · Computer Science 2020-07-28 Úlfar Erlingsson , Vitaly Feldman , Ilya Mironov , Ananth Raghunathan , Kunal Talwar , Abhradeep Thakurta

We prove a general lower bound for differentially private federated learning protocols with arbitrary public-transcript interactions. The protocol may use any number of adaptive rounds, and each client's local samples may be reused across…

Machine Learning · Computer Science 2026-05-20 Yicheng Li

We study the problem of learning exponential distributions under differential privacy. Given $n$ i.i.d.\ samples from $\mathrm{Exp}(\lambda)$, the goal is to privately estimate $\lambda$ so that the learned distribution is close in total…

Data Structures and Algorithms · Computer Science 2026-03-31 Bar Mahpud , Or Sheffet

Federated Learning (FL) allows multiple participants to train machine learning models collaboratively by keeping their datasets local while only exchanging model updates. Alas, this is not necessarily free from privacy and robustness…

Cryptography and Security · Computer Science 2022-05-30 Mohammad Naseri , Jamie Hayes , Emiliano De Cristofaro

Models need to be trained with privacy-preserving learning algorithms to prevent leakage of possibly sensitive information contained in their training data. However, canonical algorithms like differentially private stochastic gradient…

Machine Learning · Computer Science 2022-10-06 Yannis Cattan , Christopher A. Choquette-Choo , Nicolas Papernot , Abhradeep Thakurta

Federated Learning (FL) is a distributed machine learning paradigm based on protecting data privacy of devices, which however, can still be broken by gradient leakage attack via parameter inversion techniques. Differential privacy (DP)…

Machine Learning · Computer Science 2025-05-27 Pengcheng Sun , Erwu Liu , Wei Ni , Rui Wang , Yuanzhe Geng , Lijuan Lai , Abbas Jamalipour

Local differential privacy (LDP) has received much interest recently. In existing protocols with LDP guarantees, a user encodes and perturbs his data locally before sharing it to the aggregator. In common practice, however, users would…

Cryptography and Security · Computer Science 2020-02-14 Lin Sun , Xiaojun Ye , Jun Zhao , Chenhui Lu , Mengmeng Yang

We consider the setting of publishing data without leaking sensitive information. We do so in the framework of Robust Local Differential Privacy (RLDP). This ensures privacy for all distributions of the data in an uncertainty set. We…

Information Theory · Computer Science 2022-05-11 Jasper Goseling , Milan Lopuhaä-Zwakenberg

In the recent years, Local Differential Privacy (LDP) has been one of the corner stone of privacy preserving data analysis. However, many challenges still opposes its widespread application. One of these problems is the scalability of LDP…

Cryptography and Security · Computer Science 2022-06-15 Thomas Carette

In the recent decades, the advance of information technology and abundant personal data facilitate the application of algorithmic personalized pricing. However, this leads to the growing concern of potential violation of privacy due to…

Machine Learning · Statistics 2021-09-13 Xi Chen , Sentao Miao , Yining Wang