English
Related papers

Related papers: PAC-DP: Personalized Adaptive Clipping for Differe…

200 papers

Federated Learning (FL) enables collaborative model training without direct data sharing, yet it remains vulnerable to privacy attacks such as model inversion and membership inference. Existing differential privacy (DP) solutions for FL…

Cryptography and Security · Computer Science 2026-01-06 Yunbo Li , Jiaping Gui , Fanchao Meng , Yue Wu

Privacy and communication efficiency are important challenges in federated training of neural networks, and combining them is still an open problem. In this work, we develop a method that unifies highly compressed communication and…

Machine Learning · Computer Science 2021-12-09 Aleksei Triastcyn , Matthias Reisser , Christos Louizos

As large language models (LLMs) increasingly underpin technological advancements, the privacy of their training data emerges as a critical concern. Differential Privacy (DP) serves as a rigorous mechanism to protect this data, yet its…

Machine Learning · Computer Science 2025-07-03 Liangyu Wang , Junxiao Wang , Jie Ren , Zihang Xiang , David E. Keyes , Di Wang

User-level differential privacy (DP) provides certifiable privacy guarantees to the information that is specific to any user's data in federated learning. Existing methods that ensure user-level DP come at the cost of severe accuracy…

Machine Learning · Computer Science 2022-03-22 Anda Cheng , Peisong Wang , Xi Sheryl Zhang , Jian Cheng

Federated learning, as a distributed architecture, shows great promise for applications in Cyber-Physical-Social Systems (CPSS). In order to mitigate the privacy risks inherent in CPSS, the integration of differential privacy with federated…

Machine Learning · Computer Science 2025-06-05 Jiayi Wan , Xiang Zhu , Fanzhen Liu , Wei Fan , Xiaolong Xu

In many real-world applications of machine learning, data are distributed across many clients and cannot leave the devices they are stored on. Furthermore, each client's data, computational resources and communication constraints may be…

Machine Learning · Statistics 2019-12-02 Mrinank Sharma , Michael Hutchinson , Siddharth Swaroop , Antti Honkela , Richard E. Turner

Nowadays, the ubiquitous usage of mobile devices and networks have raised concerns about the loss of control over personal data and research advance towards the trade-off between privacy and utility in scenarios that combine exchange…

Advanced adversarial attacks such as membership inference and model memorization can make federated learning (FL) vulnerable and potentially leak sensitive private data. Local differentially private (LDP) approaches are gaining more…

Cryptography and Security · Computer Science 2022-08-04 M. A. P. Chamikara , Dongxi Liu , Seyit Camtepe , Surya Nepal , Marthie Grobler , Peter Bertok , Ibrahim Khalil

Federated Learning (FL) offers a promising approach for training clinical AI models without centralizing sensitive patient data. However, its real-world adoption is hindered by challenges related to privacy, resource constraints, and…

Federated learning aims to protect data privacy by collaboratively learning a model without sharing private data among users. However, an adversary may still be able to infer the private training data by attacking the released model.…

Machine Learning · Computer Science 2021-09-13 Zhicong Liang , Bao Wang , Quanquan Gu , Stanley Osher , Yuan Yao

Federated learning (FL) that enables edge devices to collaboratively learn a shared model while keeping their training data locally has received great attention recently and can protect privacy in comparison with the traditional centralized…

Machine Learning · Computer Science 2022-11-17 Rui Hu , Yanmin Gong , Yuanxiong Guo

Differential privacy (DP) is a privacy-preserving paradigm that protects the training data when training deep learning models. Critically, the performance of models is determined by the training hyperparameters, especially those of the…

Machine Learning · Computer Science 2025-03-04 Zhiqi Bu , Ruixuan Liu

Differentially Private Federated Learning (DP-FL) has garnered attention as a collaborative machine learning approach that ensures formal privacy. Most DP-FL approaches ensure DP at the record-level within each silo for cross-silo FL.…

Machine Learning · Computer Science 2024-06-18 Fumiyuki Kato , Li Xiong , Shun Takagi , Yang Cao , Masatoshi Yoshikawa

In the era of data-driven machine-learning applications, privacy concerns and the scarcity of labeled data have become paramount challenges. These challenges are particularly pronounced in the domain of few-shot learning, where the ability…

Most existing decentralized learning methods with differential privacy (DP) guarantee rely on constant gradient clipping bounds and fixed-level DP Gaussian noises for each node throughout the training process, leading to a significant…

Machine Learning · Computer Science 2025-05-13 Zehan Zhu , Yan Huang , Xin Wang , Shouling Ji , Jinming Xu

While federated learning (FL) eliminates the transmission of raw data over a network, it is still vulnerable to privacy breaches from the communicated model parameters. In this work, we propose Multi-Tier Federated Learning with Multi-Tier…

Machine Learning · Computer Science 2024-11-11 Evan Chen , Frank Po-Chen Lin , Dong-Jun Han , Christopher G. Brinton

Differential privacy is a widely accepted measure of privacy in the context of deep learning algorithms, and achieving it relies on a noisy training approach known as differentially private stochastic gradient descent (DP-SGD). DP-SGD…

Machine Learning · Computer Science 2023-07-26 Ce Feng , Nuo Xu , Wujie Wen , Parv Venkitasubramaniam , Caiwen Ding

Federated learning (FL) allows to train a massive amount of data privately due to its decentralized structure. Stochastic gradient descent (SGD) is commonly used for FL due to its good empirical performance, but sensitive user information…

Machine Learning · Computer Science 2021-02-10 Muah Kim , Onur Günlü , Rafael F. Schaefer

Differentially private stochastic gradient descent (DP-SGD) is the most widely used method for training machine learning models with provable privacy guarantees. A key challenge in DP-SGD is setting the per-sample gradient clipping…

Machine Learning · Computer Science 2025-10-29 Atefeh Gilani , Naima Tasnim , Lalitha Sankar , Oliver Kosut

Federated Learning (FL) allows multiple participants to train machine learning models collaboratively by keeping their datasets local while only exchanging model updates. Alas, this is not necessarily free from privacy and robustness…

Cryptography and Security · Computer Science 2022-05-30 Mohammad Naseri , Jamie Hayes , Emiliano De Cristofaro