English
Related papers

Related papers: Revisiting Gradient Pruning: A Dual Realization fo…

200 papers

Federated Learning (FL) enables distributed participants (e.g., mobile devices) to train a global model without sharing data directly to a central server. Recent studies have revealed that FL is vulnerable to gradient inversion attack…

Cryptography and Security · Computer Science 2023-09-15 Jiaheng Wei , Yanjun Zhang , Leo Yu Zhang , Chao Chen , Shirui Pan , Kok-Leong Ong , Jun Zhang , Yang Xiang

Recent advances in deep learning have drastically improved performance on many Natural Language Understanding (NLU) tasks. However, the data used to train NLU models may contain private information such as addresses or phone numbers,…

Computation and Language · Computer Science 2022-03-03 Christophe Dupuy , Radhika Arava , Rahul Gupta , Anna Rumshisky

Privacy-preserving training on sensitive data commonly relies on differentially private stochastic optimization with gradient clipping and Gaussian noise. The clipping threshold is a critical control knob: if set too small, systematic…

Machine Learning · Computer Science 2026-02-12 Mohammad Partohaghighi , Roummel Marcia , Bruce J. West , YangQuan Chen

In federated learning collaborative learning takes place by a set of clients who each want to remain in control of how their local training data is used, in particular, how can each client's local training data remain private? Differential…

Machine Learning · Computer Science 2023-07-18 Marten van Dijk , Phuong Ha Nguyen

Differential privacy (DP) is a prominent method for protecting information about individuals during data analysis. Training neural networks with differentially private stochastic gradient descent (DPSGD) influences the model's learning…

Machine Learning · Computer Science 2025-10-10 Lea Demelius , Dominik Kowald , Simone Kopeinik , Roman Kern , Andreas Trügler

Federated learning (FL) enables collaborative model training across distributed clients without sharing raw data, making it a promising approach for privacy-preserving machine learning. However, ensuring differential privacy (DP) in FL…

Machine Learning · Computer Science 2025-03-28 Kanishka Ranaweera , David Smith , Pubudu N. Pathirana , Ming Ding , Thierry Rakotoarivelo , Aruna Seneviratne

Federated learning enables collaborative model training across distributed clients while preserving data privacy. However, in practical deployments, device heterogeneity, non-independent, and identically distributed (Non-IID) data often…

Artificial Intelligence · Computer Science 2026-02-20 Jin Wang , Hui Ma , Fei Xing , Ming Yan

Federated learning (FL) enables collaborative model training among multiple clients without the need to expose raw data. Its ability to safeguard privacy, at the heart of FL, has recently been a hot-button debate topic. To elaborate,…

Machine Learning · Computer Science 2025-06-11 Mingyuan Fan , Fuyi Wang , Cen Chen , Jianying Zhou

Graph Neural Networks (GNNs) have emerged as powerful models for learning from graph-structured data. However, their widespread adoption has raised serious privacy concerns. While prior research has primarily focused on edge-level privacy,…

Machine Learning · Computer Science 2025-11-12 Jie Fu , Yuan Hong , Zhili Chen , Wendy Hui Wang

Federated learning (FL) is an emerging distributed machine learning paradigm proposed for privacy preservation. Unlike traditional centralized learning approaches, FL enables multiple users to collaboratively train a shared global model…

Cryptography and Security · Computer Science 2024-10-01 Hangyu Zhu , Liyuan Huang , Zhenping Xie

We show that aggregated model updates in federated learning may be insecure. An untrusted central server may disaggregate user updates from sums of updates across participants given repeated observations, enabling the server to recover…

Cryptography and Security · Computer Science 2021-06-14 Maximilian Lam , Gu-Yeon Wei , David Brooks , Vijay Janapa Reddi , Michael Mitzenmacher

Federated Learning (FL) has recently emerged as a promising distributed machine learning framework to preserve clients' privacy, by allowing multiple clients to upload the gradients calculated from their local data to a central server.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Hao Fang , Bin Chen , Xuan Wang , Zhi Wang , Shu-Tao Xia

Federated learning has emerged as an attractive approach to protect data privacy by eliminating the need for sharing clients' data while reducing communication costs compared with centralized machine learning algorithms. However, recent…

With the flourishing prosperity of generative models, manipulated facial images have become increasingly accessible, raising concerns regarding privacy infringement and societal trust. In response, proactive defense strategies embed…

Cryptography and Security · Computer Science 2025-10-03 Yue Li , Linying Xue , Dongdong Lin , Qiushi Li , Hui Tian , Hongxia Wang

While machine learning has achieved remarkable results in a wide variety of domains, the training of models often requires large datasets that may need to be collected from different individuals. As sensitive information may be contained in…

Machine Learning · Computer Science 2023-02-07 Richeng Jin , Xiaofan He , Huaiyu Dai

Federated learning (FL) enables privacy-preserving collaborative model training but remains vulnerable to adversarial behaviors that compromise model utility or fairness across sensitive groups. While extensive studies have examined attacks…

Machine Learning · Computer Science 2025-11-13 Yanli Li , Yanan Zhou , Zhongliang Guo , Nan Yang , Yuning Zhang , Huaming Chen , Dong Yuan , Weiping Ding , Witold Pedrycz

The privacy leakage of the model about the training data can be bounded in the differential privacy mechanism. However, for meaningful privacy parameters, a differentially private model degrades the utility drastically when the model…

Machine Learning · Computer Science 2021-10-13 Da Yu , Huishuai Zhang , Wei Chen , Tie-Yan Liu

As large language models (LLMs) increasingly underpin technological advancements, the privacy of their training data emerges as a critical concern. Differential Privacy (DP) serves as a rigorous mechanism to protect this data, yet its…

Machine Learning · Computer Science 2025-07-03 Liangyu Wang , Junxiao Wang , Jie Ren , Zihang Xiang , David E. Keyes , Di Wang

Machine learning (ML) models have been shown to leak private information from their training datasets. Differential Privacy (DP), typically implemented through the differential private stochastic gradient descent algorithm (DP-SGD), has…

Machine Learning · Computer Science 2025-02-17 Dariush Wahdany , Matthew Jagielski , Adam Dziedzic , Franziska Boenisch

Most existing decentralized learning methods with differential privacy (DP) guarantee rely on constant gradient clipping bounds and fixed-level DP Gaussian noises for each node throughout the training process, leading to a significant…

Machine Learning · Computer Science 2025-05-13 Zehan Zhu , Yan Huang , Xin Wang , Shouling Ji , Jinming Xu