English
Related papers

Related papers: Gradient Leakage Attack Resilient Deep Learning

200 papers

Gradient Inversion (GI) attacks are a ubiquitous threat in Federated Learning (FL) as they exploit gradient leakage to reconstruct supposedly private training data. Common defense mechanisms such as Differential Privacy (DP) or stochastic…

Machine Learning · Computer Science 2024-12-06 Daniel Scheliga , Patrick Mäder , Marco Seeland

The remarkable proliferation of deep learning across various industries has underscored the importance of data privacy and security in AI pipelines. As the evolution of sophisticated Membership Inference Attacks (MIAs) threatens the secrecy…

Cryptography and Security · Computer Science 2023-06-06 Eugenio Lomurno , Alberto Archetti , Francesca Ausonio , Matteo Matteucci

Fine-tuning large language models (LLMs) for specific tasks introduces privacy risks, as models may inadvertently memorise and leak sensitive training data. While Differential Privacy (DP) offers a solution to mitigate these risks, it…

Machine Learning · Computer Science 2024-11-26 Olivia Ma , Jonathan Passerat-Palmbach , Dmitrii Usynin

Gradient inversion attack (or input recovery from gradient) is an emerging threat to the security and privacy preservation of Federated learning, whereby malicious eavesdroppers or participants in the protocol can recover (partially) the…

Cryptography and Security · Computer Science 2021-12-02 Yangsibo Huang , Samyak Gupta , Zhao Song , Kai Li , Sanjeev Arora

Training deep neural networks via federated learning allows clients to share, instead of the original data, only the model trained on their data. Prior work has demonstrated that in practice a client's private information, unrelated to the…

Cryptography and Security · Computer Science 2021-06-01 Fan Mo , Anastasia Borovykh , Mohammad Malekzadeh , Hamed Haddadi , Soteris Demetriou

Differential Privacy has become a widely popular method for data protection in machine learning, especially since it allows formulating strict mathematical privacy guarantees. This survey provides an overview of the state-of-the-art of…

Machine Learning · Computer Science 2025-10-03 Lea Demelius , Roman Kern , Andreas Trügler

Modern machine learning algorithms aim to extract fine-grained information from data to provide accurate predictions, which often conflicts with the goal of privacy protection. This paper addresses the practical and theoretical importance…

Machine Learning · Statistics 2023-07-17 Puyu Wang , Yunwen Lei , Yiming Ying , Ding-Xuan Zhou

For many differentially private algorithms, such as the prominent noisy stochastic gradient descent (DP-SGD), the analysis needed to bound the privacy leakage of a single training run is well understood. However, few studies have reasoned…

Machine Learning · Computer Science 2022-03-15 Nicolas Papernot , Thomas Steinke

Generative adversarial network (GAN) has attracted increasing attention recently owing to its impressive ability to generate realistic samples with high privacy protection. Without directly interactive with training examples, the generative…

Machine Learning · Computer Science 2020-07-07 Chuan Ma , Jun Li , Ming Ding , Bo Liu , Kang Wei , Jian Weng , H. Vincent Poor

Training large neural networks with meaningful/usable differential privacy security guarantees is a demanding challenge. In this paper, we tackle this problem by revisiting the two key operations in Differentially Private Stochastic…

Machine Learning · Computer Science 2022-10-11 Hanshen Xiao , Jun Wan , Srinivas Devadas

In this paper, we focus on preserving differential privacy (DP) in continual learning (CL), in which we train ML models to learn a sequence of new tasks while memorizing previous tasks. We first introduce a notion of continual adjacent…

Machine Learning · Computer Science 2021-10-12 Pradnya Desai , Phung Lai , NhatHai Phan , My T. Thai

Federated learning (FL) enhances privacy by keeping user data on local devices. However, emerging attacks have demonstrated that the updates shared by users during training can reveal significant information about their data. This has…

Differential privacy (DP) is the prevailing technique for protecting user data in machine learning models. However, deficits to this framework include a lack of clarity for selecting the privacy budget $\epsilon$ and a lack of…

Machine Learning · Computer Science 2023-06-29 Tyler LeBlond , Joseph Munoz , Fred Lu , Maya Fuchs , Elliott Zaresky-Williams , Edward Raff , Brian Testa

Training deep learning models with differential privacy (DP) results in a degradation of performance. The training dynamics of models with DP show a significant difference from standard training, whereas understanding the geometric…

Machine Learning · Computer Science 2023-06-12 Jinseong Park , Hoki Kim , Yujin Choi , Jaewook Lee

Auditing mechanisms for differential privacy use probabilistic means to empirically estimate the privacy level of an algorithm. For private machine learning, existing auditing mechanisms are tight: the empirical privacy estimate (nearly)…

This article presents DDP-SA, a scalable privacy-preserving federated learning framework that jointly leverages client-side local differential privacy (LDP) and full-threshold additive secret sharing (ASS) for secure aggregation. Unlike…

Cryptography and Security · Computer Science 2026-04-09 Wenjing Wei , Farid Nait-Abdesselam , Alla Jammine

Deep learning models are often trained on datasets that contain sensitive information such as individuals' shopping transactions, personal contacts, and medical records. An increasingly important line of work therefore has sought to train…

Machine Learning · Computer Science 2020-07-23 Zhiqi Bu , Jinshuo Dong , Qi Long , Weijie J. Su

Federated Learning(FL), in theory, preserves privacy of individual clients' data while producing quality machine learning models. However, attacks such as Deep Leakage from Gradients(DLG) severely question the practicality of FL. In this…

Machine Learning · Computer Science 2024-08-19 Joon Kim , Sejin Park

We study a pitfall in the typical workflow for differentially private machine learning. The use of differentially private learning algorithms in a "drop-in" fashion -- without accounting for the impact of differential privacy (DP) noise…

Cryptography and Security · Computer Science 2022-05-16 Wenxuan Bao , Luke A. Bauer , Vincent Bindschaedler

The superior performance of large foundation models relies on the use of massive amounts of high-quality data, which often contain sensitive, private and copyrighted material that requires formal protection. While differential privacy (DP)…

Machine Learning · Computer Science 2024-10-30 Zhiqi Bu , Xinwei Zhang , Mingyi Hong , Sheng Zha , George Karypis