English
Related papers

Related papers: Robustness Threats of Differential Privacy

200 papers

Differential Privacy (DP) is a key property to protect data and models from integrity attacks. In the Deep Learning (DL) field, it is commonly implemented through the Differentially Private Stochastic Gradient Descent (DP-SGD). However,…

Machine Learning · Computer Science 2023-11-21 Jiménez-López , Daniel , Rodríguez-Barroso , Nuria , Luzón , M. Victoria , Herrera , Francisco

Differentially private learning is essential for training models on sensitive data, but empirical studies consistently show that it can degrade performance, introduce fairness issues like disparate impact, and reduce adversarial robustness.…

Machine Learning · Computer Science 2026-04-21 Ruichen Xu , Kexin Chen

Differential privacy (DP) has become the de facto standard of privacy preservation due to its strong protection and sound mathematical foundation, which is widely adopted in different applications such as big data analysis, graph data…

Cryptography and Security · Computer Science 2021-12-06 Honglu Jiang , Yifeng Gao , S M Sarwar , Luis GarzaPerez , Mahmudul Robin

Deep learning techniques based on neural networks have shown significant success in a wide range of AI tasks. Large-scale training datasets are one of the critical factors for their success. However, when the training datasets are…

Cryptography and Security · Computer Science 2019-12-23 Lei Yu , Ling Liu , Calton Pu , Mehmet Emre Gursoy , Stacey Truex

The worldwide adoption of machine learning (ML) and deep learning models, particularly in critical sectors, such as healthcare and finance, presents substantial challenges in maintaining individual privacy and fairness. These two elements…

Machine Learning · Computer Science 2024-04-16 Mengmeng Yang , Ming Ding , Youyang Qu , Wei Ni , David Smith , Thierry Rakotoarivelo

Machine learning techniques based on neural networks are achieving remarkable results in a wide variety of domains. Often, the training of models requires large, representative datasets, which may be crowdsourced and contain sensitive…

Machine Learning · Statistics 2018-12-21 Martín Abadi , Andy Chu , Ian Goodfellow , H. Brendan McMahan , Ilya Mironov , Kunal Talwar , Li Zhang

The increased application of machine learning (ML) in sensitive domains requires protecting the training data through privacy frameworks, such as differential privacy (DP). DP requires to specify a uniform privacy level $\varepsilon$ that…

Machine Learning · Computer Science 2024-01-31 Krishna Acharya , Franziska Boenisch , Rakshit Naidu , Juba Ziani

The remarkable proliferation of deep learning across various industries has underscored the importance of data privacy and security in AI pipelines. As the evolution of sophisticated Membership Inference Attacks (MIAs) threatens the secrecy…

Cryptography and Security · Computer Science 2023-06-06 Eugenio Lomurno , Alberto Archetti , Francesca Ausonio , Matteo Matteucci

The superior performance of large foundation models relies on the use of massive amounts of high-quality data, which often contain sensitive, private and copyrighted material that requires formal protection. While differential privacy (DP)…

Machine Learning · Computer Science 2024-10-30 Zhiqi Bu , Xinwei Zhang , Mingyi Hong , Sheng Zha , George Karypis

To enable an ethical and legal use of machine learning algorithms, they must both be fair and protect the privacy of those whose data are being used. However, implementing privacy and fairness constraints might come at the cost of utility…

Machine Learning · Computer Science 2021-02-12 Marlotte Pannekoek , Giacomo Spigler

Models need to be trained with privacy-preserving learning algorithms to prevent leakage of possibly sensitive information contained in their training data. However, canonical algorithms like differentially private stochastic gradient…

Machine Learning · Computer Science 2022-10-06 Yannis Cattan , Christopher A. Choquette-Choo , Nicolas Papernot , Abhradeep Thakurta

Artificial Intelligence systems require a through assessment of different pillars of trust, namely, fairness, interpretability, data and model privacy, reliability (safety) and robustness against against adversarial attacks. While these…

Cryptography and Security · Computer Science 2020-03-10 Vasisht Duddu , N. Rajesh Pillai , D. Vijay Rao , Valentina E. Balas

Many high-stakes applications require machine learning models that protect user privacy and provide well-calibrated, accurate predictions. While Differential Privacy (DP) is the gold standard for protecting user privacy, standard DP…

Machine Learning · Computer Science 2025-05-09 Ossi Räisä , Stratis Markou , Matthew Ashman , Wessel P. Bruinsma , Marlon Tobaben , Antti Honkela , Richard E. Turner

Differential privacy (DP) is a key technique for protecting sensitive patient data in medical deep learning (DL). As clinical models grow more data-dependent, balancing privacy with utility and fairness has become a critical challenge. This…

Differential privacy is a strong notion for privacy that can be used to prove formal guarantees, in terms of a privacy budget, $\epsilon$, about how much information is leaked by a mechanism. However, implementations of privacy-preserving…

Machine Learning · Computer Science 2019-08-14 Bargav Jayaraman , David Evans

The integration of Differential Privacy (DP) with diffusion models (DMs) presents a promising yet challenging frontier, particularly due to the substantial memorization capabilities of DMs that pose significant privacy risks. Differential…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Yu-Lin Tsai , Yizhe Li , Zekai Chen , Po-Yu Chen , Chia-Mu Yu , Xuebin Ren , Francois Buet-Golfouse

The combination of deep neural networks and Differential Privacy has been of increasing interest in recent years, as it offers important data protection guarantees to the individuals of the training datasets used. However, using…

Machine Learning · Computer Science 2021-06-03 Osvald Frisk , Friedrich Dörmann , Christian Marius Lillelund , Christian Fischer Pedersen

Gradient leakage attacks are considered one of the wickedest privacy threats in deep learning as attackers covertly spy gradient updates during iterative training without compromising model training quality, and yet secretly reconstruct…

Machine Learning · Computer Science 2021-12-28 Wenqi Wei , Ling Liu

We study the difficulties in learning that arise from robust and differentially private optimization. We first study convergence of gradient descent based adversarial training with differential privacy, taking a simple binary classification…

Machine Learning · Computer Science 2022-01-10 Jamie Hayes , Borja Balle , M. Pawan Kumar

Training deep learning models with differential privacy (DP) results in a degradation of performance. The training dynamics of models with DP show a significant difference from standard training, whereas understanding the geometric…

Machine Learning · Computer Science 2023-06-12 Jinseong Park , Hoki Kim , Yujin Choi , Jaewook Lee