English
Related papers

Related papers: Differential Privacy Has Disparate Impact on Model…

200 papers

Differentially Private Stochastic Gradient Descent (DP-SGD) limits the amount of private information deep learning models can memorize during training. This is achieved by clipping and adding noise to the model's gradients, and thus…

Computer Vision and Pattern Recognition · Computer Science 2023-06-22 Florian A. Hölzl , Daniel Rueckert , Georgios Kaissis

Graph Neural Networks (GNNs) have established themselves as the state-of-the-art models for many machine learning applications such as the analysis of social networks, protein interactions and molecules. Several among these datasets contain…

The performance cost of differential privacy has, for some applications, been shown to be higher for minority groups; fairness, conversely, has been shown to disproportionally compromise the privacy of members of such groups. Most work in…

Cryptography and Security · Computer Science 2022-03-08 Victor Petrén Bach Hansen , Atula Tejaswi Neerkaje , Ramit Sawhney , Lucie Flek , Anders Søgaard

Differential Privacy (DP) was originally developed to protect privacy. However, it has recently been utilized to secure machine learning (ML) models from poisoning attacks, with DP-SGD receiving substantial attention. Nevertheless, a…

Cryptography and Security · Computer Science 2023-11-13 Fereshteh Razmi , Jian Lou , Li Xiong

Differentially-private stochastic gradient descent (DP-SGD) is a family of iterative machine learning training algorithms that privatize gradients to generate a sequence of differentially-private (DP) model parameters. It is also the…

Machine Learning · Computer Science 2025-02-11 Weiwei Kong , Mónica Ribero

Within the machine learning community, reconstruction attacks are a principal concern and have been identified even in federated learning (FL), which was designed with privacy preservation in mind. In response to these threats, the privacy…

Deep learning models are increasingly popular in many machine learning applications where the training data may contain sensitive information. To provide formal and rigorous privacy guarantee, many learning systems now incorporate…

Machine Learning · Computer Science 2021-03-19 Xiangyi Chen , Zhiwei Steven Wu , Mingyi Hong

Differential privacy (DP) has become an essential framework for privacy-preserving machine learning. Existing DP learning methods, however, often have disparate impacts on model predictions, e.g., for minority groups. Gradient clipping,…

Machine Learning · Computer Science 2025-06-03 Linzh Zhao , Aki Rehn , Mikko A. Heikkilä , Razane Tajeddine , Antti Honkela

Current practices for reporting the level of differential privacy (DP) protection for machine learning (ML) algorithms such as DP-SGD provide an incomplete and potentially misleading picture of the privacy guarantees. For instance, if only…

Machine Learning · Computer Science 2025-10-03 Juan Felipe Gomez , Bogdan Kulynych , Georgios Kaissis , Flavio P. Calmon , Jamie Hayes , Borja Balle , Antti Honkela

Protecting privacy in learning while maintaining the model performance has become increasingly critical in many applications that involve sensitive data. Private Gradient Descent (PGD) is a commonly used private learning framework, which…

Machine Learning · Computer Science 2022-10-20 Junyuan Hong , Zhangyang Wang , Jiayu Zhou

Machine learning models are increasingly made available to the masses through public query interfaces. Recent academic work has demonstrated that malicious users who can query such models are able to infer sensitive information about…

Cryptography and Security · Computer Science 2017-12-27 Yunhui Long , Vincent Bindschaedler , Carl A. Gunter

Developing a differentially private deep learning algorithm is challenging, due to the difficulty in analyzing the sensitivity of objective functions that are typically used to train deep neural networks. Many existing methods resort to the…

Machine Learning · Computer Science 2019-10-16 Frederik Harder , Jonas Köhler , Max Welling , Mijung Park

The Noisy-SGD algorithm is widely used for privately training machine learning models. Traditional privacy analyses of this algorithm assume that the internal state is publicly revealed, resulting in privacy loss bounds that increase…

Machine Learning · Computer Science 2023-05-18 Shahab Asoodeh , Mario Diaz

In the domain of deep learning, the challenge of protecting sensitive data while maintaining model utility is significant. Traditional Differential Privacy (DP) techniques such as Differentially Private Stochastic Gradient Descent (DP-SGD)…

Machine Learning · Computer Science 2024-11-06 Tao Huang , Qingyu Huang , Xin Shi , Jiayang Meng , Guolong Zheng , Xu Yang , Xun Yi

Differentially private (DP) optimization is the standard paradigm to learn large neural networks that are accurate and privacy-preserving. The computational cost for DP deep learning, however, is notoriously heavy due to the per-sample…

Machine Learning · Computer Science 2023-09-20 Zhiqi Bu , Yu-Xiang Wang , Sheng Zha , George Karypis

Differential privacy (DP) is widely being employed in the industry as a practical standard for privacy protection. While private training of computer vision or natural language processing applications has been studied extensively, the…

Information Retrieval · Computer Science 2024-04-16 Juntaek Lim , Youngeun Kwon , Ranggi Hwang , Kiwan Maeng , G. Edward Suh , Minsoo Rhu

Differentially Private Stochastic Gradient Descent (DP-SGD) is the dominant paradigm for private training, but its fundamental limitations under worst-case adversarial privacy definitions remain poorly understood. We analyze DP-SGD in the…

Machine Learning · Computer Science 2026-04-17 Murat Bilgehan Ertan , Marten van Dijk

Differential Privacy (DP) mechanisms, especially in high-dimensional settings, often face the challenge of maintaining privacy without compromising the data utility. This work introduces an innovative shuffling mechanism in…

Machine Learning · Computer Science 2024-07-23 Jungang Yang , Zhe Ji , Liyao Xiang

In this paper, we present a notion of differential privacy (DP) for data that comes from different classes. Here, the class-membership is private information that needs to be protected. The proposed method is an output perturbation…

Signal Processing · Electrical Eng. & Systems 2023-06-12 Raksha Ramakrishna , Anna Scaglione , Tong Wu , Nikhil Ravi , Sean Peisert

The combination of deep neural networks and Differential Privacy has been of increasing interest in recent years, as it offers important data protection guarantees to the individuals of the training datasets used. However, using…

Machine Learning · Computer Science 2021-06-03 Osvald Frisk , Friedrich Dörmann , Christian Marius Lillelund , Christian Fischer Pedersen