English
Related papers

Related papers: Directional Privacy for Deep Learning

200 papers

Neural machine translation (NMT) is a widely popular text generation task, yet there is a considerable research gap in the development of privacy-preserving NMT models, despite significant data privacy concerns for NMT systems.…

Computation and Language · Computer Science 2024-04-25 Timour Igamberdiev , Doan Nam Long Vu , Felix Künnecke , Zhuo Yu , Jannik Holmer , Ivan Habernal

Differential privacy is a useful tool to build machine learning models which do not release too much information about the training data. We study the R\'enyi differential privacy of stochastic gradient descent when each training example is…

Machine Learning · Computer Science 2020-02-18 Eloïse Berthier , Sai Praneeth Karimireddy

Differentially private stochastic gradient descent (DP-SGD) has been instrumental in privately training deep learning models by providing a framework to control and track the privacy loss incurred during training. At the core of this…

Machine Learning · Computer Science 2024-08-21 Jeremiah Birrell , Reza Ebrahimi , Rouzbeh Behnia , Jason Pacheco

We propose a novel and practical privacy notion called $f$-Membership Inference Privacy ($f$-MIP), which explicitly considers the capabilities of realistic adversaries under the membership inference attack threat model. Consequently,…

Machine Learning · Computer Science 2023-10-27 Tobias Leemann , Martin Pawelczyk , Gjergji Kasneci

Differential privacy (DP) provides robust privacy guarantees for statistical inference, but this can lead to unreliable results and biases in downstream applications. While several noise-aware approaches have been proposed which integrate…

Machine Learning · Statistics 2026-05-29 Talal Alrawajfeh , Joonas Jälkö , Antti Honkela

Differentially private SGD (DP-SGD) is one of the most popular methods for solving differentially private empirical risk minimization (ERM). Due to its noisy perturbation on each gradient update, the error rate of DP-SGD scales with the…

Machine Learning · Computer Science 2021-04-27 Yingxue Zhou , Zhiwei Steven Wu , Arindam Banerjee

Differential Privacy (DP) has emerged as a key framework for protecting sensitive data in machine learning, but standard DP-SGD often suffers from significant accuracy loss due to injected noise. To address this limitation, we introduce the…

Machine Learning · Computer Science 2025-09-16 Hyeju Shin , Vincent-Daniel , Kyudan Jung , Seongwon Yun

Protecting privacy in learning while maintaining the model performance has become increasingly critical in many applications that involve sensitive data. Private Gradient Descent (PGD) is a commonly used private learning framework, which…

Machine Learning · Computer Science 2022-10-20 Junyuan Hong , Zhangyang Wang , Jiayu Zhou

Privacy is a growing concern in modern deep-learning systems and applications. Differentially private (DP) training prevents the leakage of sensitive information in the collected training data from the trained machine learning models. DP…

Machine Learning · Computer Science 2024-08-28 Xinwei Zhang , Zhiqi Bu , Mingyi Hong , Meisam Razaviyayn

In this work, we introduce a differentially private method for generating synthetic data from vertically partitioned data, \emph{i.e.}, where data of the same individuals is distributed across multiple data holders or parties. We present a…

Machine Learning · Computer Science 2022-09-05 Razane Tajeddine , Joonas Jälkö , Samuel Kaski , Antti Honkela

By ensuring differential privacy in the learning algorithms, one can rigorously mitigate the risk of large models memorizing sensitive training data. In this paper, we study two algorithms for this purpose, i.e., DP-SGD and DP-NSGD, which…

Machine Learning · Computer Science 2022-06-28 Xiaodong Yang , Huishuai Zhang , Wei Chen , Tie-Yan Liu

For gradient-based machine learning (ML) methods commonly adopted in practice such as stochastic gradient descent, the de facto differential privacy (DP) technique is perturbing the gradients with random Gaussian noise. Data valuation…

Machine Learning · Computer Science 2024-12-24 Zijian Zhou , Xinyi Xu , Daniela Rus , Bryan Kian Hsiang Low

Federated learning aims to protect data privacy by collaboratively learning a model without sharing private data among users. However, an adversary may still be able to infer the private training data by attacking the released model.…

Machine Learning · Computer Science 2021-09-13 Zhicong Liang , Bao Wang , Quanquan Gu , Stanley Osher , Yuan Yao

Differentially private (DP) training preserves the data privacy usually at the cost of slower convergence (and thus lower accuracy), as well as more severe mis-calibration than its non-private counterpart. To analyze the convergence of DP…

Machine Learning · Computer Science 2023-06-21 Zhiqi Bu , Hua Wang , Zongyu Dai , Qi Long

To protect sensitive data in training a Generative Adversarial Network (GAN), the standard approach is to use differentially private (DP) stochastic gradient descent method in which controlled noise is added to the gradients. The quality of…

Machine Learning · Computer Science 2022-10-28 Dongjie Chen , Sen-ching Samson Cheung , Chen-Nee Chuah , Sally Ozonoff

Graph Neural Networks (GNNs) have established themselves as the state-of-the-art models for many machine learning applications such as the analysis of social networks, protein interactions and molecules. Several among these datasets contain…

We study Gaussian mechanism in the shuffle model of differential privacy (DP). Particularly, we characterize the mechanism's R\'enyi differential privacy (RDP), showing that it is of the form: $$ \epsilon(\lambda) \leq…

Cryptography and Security · Computer Science 2023-07-05 Seng Pei Liew , Tsubasa Takahashi

In this paper, we propose a novel Heterogeneous Gaussian Mechanism (HGM) to preserve differential privacy in deep neural networks, with provable robustness against adversarial examples. We first relax the constraint of the privacy budget in…

Cryptography and Security · Computer Science 2019-06-05 NhatHai Phan , Minh Vu , Yang Liu , Ruoming Jin , Dejing Dou , Xintao Wu , My T. Thai

Publishing open graph data while preserving individual privacy remains challenging when data publishers and data users are distinct entities. Although differential privacy (DP) provides rigorous guarantees, most existing approaches enforce…

Machine Learning · Computer Science 2026-03-25 Muhao Guo , Jiaqi Wu , Yizheng Liao , Wenke Lee , Shengzhe Chen , Yang Weng

The Differentially Private Stochastic Gradient Descent (DP-SGD) algorithm supports the training of machine learning (ML) models with formal Differential Privacy (DP) guarantees. Traditionally, DP-SGD processes training data in batches using…

Cryptography and Security · Computer Science 2025-12-15 Meenatchi Sundaram Muthu Selva Annamalai , Borja Balle , Jamie Hayes , Emiliano De Cristofaro