English
Related papers

Related papers: R\'enyi Differential Privacy of the Sampled Gaussi…

200 papers

Modern machine learning algorithms aim to extract fine-grained information from data to provide accurate predictions, which often conflicts with the goal of privacy protection. This paper addresses the practical and theoretical importance…

Machine Learning · Statistics 2023-07-17 Puyu Wang , Yunwen Lei , Yiming Ying , Ding-Xuan Zhou

Differential privacy (DP) has become the gold standard for preserving individual privacy in data analysis. However, an implicit yet fundamental assumption underlying these rigorous privacy guarantees is the correct implementation and…

Cryptography and Security · Computer Science 2026-03-17 Haochen Sun , Xi He

The framework of differential privacy protects an individual's privacy while publishing query responses on congregated data. In this work, a new noise addition mechanism for differential privacy is introduced where the noise added is…

Cryptography and Security · Computer Science 2023-07-06 Gokularam Muthukrishnan , Sheetal Kalyani

Gaussian process regression (GPR) is a non-parametric model that has been used in many real-world applications that involve sensitive personal data (e.g., healthcare, finance, etc.) from multiple data owners. To fully and securely exploit…

Cryptography and Security · Computer Science 2023-06-27 Jinglong Luo , Yehong Zhang , Jiaqi Zhang , Shuang Qin , Hui Wang , Yue Yu , Zenglin Xu

Amplification by subsampling is one of the main primitives in machine learning with differential privacy (DP): Training a model on random batches instead of complete datasets results in stronger privacy. This is traditionally formalized via…

Cryptography and Security · Computer Science 2024-11-04 Jan Schuchardt , Mihail Stoian , Arthur Kosmala , Stephan Günnemann

We consider the task of privately obtaining prediction error guarantees in ordinary least-squares regression problems with Gaussian covariates (with unknown covariance structure). We provide the first sample-optimal polynomial time…

Data Structures and Algorithms · Computer Science 2025-04-01 Prashanti Anderson , Ainesh Bakshi , Mahbod Majid , Stefan Tiegel

Differential privacy guarantees allow the results of a statistical analysis involving sensitive data to be released without compromising the privacy of any individual taking part. Achieving such guarantees generally requires the injection…

Machine Learning · Statistics 2023-10-31 Jack Jewson , Sahra Ghalebikesabi , Chris Holmes

Motivated by the rapid rise in statistical tools in Functional Data Analysis, we consider the Gaussian mechanism for achieving differential privacy with parameter estimates taking values in a, potentially infinite-dimensional, separable…

Statistics Theory · Mathematics 2019-01-29 Ardalan Mirshani , Matthew Reimherr , Aleksandra Slavkovic

We analyse the privacy leakage of noisy stochastic gradient descent by modeling R\'enyi divergence dynamics with Langevin diffusions. Inspired by recent work on non-stochastic algorithms, we derive similar desirable properties in the…

Machine Learning · Statistics 2022-02-08 Théo Ryffel , Francis Bach , David Pointcheval

We consider the problem of computing tight privacy guarantees for the composition of subsampled differentially private mechanisms. Recent algorithms can numerically compute the privacy parameters to arbitrary precision but must be carefully…

Cryptography and Security · Computer Science 2025-04-09 Christian Janos Lebeda , Matthew Regehr , Gautam Kamath , Thomas Steinke

We show that Gaussian Differential Privacy, a variant of differential privacy tailored to the analysis of Gaussian noise addition, composes gracefully even in the presence of a fully adaptive analyst. Such an analyst selects mechanisms (to…

Cryptography and Security · Computer Science 2022-11-01 Adam Smith , Abhradeep Thakurta

This paper develops a framework for differentially private $e$-values under Gaussian differential privacy ($\mu$-GDP). We characterize the canonical noise mechanism, establishing that optimal multiplicative perturbation follows a Gaussian…

Methodology · Statistics 2026-05-29 Qi Kuang , Bowen Gang , Yin Xia

We study how to communicate findings of Bayesian inference to third parties, while preserving the strong guarantee of differential privacy. Our main contributions are four different algorithms for private Bayesian inference on…

Artificial Intelligence · Computer Science 2015-12-23 Zuhe Zhang , Benjamin Rubinstein , Christos Dimitrakakis

We investigate unbiased high-dimensional mean estimators in differential privacy. We consider differentially private mechanisms whose expected output equals the mean of the input dataset, for every dataset drawn from a fixed bounded…

Statistics Theory · Mathematics 2023-12-22 Aleksandar Nikolov , Haohua Tang

Current practices for reporting the level of differential privacy (DP) protection for machine learning (ML) algorithms such as DP-SGD provide an incomplete and potentially misleading picture of the privacy guarantees. For instance, if only…

Machine Learning · Computer Science 2025-10-03 Juan Felipe Gomez , Bogdan Kulynych , Georgios Kaissis , Flavio P. Calmon , Jamie Hayes , Borja Balle , Antti Honkela

Building a recommendation system involves analyzing user data, which can potentially leak sensitive information about users. Anonymizing user data is often not sufficient for preserving user privacy. Motivated by this, we propose a…

Information Retrieval · Computer Science 2023-04-19 Sohan Salahuddin Mugdho , Hafiz Imtiaz

Differential privacy (DP) is becoming increasingly important for deployed machine learning applications because it provides strong guarantees for protecting the privacy of individuals whose data is used to train models. However, DP…

We propose a novel theoretical and methodological framework for Gaussian process regression subject to privacy constraints. The proposed method can be used when a data owner is unwilling to share a high-fidelity supervised learning model…

Machine Learning · Computer Science 2025-10-14 Rui Tuo , Haoyuan Chen , Raktim Bhattacharya

Differential privacy provides a rigorous framework to quantify data privacy, and has received considerable interest recently. A randomized mechanism satisfying $(\epsilon, \delta)$-differential privacy (DP) roughly means that, except with a…

Cryptography and Security · Computer Science 2019-12-10 Jun Zhao , Teng Wang , Tao Bai , Kwok-Yan Lam , Zhiying Xu , Shuyu Shi , Xuebin Ren , Xinyu Yang , Yang Liu , Han Yu

With the rapid growth of digital platforms, there is increasing apprehension about how personal data is collected, stored, and used by various entities. These concerns arise from the increasing frequency of data breaches, cyber-attacks, and…

Cryptography and Security · Computer Science 2025-04-28 Christopher C. Zawacki , Eyad H. Abed