English
Related papers

Related papers: Avoiding Pitfalls for Privacy Accounting of Subsam…

200 papers

Tuning the hyperparameters of differentially private (DP) machine learning (ML) algorithms often requires use of sensitive data and this may leak private information via hyperparameter values. Recently, Papernot and Steinke (2022) proposed…

Machine Learning · Computer Science 2024-02-14 Antti Koskela , Tejas Kulkarni

Differential privacy (DP) is a widely used notion for reasoning about privacy when publishing aggregate data. In this paper, we observe that certain DP mechanisms are amenable to a posteriori privacy analysis that exploits the fact that…

Cryptography and Security · Computer Science 2023-06-21 Valentin Hartmann , Vincent Bindschaedler , Alexander Bentkamp , Robert West

How to query a dataset in the way of preserving the privacy of individuals whose data is included in the dataset is an important problem. The information privacy model, a variant of Shannon's information theoretic model to the encryption…

Cryptography and Security · Computer Science 2021-01-06 Genqiang Wu

We initiate an investigation of private sampling from distributions. Given a dataset with $n$ independent observations from an unknown distribution $P$, a sampling algorithm must output a single observation from a distribution that is close…

Machine Learning · Computer Science 2022-11-16 Sofya Raskhodnikova , Satchit Sivakumar , Adam Smith , Marika Swanberg

We study the problem of estimating finite sample confidence intervals of the mean of a normal population under the constraint of differential privacy. We consider both the known and unknown variance cases and construct differentially…

Cryptography and Security · Computer Science 2017-11-13 Vishesh Karwa , Salil Vadhan

Differential privacy (DP) has become the gold standard for preserving individual privacy in data analysis. However, an implicit yet fundamental assumption underlying these rigorous privacy guarantees is the correct implementation and…

Cryptography and Security · Computer Science 2026-03-17 Haochen Sun , Xi He

We study the problem of top-$k$ selection over a large domain universe subject to user-level differential privacy. Typically, the exponential mechanism or report noisy max are the algorithms used to solve this problem. However, these…

Cryptography and Security · Computer Science 2019-09-19 David Durfee , Ryan Rogers

In this manuscript, we provide a set of tools (in terms of semidefinite programs) to synthesize Gaussian mechanisms to maximize privacy of databases. Information about the database is disclosed through queries requested by (potentially)…

Systems and Control · Electrical Eng. & Systems 2022-03-30 Haleh Hayati , Carlos Murguia , Nathan van de Wouw

Ensuring differential privacy of models learned from sensitive user data is an important goal that has been studied extensively in recent years. It is now known that for some basic learning problems, especially those involving…

Machine Learning · Computer Science 2018-05-10 Cynthia Dwork , Vitaly Feldman

In this note, we consider the problem of differentially privately (DP) computing an anonymized histogram, which is defined as the multiset of counts of the input dataset (without bucket labels). In the low-privacy regime $\epsilon \geq 1$,…

Data Structures and Algorithms · Computer Science 2021-11-08 Pasin Manurangsi

We consider the task of privately obtaining prediction error guarantees in ordinary least-squares regression problems with Gaussian covariates (with unknown covariance structure). We provide the first sample-optimal polynomial time…

Data Structures and Algorithms · Computer Science 2025-04-01 Prashanti Anderson , Ainesh Bakshi , Mahbod Majid , Stefan Tiegel

Differentially Private algorithms often need to select the best amongst many candidate options. Classical works on this selection problem require that the candidates' goodness, measured as a real-valued score function, does not change by…

Data Structures and Algorithms · Computer Science 2018-11-21 Jingcheng Liu , Kunal Talwar

Differential privacy is a formal mathematical {stand-ard} for quantifying the degree of that individual privacy in a statistical database is preserved. To guarantee differential privacy, a typical method is adding random noise to the…

Information Theory · Computer Science 2017-03-08 Jianping He , Lin Cai

For small privacy parameter $\epsilon$, $\epsilon$-differential privacy (DP) provides a strong worst-case guarantee that no membership inference attack (MIA) can succeed at determining whether a person's data was used to train a machine…

Cryptography and Security · Computer Science 2024-02-16 Andrew Lowy , Zhuohang Li , Jing Liu , Toshiaki Koike-Akino , Kieran Parsons , Ye Wang

Differentially private (DP) machine learning has recently become popular. The privacy loss of DP algorithms is commonly reported using $(\varepsilon,\delta)$-DP. In this paper, we propose a numerical accountant for evaluating the privacy…

Machine Learning · Statistics 2020-08-28 Antti Koskela , Joonas Jälkö , Antti Honkela

Data engineering often requires accuracy (utility) constraints on results, posing significant challenges in designing differentially private (DP) mechanisms, particularly under stringent privacy parameter $\epsilon$. In this paper, we…

Cryptography and Security · Computer Science 2024-12-17 Bo Jiang , Wanrong Zhang , Donghang Lu , Jian Du , Sagar Sharma , Qiang Yan

Popular approaches to differential privacy, such as the Laplace and exponential mechanisms, calibrate randomised smoothing through global sensitivity of the target non-private function. Bounding such sensitivity is often a prohibitively…

Machine Learning · Computer Science 2017-06-12 Benjamin I. P. Rubinstein , Francesco Aldà

In recent years, differential privacy has been adopted by tech-companies and governmental agencies as the standard for measuring privacy in algorithms. In this article, we study differential privacy in Bayesian posterior sampling settings.…

Statistics Theory · Mathematics 2026-02-13 Shenggang Hu , Louis Aslett , Hongsheng Dai , Murray Pollock , Gareth O. Roberts

Differential privacy has emerged as a promising probabilistic formulation of privacy, generating intense interest within academia and industry. We present a push-button, automated technique for verifying $\varepsilon$-differential privacy…

Programming Languages · Computer Science 2017-11-10 Aws Albarghouthi , Justin Hsu

Differentially private gradient descent (DP-GD) is a popular algorithm to train deep learning models with provable guarantees on the privacy of the training data. In the last decade, the problem of understanding its performance cost with…

Machine Learning · Statistics 2025-05-29 Simone Bombari , Marco Mondelli