English
Related papers

Related papers: The Saddle-Point Accountant for Differential Priva…

200 papers

Many applications of machine learning, for example in health care, would benefit from methods that can guarantee privacy of data subjects. Differential privacy (DP) has become established as a standard for protecting learning results. The…

Machine Learning · Statistics 2017-05-30 Mikko Heikkilä , Eemil Lagerspetz , Samuel Kaski , Kana Shimizu , Sasu Tarkoma , Antti Honkela

Prior work on differential privacy analysis of randomized SGD algorithms relies on composition theorems, where the implicit (unrealistic) assumption is that the internal state of the iterative algorithm is revealed to the adversary. As a…

Machine Learning · Statistics 2022-10-18 Jiayuan Ye , Reza Shokri

Differentially private stochastic gradient descent (DP-SGD) enables private deep learning through per-example clipping and calibrated Gaussian noise, but its high-variance updates can reduce utility on challenging datasets. We propose…

Machine Learning · Computer Science 2026-05-21 Mohammad Partohaghighi , Roummel Marcia

We study the canonical statistical task of computing the principal component from $n$ i.i.d.~data in $d$ dimensions under $(\varepsilon,\delta)$-differential privacy. Although extensively studied in literature, existing solutions fall short…

Machine Learning · Computer Science 2022-05-30 Xiyang Liu , Weihao Kong , Prateek Jain , Sewoong Oh

Differential privacy is a rigorous privacy condition achieved by randomizing query answers. This paper develops efficient algorithms for answering multiple queries under differential privacy with low error. We pursue this goal by advancing…

Databases · Computer Science 2011-03-08 Chao Li , Gerome Miklau

The emerging technologies for large scale data analysis raise new challenges to the security and privacy of sensitive user data. In this work we investigate the problem of private statistical analysis of time-series data in the distributed…

Cryptography and Security · Computer Science 2017-12-05 Filipp Valovich , Francesco Aldà

The integration of Differential Privacy (DP) with diffusion models (DMs) presents a promising yet challenging frontier, particularly due to the substantial memorization capabilities of DMs that pose significant privacy risks. Differential…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Yu-Lin Tsai , Yizhe Li , Zekai Chen , Po-Yu Chen , Chia-Mu Yu , Xuebin Ren , Francois Buet-Golfouse

The shuffle model of Differential Privacy (DP) has gained significant attention in privacy-preserving data analysis due to its remarkable tradeoff between privacy and utility. It is characterized by adding a shuffling procedure after each…

Combinatorics · Mathematics 2024-01-10 E Chen , Yang Cao , Yifei Ge

Differential privacy is a mathematical framework for privacy-preserving data analysis. Changing the hyperparameters of a differentially private algorithm allows one to trade off privacy and utility in a principled way. Quantifying this…

Machine Learning · Statistics 2020-07-23 Brendan Avent , Javier Gonzalez , Tom Diethe , Andrei Paleyes , Borja Balle

Many existing mechanisms for achieving differential privacy (DP) on infinite-dimensional functional summaries typically involve embedding these functional summaries into finite-dimensional subspaces and applying traditional multivariate DP…

Machine Learning · Statistics 2026-04-02 Haotian Lin , Matthew Reimherr

Differential privacy is a mathematical concept that provides an information-theoretic security guarantee. While differential privacy has emerged as a de facto standard for guaranteeing privacy in data sharing, the known mechanisms to…

Cryptography and Security · Computer Science 2024-03-26 March Boedihardjo , Thomas Strohmer , Roman Vershynin

The change-point detection problem seeks to identify distributional changes at an unknown change-point k* in a stream of data. This problem appears in many important practical settings involving personal data, including biosurveillance,…

Statistics Theory · Mathematics 2019-09-10 Rachel Cummings , Sara Krehbiel , Yajun Mei , Rui Tuo , Wanrong Zhang

Sequential change detection is a fundamental problem in statistics and signal processing, with the CUSUM procedure widely used to achieve minimax detection delay under a prescribed false-alarm rate when pre- and post-change distributions…

Statistics Theory · Mathematics 2026-01-16 Liyan Xie , Ruizhi Zhang

Data privacy is a core tenet of responsible computing, and in the United States, differential privacy (DP) is the dominant technical operationalization of privacy-preserving data analysis. With this study, we qualitatively examine one class…

Human-Computer Interaction · Computer Science 2024-12-18 Lucas Rosenblatt , Bill Howe , Julia Stoyanovich

Differential Privacy (DP) was originally developed to protect privacy. However, it has recently been utilized to secure machine learning (ML) models from poisoning attacks, with DP-SGD receiving substantial attention. Nevertheless, a…

Cryptography and Security · Computer Science 2023-11-13 Fereshteh Razmi , Jian Lou , Li Xiong

Privacy-preserving distributed average consensus has received significant attention recently due to its wide applicability. Based on the achieved performances, existing approaches can be broadly classified into perfect accuracy-prioritized…

Cryptography and Security · Computer Science 2024-07-16 Qiongxiu Li , Jaron Skovsted Gundersen , Milan Lopuhaa-Zwakenberg , Richard Heusdens

Shuffler-based differential privacy (shuffle-DP) is a privacy paradigm providing high utility by involving a shuffler to permute noisy report from users. Existing shuffle-DP protocols mainly focus on the design of shuffler-based categorical…

Cryptography and Security · Computer Science 2026-03-06 Xiaoguang Li , Hanyi Wang , Yaowei Huang , Jungang Yang , Qingqing Ye , Haonan Yan , Ke Pan , Zhe Sun , Hui Li

In the arena of privacy-preserving machine learning, differentially private stochastic gradient descent (DP-SGD) has outstripped the objective perturbation mechanism in popularity and interest. Though unrivaled in versatility, DP-SGD…

Machine Learning · Computer Science 2024-01-02 Rachel Redberg , Antti Koskela , Yu-Xiang Wang

This paper introduces a novel theoretical framework for auditing differential privacy (DP) in a black-box setting. Leveraging the concept of $f$-differential privacy, we explicitly define type I and type II errors and propose an auditing…

Methodology · Statistics 2025-04-14 Kaining Shi , Cong Ma

The randomized power method has gained significant interest due to its simplicity and efficient handling of large-scale spectral analysis and recommendation tasks. However, its application to large datasets containing personal information…

Machine Learning · Computer Science 2025-06-13 Julien Nicolas , César Sabater , Mohamed Maouche , Sonia Ben Mokhtar , Mark Coates