English
Related papers

Related papers: Privacy Amplification by Subsampling: Tight Analys…

200 papers

Sensitive statistics are often collected across sets of users, with repeated collection of reports done over time. For example, trends in users' private preferences or software usage may be monitored via such reports. We study the…

Machine Learning · Computer Science 2020-07-28 Úlfar Erlingsson , Vitaly Feldman , Ilya Mironov , Ananth Raghunathan , Kunal Talwar , Abhradeep Thakurta

Differential privacy guarantees allow the results of a statistical analysis involving sensitive data to be released without compromising the privacy of any individual taking part. Achieving such guarantees generally requires the injection…

Machine Learning · Statistics 2023-10-31 Jack Jewson , Sahra Ghalebikesabi , Chris Holmes

Privacy preservation is a fundamental requirement in many high-stakes domains such as medicine and finance, where sensitive personal data must be analyzed without compromising individual confidentiality. At the same time, these applications…

Machine Learning · Statistics 2026-02-05 Simon Roburin , Rafaël Pinot , Erwan Scornet

In a world where artificial intelligence and data science become omnipresent, data sharing is increasingly locking horns with data-privacy concerns. Differential privacy has emerged as a rigorous framework for protecting individual privacy…

Cryptography and Security · Computer Science 2022-06-06 March Boedihardjo , Thomas Strohmer , Roman Vershynin

The randomized power method has gained significant interest due to its simplicity and efficient handling of large-scale spectral analysis and recommendation tasks. However, its application to large datasets containing personal information…

Machine Learning · Computer Science 2025-06-13 Julien Nicolas , César Sabater , Mohamed Maouche , Sonia Ben Mokhtar , Mark Coates

Many machine learning applications are based on data collected from people, such as their tastes and behaviour as well as biological traits and genetic data. Regardless of how important the application might be, one has to make sure…

Machine Learning · Statistics 2017-04-11 Joonas Jälkö , Onur Dikmen , Antti Honkela

We study how inherent randomness in the training process -- where each sample (or client in federated learning) contributes only to a randomly selected portion of training -- can be leveraged for privacy amplification. This includes (1)…

Machine Learning · Computer Science 2025-06-03 Andy Dong , Wei-Ning Chen , Ayfer Ozgur

Personalized privacy becomes critical in deep learning for Trustworthy AI. While Differentially Private Stochastic Gradient Descent (DP-SGD) is widely used in deep learning methods supporting privacy, it provides the same level of privacy…

Machine Learning · Computer Science 2023-05-25 Geon Heo , Junseok Seo , Steven Euijong Whang

Noisy gradient descent and its variants are the predominant algorithms for differentially private machine learning. It is a fundamental question to quantify their privacy leakage, yet tight characterizations remain open even in the…

Machine Learning · Computer Science 2024-06-13 Jinho Bok , Weijie Su , Jason M. Altschuler

The shuffle model of differential privacy provides promising privacy-utility balances in decentralized, privacy-preserving data analysis. However, the current analyses of privacy amplification via shuffling lack both tightness and…

Cryptography and Security · Computer Science 2024-07-30 Shaowei Wang , Yun Peng , Jin Li , Zikai Wen , Zhipeng Li , Shiyu Yu , Di Wang , Wei Yang

Differentially Private Stochastic Gradient Descent (DP-SGD) forms a fundamental building block in many applications for learning over sensitive data. Two standard approaches, privacy amplification by subsampling, and privacy amplification…

Machine Learning · Computer Science 2020-07-31 Borja Balle , Peter Kairouz , H. Brendan McMahan , Om Thakkar , Abhradeep Thakurta

This paper aims at answering the following two questions in privacy-preserving data analysis and publishing: What formal privacy guarantee (if any) does $k$-anonymization provide? How to benefit from the adversary's uncertainty about the…

Cryptography and Security · Computer Science 2015-03-17 Ninghui Li , Wahbeh Qardaji , Dong Su

The shuffle model of Differential Privacy (DP) has gained significant attention in privacy-preserving data analysis due to its remarkable tradeoff between privacy and utility. It is characterized by adding a shuffling procedure after each…

Combinatorics · Mathematics 2024-01-10 E Chen , Yang Cao , Yifei Ge

In statistical disclosure control, the goal of data analysis is twofold: The released information must provide accurate and useful statistics about the underlying population of interest, while minimizing the potential for an individual…

Methodology · Statistics 2016-07-15 Jing Lei , Anne-Sophie Charest , Aleksandra Slavkovic , Adam Smith , Stephen Fienberg

We investigate the framework of privacy amplification by iteration, recently proposed by Feldman et al., from an information-theoretic lens. We demonstrate that differential privacy guarantees of iterative mappings can be determined by a…

Information Theory · Computer Science 2020-01-22 Shahab Asoodeh , Mario Diaz , Flavio P. Calmon

Many algorithms have been developed to estimate probability distributions subject to differential privacy (DP): such an algorithm takes as input independent samples from a distribution and estimates the density function in a way that is…

Cryptography and Security · Computer Science 2024-12-17 Albert Cheu , Debanuj Nayak

The shuffle model of Differential Privacy (DP) is an enhanced privacy protocol which introduces an intermediate trusted server between local users and a central data curator. It significantly amplifies the central DP guarantee by…

Cryptography and Security · Computer Science 2024-07-26 Yixuan Liu , Yuhan Liu , Li Xiong , Yujie Gu , Hong Chen

We consider a problem where mutually untrusting curators possess portions of a vertically partitioned database containing information about a set of individuals. The goal is to enable an authorized party to obtain aggregate (statistical)…

Cryptography and Security · Computer Science 2013-04-18 Bing-Rong Lin , Ye Wang , Shantanu Rane

Differential privacy (DP) is a widely-accepted and widely-applied notion of privacy based on worst-case analysis. Often, DP classifies most mechanisms without additive noise as non-private (Dwork et al., 2014). Thus, additive noises are…

Cryptography and Security · Computer Science 2023-12-14 Ao Liu , Yu-Xiang Wang , Lirong Xia

Auditing mechanisms for differential privacy use probabilistic means to empirically estimate the privacy level of an algorithm. For private machine learning, existing auditing mechanisms are tight: the empirical privacy estimate (nearly)…