English
Related papers

Related papers: Sampling-Free Privacy Accounting for Matrix Mechan…

200 papers

The design of a statistical signal processing privacy problem is studied where the private data is assumed to be observable. In this work, an agent observes useful data $Y$, which is correlated with private data $X$, and wants to disclose…

Information Theory · Computer Science 2023-09-19 Amirreza Zamani , Tobias J. Oechtering , Mikael Skoglund

In this brief, we present an enhanced privacy-preserving distributed estimation algorithm, referred to as the ``Double-Private Algorithm," which combines the principles of both differential privacy (DP) and cryptography. The proposed…

Signal Processing · Electrical Eng. & Systems 2024-03-19 Mehdi Korki , Fatemehsadat Hosseiniamin , Hadi Zayyani , Mehdi Bekrani

Pairwise learning focuses on learning tasks with pairwise loss functions, depends on pairs of training instances, and naturally fits for modeling relationships between pairs of samples. In this paper, we focus on the privacy of pairwise…

Machine Learning · Computer Science 2021-06-02 Yilin Kang , Yong Liu , Jian Li , Weiping Wang

Differential privacy is known to protect against threats to validity incurred due to adaptive, or exploratory, data analysis -- even when the analyst adversarially searches for a statistical estimate that diverges from the true value of the…

Cryptography and Security · Computer Science 2022-07-25 Elbert Du , Cynthia Dwork

Achieving optimal statistical performance while ensuring the privacy of personal data is a challenging yet crucial objective in modern data analysis. However, characterizing the optimality, particularly the minimax lower bound, under…

Statistics Theory · Mathematics 2025-07-15 T. Tony Cai , Yichen Wang , Linjun Zhang

We study black-box auditing for machine learning algorithms that claim R \ 'enyi differential privacy (RDP) guarantees. We introduce an auditing framework, based on hypothesis testing, that directly estimates R\'enyi divergence between…

Machine Learning · Computer Science 2026-05-22 Benjamin D. Kim , Lav R. Varshney , Daniel Alabi

Training differentially private machine learning models requires constraining an individual's contribution to the optimization process. This is achieved by clipping the $2$-norm of their gradient at a predetermined threshold prior to…

Machine Learning · Computer Science 2024-01-09 Filippo Galli , Catuscia Palamidessi , Tommaso Cucinotta

Linear regression is a fundamental tool for statistical analysis. This has motivated the development of linear regression methods that also satisfy differential privacy and thus guarantee that the learned model reveals little about any one…

Machine Learning · Computer Science 2023-03-20 Kareem Amin , Matthew Joseph , Mónica Ribero , Sergei Vassilvitskii

The shuffle model of local differential privacy is an advanced method of privacy amplification designed to enhance privacy protection with high utility. It achieves this by randomly shuffling sensitive data, making linking individual data…

Cryptography and Security · Computer Science 2024-03-04 E Chen , Yang Cao , Yifei Ge

Differential privacy (DP) is a rigorous notion of data privacy, used for private statistics. The canonical algorithm for differentially private mean estimation is to first clip the samples to a bounded range and then add noise to their…

Statistics Theory · Mathematics 2024-10-10 Gautam Kamath , Argyris Mouzakis , Matthew Regehr , Vikrant Singhal , Thomas Steinke , Jonathan Ullman

Differential privacy (DP) is the state-of-the-art framework for guaranteeing privacy for individuals when releasing aggregated statistics or building statistical/machine learning models from data. We develop the open-source R package DPpack…

Machine Learning · Statistics 2023-09-21 Spencer Giddens , Fang Liu

Differential privacy has become a widely accepted notion of privacy, leading to the introduction and deployment of numerous privatization mechanisms. However, ensuring the privacy guarantee is an error-prone process, both in designing…

Information Theory · Computer Science 2019-05-27 Xiyang Liu , Sewoong Oh

Building a recommendation system involves analyzing user data, which can potentially leak sensitive information about users. Anonymizing user data is often not sufficient for preserving user privacy. Motivated by this, we propose a…

Information Retrieval · Computer Science 2023-04-19 Sohan Salahuddin Mugdho , Hafiz Imtiaz

Differential privacy (DP) is a privacy-preserving paradigm that protects the training data when training deep learning models. Critically, the performance of models is determined by the training hyperparameters, especially those of the…

Machine Learning · Computer Science 2025-03-04 Zhiqi Bu , Ruixuan Liu

In this paper, we develop compositional methods for formally verifying differential privacy for algorithms whose analysis goes beyond the composition theorem. Our methods are based on the observation that differential privacy has deep…

Logic in Computer Science · Computer Science 2021-03-16 Gilles Barthe , Marco Gaboardi , Benjamin Grégoire , Justin Hsu , Pierre-Yves Strub

Given a trained model and a data sample, membership-inference (MI) attacks predict whether the sample was in the model's training set. A common countermeasure against MI attacks is to utilize differential privacy (DP) during model training…

Cryptography and Security · Computer Science 2022-04-14 Saeed Mahloujifar , Alexandre Sablayrolles , Graham Cormode , Somesh Jha

While pursuing better utility by discovering knowledge from the data, individual's privacy may be compromised during an analysis. To that end, differential privacy has been widely recognized as the state-of-the-art privacy notion. By…

Cryptography and Security · Computer Science 2022-09-07 Meisam Mohammady

Black-box machine learning models are used in critical decision-making domains, giving rise to several calls for more algorithmic transparency. The drawback is that model explanations can leak information about the training data and the…

Machine Learning · Computer Science 2020-06-17 Neel Patel , Reza Shokri , Yair Zick

Differential Privacy (DP) is the leading approach to privacy preserving deep learning. As such, there are multiple efforts to provide drop-in integration of DP into popular frameworks. These efforts, which add noise to each gradient…

Machine Learning · Statistics 2021-06-08 Mathias Lécuyer

Poisson subsampling is the default sampling scheme in differentially private machine learning, largely because its unstructured randomness yields tractable privacy amplification analyses. Yet this same randomness introduces substantial…

Machine Learning · Computer Science 2026-05-11 Andy Dong , Ayfer Özgür