English
Related papers

Related papers: Optimal Guarantees for Auditing R\'enyi Differenti…

200 papers

Differential privacy (DP) is a widely-accepted and widely-applied notion of privacy based on worst-case analysis. Often, DP classifies most mechanisms without additive noise as non-private (Dwork et al., 2014). Thus, additive noises are…

Cryptography and Security · Computer Science 2023-12-14 Ao Liu , Yu-Xiang Wang , Lirong Xia

We present a rigorous methodology for auditing differentially private machine learning algorithms by adding multiple carefully designed examples called canaries. We take a first principles approach based on three key components. First, we…

Machine Learning · Computer Science 2023-05-31 Krishna Pillutla , Galen Andrew , Peter Kairouz , H. Brendan McMahan , Alina Oprea , Sewoong Oh

In this work, we give efficient algorithms for privately estimating a Gaussian distribution in both pure and approximate differential privacy (DP) models with optimal dependence on the dimension in the sample complexity. In the pure DP…

Data Structures and Algorithms · Computer Science 2023-06-02 Daniel Alabi , Pravesh K. Kothari , Pranay Tankala , Prayaag Venkat , Fred Zhang

We consider the problem of property testing for differential privacy: with black-box access to a purportedly private algorithm, can we verify its privacy guarantees? In particular, we show that any privacy guarantee that can be efficiently…

Cryptography and Security · Computer Science 2019-02-14 Anna Gilbert , Audra McMillan

Differential Privacy (DP) is a widely adopted standard for privacy-preserving data analysis, but it assumes a uniform privacy budget across all records, limiting its applicability when privacy requirements vary with data values. Per-record…

Databases · Computer Science 2025-11-25 Xinghe Chen , Dajun Sun , Quanqing Xu , Wei Dong

Estimating causal effects from randomized experiments is only possible if participants are willing to disclose their potentially sensitive responses. Differential privacy, a widely used framework for ensuring an algorithms privacy…

Machine Learning · Statistics 2025-05-29 Adel Javanmard , Vahab Mirrokni , Jean Pouget-Abadie

In privacy-preserving machine learning, individual parties are reluctant to share their sensitive training data due to privacy concerns. Even the trained model parameters or prediction can pose serious privacy leakage. To address these…

Cryptography and Security · Computer Science 2020-09-04 Lingjuan Lyu , Yee Wei Law , Kee Siong Ng , Shibei Xue , Jun Zhao , Mengmeng Yang , Lei Liu

Differential privacy (DP) is a rigorous notion of data privacy, used for private statistics. The canonical algorithm for differentially private mean estimation is to first clip the samples to a bounded range and then add noise to their…

Statistics Theory · Mathematics 2024-10-10 Gautam Kamath , Argyris Mouzakis , Matthew Regehr , Vikrant Singhal , Thomas Steinke , Jonathan Ullman

Differentially Private Stochastic Gradient Descent (DP-SGD) has been widely used for solving optimization problems with privacy guarantees in machine learning and statistics. Despite this, a systematic non-asymptotic convergence analysis…

Methodology · Statistics 2025-07-10 Enze Shi , Jinhan Xie , Bei Jiang , Linglong Kong , Xuming He

Differential Privacy (DP) provides a formal privacy guarantee preventing adversaries with access to a machine learning model from extracting information about individual training points. Differentially Private Stochastic Gradient Descent…

Machine Learning · Computer Science 2022-06-17 Soham De , Leonard Berrada , Jamie Hayes , Samuel L. Smith , Borja Balle

This paper develops a novel differentially private framework to solve convex optimization problems with sensitive optimization data and complex physical or operational constraints. Unlike standard noise-additive algorithms, that act…

Cryptography and Security · Computer Science 2020-06-23 Vladimir Dvorkin , Ferdinando Fioretto , Pascal Van Hentenryck , Jalal Kazempour , Pierre Pinson

Differential privacy (DP), provides a framework for provable privacy protection against arbitrary adversaries, while allowing the release of summary statistics and synthetic data. We address the problem of releasing a noisy real-valued…

Methodology · Statistics 2024-11-04 Jordan Awan , Aleksandra Slavkovic

In this paper, we study efficient differentially private alternating direction methods of multipliers (ADMM) via gradient perturbation for many machine learning problems. For smooth convex loss functions with (non)-smooth regularization, we…

Machine Learning · Computer Science 2020-11-03 Tao Xu , Fanhua Shang , Yuanyuan Liu , Hongying Liu , Longjie Shen , Maoguo Gong

Differential privacy (DP) is a gold-standard concept of measuring and guaranteeing privacy in data analysis. It is well-known that the cost of adding DP to deep learning model is its accuracy. However, it remains unclear how it affects…

Machine Learning · Computer Science 2021-08-26 Nurislam Tursynbek , Aleksandr Petiushko , Ivan Oseledets

(Gradient) Expectation Maximization (EM) is a widely used algorithm for estimating the maximum likelihood of mixture models or incomplete data problems. A major challenge facing this popular technique is how to effectively preserve the…

Machine Learning · Computer Science 2022-01-19 Di Wang , Jiahao Ding , Lijie Hu , Zejun Xie , Miao Pan , Jinhui Xu

We introduce a differentially private manifold denoising framework that allows users to exploit sensitive reference datasets to correct noisy, non-private query points without compromising privacy. The method follows an iterative procedure…

Machine Learning · Computer Science 2026-04-02 Jiaqi Wu , Yiqing Sun , Zhigang Yao

We study the problem of multi-agent reinforcement learning (multi-agent RL) with differential privacy (DP) constraints. This is well-motivated by various real-world applications involving sensitive data, where it is critical to protect…

Machine Learning · Computer Science 2024-04-12 Dan Qiao , Yu-Xiang Wang

In this paper, we present a framework based on differential privacy (DP) for querying electric power measurements to detect system anomalies or bad data. Our DP approach conceals consumption and system matrix data, while simultaneously…

Signal Processing · Electrical Eng. & Systems 2024-03-26 Nikhil Ravi , Anna Scaglione , Sean Peisert , Parth Pradhan

Reinforcement learning (RL) algorithms can be used to provide personalized services, which rely on users' private and sensitive data. To protect the users' privacy, privacy-preserving RL algorithms are in demand. In this paper, we study RL…

Machine Learning · Computer Science 2021-10-20 Chonghua Liao , Jiafan He , Quanquan Gu

In the literature of data privacy, differential privacy is the most popular model. An algorithm is differentially private if its outputs with and without any individual's data are indistinguishable. In this paper, we focus on data generated…

Cryptography and Security · Computer Science 2022-06-24 Darshan Chakrabarti , Jie Gao , Aditya Saraf , Grant Schoenebeck , Fang-Yi Yu