English
Related papers

Related papers: Assessing Differentially Private Variational Autoe…

200 papers

Federated learning (FL) aims to collaboratively train the global model in a distributed manner by sharing the model parameters from local clients to a central server, thereby potentially protecting users' private information. Nevertheless,…

Machine Learning · Computer Science 2023-02-17 Zhe Li , Honglong Chen , Zhichen Ni , Huajie Shao

We investigate how to optimally design local differential privacy (LDP) mechanisms that reduce data unfairness and thereby improve fairness in downstream classification. We first derive a closed-form optimal mechanism for binary sensitive…

Machine Learning · Computer Science 2026-02-02 Hrad Ghoukasian , Shahab Asoodeh

Differentially private (DP) mechanisms are difficult to interpret and calibrate because existing methods for mapping standard privacy parameters to concrete privacy risks -- re-identification, attribute inference, and data reconstruction --…

Constructing a differentially private (DP) estimator requires deriving the maximum influence of an observation, which can be difficult in the absence of exogenous bounds on the input data or the estimator, especially in high dimensional…

Machine Learning · Statistics 2022-07-27 Ryan Cumings-Menon

Motivated by the increasing deployment of reinforcement learning in the real world, involving a large consumption of personal data, we introduce a differentially private (DP) policy gradient algorithm. We show that, in this setting, the…

Machine Learning · Computer Science 2025-02-03 Alexandre Rio , Merwan Barlier , Igor Colin

Recent research has shown that structured machine learning models such as tree ensembles are vulnerable to privacy attacks targeting their training data. To mitigate these risks, differential privacy (DP) has become a widely adopted…

Machine Learning · Computer Science 2026-01-07 Alice Gorgé , Julien Ferry , Sébastien Gambs , Thibaut Vidal

How to properly set the privacy parameter in differential privacy (DP) has been an open question in DP research since it was first proposed in 2006. In this work, we demonstrate the ability of influence functions to offer insight into how a…

Machine Learning · Computer Science 2023-09-19 Alycia N. Carey , Minh-Hao Van , Xintao Wu

Differentially private stochastic gradient descent (DP-SGD) is the canonical approach to private deep learning. While the current privacy analysis of DP-SGD is known to be tight in some settings, several empirical results suggest that…

Machine Learning · Computer Science 2024-07-17 Anvith Thudi , Hengrui Jia , Casey Meehan , Ilia Shumailov , Nicolas Papernot

This work investigates a privacy metric based on Chernoff information motivated by its importance in characterizing the optimal classifier's performance. Adversarial classification centers on minimizing the probability of error when…

Information Theory · Computer Science 2026-05-21 Ayşe Ünsal

In modern settings of data analysis, we may be running our algorithms on datasets that are sensitive in nature. However, classical machine learning and statistical algorithms were not designed with these risks in mind, and it has been…

Data Structures and Algorithms · Computer Science 2021-08-21 Huanyu Zhang

This work studies anomaly detection under differential privacy (DP) with Gaussian perturbation using both statistical and information-theoretic tools. In our setting, the adversary aims to modify the content of a statistical dataset by…

Information Theory · Computer Science 2022-08-23 Ayse Unsal , Melek Onen

Differential privacy (DP) is a mathematical privacy notion increasingly deployed across government and industry. With DP, privacy protections are probabilistic: they are bounded by the privacy budget parameter, $\epsilon$. Prior work in…

Cryptography and Security · Computer Science 2023-03-02 Priyanka Nanayakkara , Mary Anne Smart , Rachel Cummings , Gabriel Kaptchuk , Elissa Redmiles

Differential privacy is known to protect against threats to validity incurred due to adaptive, or exploratory, data analysis -- even when the analyst adversarially searches for a statistical estimate that diverges from the true value of the…

Cryptography and Security · Computer Science 2022-07-25 Elbert Du , Cynthia Dwork

Practitioners commonly download pretrained machine learning models from open repositories and finetune them to fit specific applications. We show that this practice introduces a new risk of privacy backdoors. By tampering with a pretrained…

Cryptography and Security · Computer Science 2024-04-02 Shanglun Feng , Florian Tramèr

The application of Differential Privacy to Natural Language Processing techniques has emerged in relevance in recent years, with an increasing number of studies published in established NLP outlets. In particular, the adaptation of…

Computation and Language · Computer Science 2024-04-05 Stephen Meisenbacher , Nihildev Nandakumar , Alexandra Klymenko , Florian Matthes

Privacy risks in differentially private (DP) systems increase significantly when data is correlated, as standard DP metrics often underestimate the resulting privacy leakage, leaving sensitive information vulnerable. Given the ubiquity of…

Cryptography and Security · Computer Science 2025-07-16 Martin Lange , Patricia Guerra-Balboa , Javier Parra-Arnau , Thorsten Strufe

Differential privacy (DP) allows data analysts to query databases that contain users' sensitive information while providing a quantifiable privacy guarantee to users. Recent interactive DP systems such as APEx provide accuracy guarantees…

Cryptography and Security · Computer Science 2022-11-30 Miti Mazmudar , Thomas Humphries , Jiaxiang Liu , Matthew Rafuse , Xi He

Data privacy is an important concern in machine learning, and is fundamentally at odds with the task of training useful learning models, which typically require the acquisition of large amounts of private user data. One possible way of…

Machine Learning · Computer Science 2019-02-14 Mehrdad Showkatbakhsh , Can Karakus , Suhas Diggavi

We investigate whether Differentially Private SGD offers better privacy in practice than what is guaranteed by its state-of-the-art analysis. We do so via novel data poisoning attacks, which we show correspond to realistic privacy attacks.…

Cryptography and Security · Computer Science 2020-06-16 Matthew Jagielski , Jonathan Ullman , Alina Oprea

As data-driven technologies advance swiftly, maintaining strong privacy measures becomes progressively difficult. Conventional $(\epsilon, \delta)$-differential privacy, while prevalent, exhibits limited adaptability for many applications.…

Cryptography and Security · Computer Science 2025-07-03 Yifeng Liu , Zehua Wang