English
Related papers

Related papers: Score Attack: A Lower Bound Technique for Optimal …

200 papers

Local differential privacy (LDP) is a model where users send privatized data to an untrusted central server whose goal it to solve some data analysis task. In the non-interactive version of this model the protocol consists of a single round…

Machine Learning · Computer Science 2020-09-24 Yuval Dagan , Vitaly Feldman

We study the task of training regression models with the guarantee of label differential privacy (DP). Based on a global prior distribution on label values, which could be obtained privately, we derive a label DP randomization mechanism…

Machine Learning · Computer Science 2023-10-06 Badih Ghazi , Pritish Kamath , Ravi Kumar , Ethan Leeman , Pasin Manurangsi , Avinash V Varadarajan , Chiyuan Zhang

Protecting individual privacy is crucial when releasing sensitive data for public use. While data de-identification helps, it is not enough. This paper addresses parameter estimation in scenarios where data are perturbed using the…

Methodology · Statistics 2024-03-13 Qinglong Tian , Jiwei Zhao

Prior work on differential privacy analysis of randomized SGD algorithms relies on composition theorems, where the implicit (unrealistic) assumption is that the internal state of the iterative algorithm is revealed to the adversary. As a…

Machine Learning · Statistics 2022-10-18 Jiayuan Ye , Reza Shokri

Constructing a differentially private (DP) estimator requires deriving the maximum influence of an observation, which can be difficult in the absence of exogenous bounds on the input data or the estimator, especially in high dimensional…

Machine Learning · Statistics 2022-07-27 Ryan Cumings-Menon

Decision trees are interpretable models that are well-suited to non-linear learning problems. Much work has been done on extending decision tree learning algorithms with differential privacy, a system that guarantees the privacy of samples…

Machine Learning · Computer Science 2023-10-13 Daniël Vos , Jelle Vos , Tianyu Li , Zekeriya Erkin , Sicco Verwer

Differential Privacy (DP) is the de facto standard for reasoning about the privacy guarantees of a training algorithm. Despite the empirical observation that DP reduces the vulnerability of models to existing membership inference (MI)…

Machine Learning · Computer Science 2022-12-20 Anvith Thudi , Ilia Shumailov , Franziska Boenisch , Nicolas Papernot

To protect user privacy in data analysis, a state-of-the-art strategy is differential privacy in which scientific noise is injected into the real analysis output. The noise masks individual's sensitive information contained in the dataset.…

Cryptography and Security · Computer Science 2018-06-20 Xuan-Son Vu , Lili Jiang

Differential privacy is a modern approach in privacy-preserving data analysis to control the amount of information that can be inferred about an individual by querying a database. The most common techniques are based on the introduction of…

Cryptography and Security · Computer Science 2012-07-05 Catuscia Palamidessi , Marco Stronati

The Shapley value has been proposed as a solution to many applications in machine learning, including for equitable valuation of data. Shapley values are computationally expensive and involve the entire dataset. The query for a point's…

Machine Learning · Computer Science 2022-06-02 Lauren Watson , Rayna Andreeva , Hao-Tsung Yang , Rik Sarkar

The sparse vector technique is a powerful differentially private primitive that allows an analyst to check whether queries in a stream are greater or lesser than a threshold. This technique has a unique property -- the algorithm works by…

Databases · Computer Science 2015-08-31 Yan Chen , Ashwin Machanavajjhala

We study differentially private (DP) algorithms for smooth stochastic minimax optimization, with stochastic minimization as a byproduct. The holy grail of these settings is to guarantee the optimal trade-off between the privacy and the…

Machine Learning · Computer Science 2022-10-20 Liang Zhang , Kiran Koshy Thekumparampil , Sewoong Oh , Niao He

We consider differentially private range queries on a graph where query ranges are defined as the set of edges on a shortest path of the graph. Edges in the graph carry sensitive attributes and the goal is to report the sum of these…

Data Structures and Algorithms · Computer Science 2023-03-03 Chengyuan Deng , Jie Gao , Jalaj Upadhyay , Chen Wang

This paper considers privacy-concerned distributed constraint-coupled resource allocation problems over an undirected network, where each agent holds a private cost function and obtains the solution via only local communication. With…

Optimization and Control · Mathematics 2025-06-05 Wenwen Wu , Shanying Zhu , Shuai Liu , Xinping Guan

We develop data processing inequalities that describe how Fisher information from statistical samples can scale with the privacy parameter $\varepsilon$ under local differential privacy constraints. These bounds are valid under general…

Information Theory · Computer Science 2020-05-22 Leighton Pate Barnes , Wei-Ning Chen , Ayfer Ozgur

Differential privacy (DP) has become an essential framework for privacy-preserving machine learning. Existing DP learning methods, however, often have disparate impacts on model predictions, e.g., for minority groups. Gradient clipping,…

Machine Learning · Computer Science 2025-06-03 Linzh Zhao , Aki Rehn , Mikko A. Heikkilä , Razane Tajeddine , Antti Honkela

Differential privacy (DP) is by far the most widely accepted framework for mitigating privacy risks in machine learning. However, exactly how small the privacy parameter $\epsilon$ needs to be to protect against certain privacy risks in…

Machine Learning · Computer Science 2023-08-11 Chuan Guo , Alexandre Sablayrolles , Maziar Sanjabi

We present a data analytics system that ensures accurate counts can be released with differential privacy and minimal onboarding effort while showing instances that outperform other approaches that require more onboarding effort. The…

Cryptography and Security · Computer Science 2024-03-11 Ryan Rogers

Deep learning models are known to put the privacy of their training data at risk, which poses challenges for their safe and ethical release to the public. Differentially private stochastic gradient descent is the de facto standard for…

Machine Learning · Computer Science 2023-01-03 Morgane Ayle , Jan Schuchardt , Lukas Gosch , Daniel Zügner , Stephan Günnemann

We study the computational cost of differential privacy in terms of memory efficiency. While the trade-off between accuracy and differential privacy is well-understood, the inherent cost of privacy regarding memory use remains largely…

Cryptography and Security · Computer Science 2026-02-13 Alessandro Epasto , Xin Lyu , Pasin Manurangsi