English
Related papers

Related papers: Differentially Private Policy Evaluation

200 papers

Differential Privacy can provide provable privacy guarantees for training data in machine learning. However, the presence of proofs does not preclude the presence of errors. Inspired by recent advances in auditing which have been used for…

Machine Learning · Computer Science 2022-03-29 Florian Tramer , Andreas Terzis , Thomas Steinke , Shuang Song , Matthew Jagielski , Nicholas Carlini

Markov decision processes often seek to maximize a reward function, but onlookers may infer reward functions by observing the states and actions of such systems, revealing sensitive information. Therefore, in this paper we introduce and…

Systems and Control · Electrical Eng. & Systems 2024-09-04 Alexander Benvenuti , Calvin Hawkins , Brandon Fallin , Bo Chen , Brendan Bialy , Miriam Dennis , Matthew Hale

Differential privacy is becoming a gold standard for privacy research; it offers a guaranteed bound on loss of privacy due to release of query results, even under worst-case assumptions. The theory of differential privacy is an active…

Machine learning techniques based on neural networks are achieving remarkable results in a wide variety of domains. Often, the training of models requires large, representative datasets, which may be crowdsourced and contain sensitive…

Machine Learning · Statistics 2018-12-21 Martín Abadi , Andy Chu , Ian Goodfellow , H. Brendan McMahan , Ilya Mironov , Kunal Talwar , Li Zhang

Many machine learning applications are based on data collected from people, such as their tastes and behaviour as well as biological traits and genetic data. Regardless of how important the application might be, one has to make sure…

Machine Learning · Statistics 2017-04-11 Joonas Jälkö , Onur Dikmen , Antti Honkela

Privacy-preserving machine learning algorithms are crucial for the increasingly common setting in which personal data, such as medical or financial records, are analyzed. We provide general techniques to produce privacy-preserving…

Machine Learning · Computer Science 2011-02-18 Kamalika Chaudhuri , Claire Monteleoni , Anand D. Sarwate

In this paper, we initiate the systematic study of solving linear programs under differential privacy. The first step is simply to define the problem: to this end, we introduce several natural classes of private linear programs that capture…

Data Structures and Algorithms · Computer Science 2018-03-16 Justin Hsu , Aaron Roth , Tim Roughgarden , Jonathan Ullman

We consider differentially private algorithms for reinforcement learning in continuous spaces, such that neighboring reward functions are indistinguishable. This protects the reward information from being exploited by methods such as…

Machine Learning · Statistics 2019-11-12 Baoxiang Wang , Nidhi Hegde

Motivated by high-stakes decision-making domains like personalized medicine where user information is inherently sensitive, we design privacy preserving exploration policies for episodic reinforcement learning (RL). We first provide a…

Machine Learning · Computer Science 2020-09-22 Giuseppe Vietri , Borja Balle , Akshay Krishnamurthy , Zhiwei Steven Wu

In many real-world applications of machine learning, data are distributed across many clients and cannot leave the devices they are stored on. Furthermore, each client's data, computational resources and communication constraints may be…

Machine Learning · Statistics 2019-12-02 Mrinank Sharma , Michael Hutchinson , Siddharth Swaroop , Antti Honkela , Richard E. Turner

Differentially private training algorithms provide protection against one of the most popular attacks in machine learning: the membership inference attack. However, these privacy algorithms incur a loss of the model's classification…

Cryptography and Security · Computer Science 2021-10-13 Jiaxiang Liu , Simon Oya , Florian Kerschbaum

We present a framework to statistically audit the privacy guarantee conferred by a differentially private machine learner in practice. While previous works have taken steps toward evaluating privacy loss through poisoning attacks or…

Machine Learning · Computer Science 2023-01-10 Fred Lu , Joseph Munoz , Maya Fuchs , Tyler LeBlond , Elliott Zaresky-Williams , Edward Raff , Francis Ferraro , Brian Testa

We investigate whether Differentially Private SGD offers better privacy in practice than what is guaranteed by its state-of-the-art analysis. We do so via novel data poisoning attacks, which we show correspond to realistic privacy attacks.…

Cryptography and Security · Computer Science 2020-06-16 Matthew Jagielski , Jonathan Ullman , Alina Oprea

Learning a privacy-preserving model from sensitive data which are distributed across multiple devices is an increasingly important problem. The problem is often formulated in the federated learning context, with the aim of learning a single…

Machine Learning · Computer Science 2023-04-20 Mikko A. Heikkilä , Matthew Ashman , Siddharth Swaroop , Richard E. Turner , Antti Honkela

Policy optimization (PO) is a cornerstone of modern reinforcement learning (RL), with diverse applications spanning robotics, healthcare, and large language model training. The increasing deployment of PO in sensitive domains, however,…

Machine Learning · Computer Science 2026-05-14 Yi He , Xingyu Zhou

Differential privacy is a strong mathematical notion of privacy. Still, a prominent challenge when using differential privacy in real data collection is understanding and counteracting the accuracy loss that differential privacy imposes. As…

Cryptography and Security · Computer Science 2021-08-24 Boel Nelson

Protecting the privacy of people whose data is used by machine learning algorithms is important. Differential Privacy is the appropriate mathematical framework for formal guarantees of privacy, and boosted decision trees are a popular…

Machine Learning · Computer Science 2022-02-01 Vahid R. Asadi , Marco L. Carmosino , Mohammadmahdi Jahanara , Akbar Rafiey , Bahar Salamatian

Iterative algorithms for differential privacy run for a fixed number of iterations, where each iteration learns some information from data and produces an intermediate output. However, the algorithm only releases the output of the last…

Data Structures and Algorithms · Computer Science 2016-09-13 Jaewoo Lee , Daniel Kifer

Auditing mechanisms for differential privacy use probabilistic means to empirically estimate the privacy level of an algorithm. For private machine learning, existing auditing mechanisms are tight: the empirical privacy estimate (nearly)…

Designing privacy-preserving machine learning algorithms has received great attention in recent years, especially in the setting when the data contains sensitive information. Differential privacy (DP) is a widely used mechanism for data…

Machine Learning · Computer Science 2025-09-11 Chunyang Liao , Deanna Needell , Hayden Schaeffer , Alexander Xue