English
Related papers

Related papers: Auditing Differentially Private Machine Learning: …

200 papers

Differential privacy offers formal quantitative guarantees for algorithms over datasets, but it assumes attackers that know and can influence all but one record in the database. This assumption often vastly overapproximates the attackers'…

Cryptography and Security · Computer Science 2020-12-01 Damien Desfontaines , Esfandiar Mohammadi , Elisabeth Krahmer , David Basin

Significant success has been realized recently on applying machine learning to real-world applications. There have also been corresponding concerns on the privacy of training data, which relates to data security and confidentiality issues.…

Machine Learning · Statistics 2017-12-27 Bai Li , Changyou Chen , Hao Liu , Lawrence Carin

Stochastic optimization is a pivotal enabler in modern machine learning, producing effective models for various tasks. However, several existing works have shown that model parameters and gradient information are susceptible to privacy…

Machine Learning · Computer Science 2025-09-15 Zhanhong Jiang , Md Zahid Hasan , Nastaran Saadati , Aditya Balu , Chao Liu , Soumik Sarkar

A well-known algorithm in privacy-preserving ML is differentially private stochastic gradient descent (DP-SGD). While this algorithm has been evaluated on text and image data, it has not been previously applied to ads data, which are…

Recent works have shown that selecting an optimal model architecture suited to the differential privacy setting is necessary to achieve the best possible utility for a given privacy budget using differentially private stochastic gradient…

Machine Learning · Computer Science 2024-11-01 Anderson Santana de Oliveira , Caelin Kaplan , Khawla Mallat , Tanmay Chakraborty

We present the first differentially private algorithms for reinforcement learning, which apply to the task of evaluating a fixed policy. We establish two approaches for achieving differential privacy, provide a theoretical analysis of the…

Machine Learning · Computer Science 2016-03-08 Borja Balle , Maziar Gomrokchi , Doina Precup

Users of a personalised recommendation system face a dilemma: recommendations can be improved by learning from data, but only if the other users are willing to share their private information. Good personalised predictions are vitally…

Machine Learning · Statistics 2018-02-12 Antti Honkela , Mrinal Das , Arttu Nieminen , Onur Dikmen , Samuel Kaski

Differentially private learning on real-world data poses challenges for standard machine learning practice: privacy guarantees are difficult to interpret, hyperparameter tuning on private data reduces the privacy budget, and ad-hoc privacy…

Machine Learning · Statistics 2018-12-10 Koen Lennart van der Veen , Ruben Seggers , Peter Bloem , Giorgio Patrini

Differential privacy (DP) provides a formal privacy guarantee that prevents adversaries with access to machine learning models from extracting information about individual training points. Differentially private stochastic gradient descent…

Cryptography and Security · Computer Science 2022-12-15 Jie Fu , Zhili Chen , XinPeng Ling

Differential privacy (DP) provides formal guarantees that the output of a database query does not reveal too much information about any individual present in the database. While many differentially private algorithms have been proposed in…

Cryptography and Security · Computer Science 2019-11-27 Royce J Wilson , Celia Yuxin Zhang , William Lam , Damien Desfontaines , Daniel Simmons-Marengo , Bryant Gipson

Fine-tuning large language models (LLMs) has become an essential strategy for adapting them to specialized tasks; however, this process introduces significant privacy challenges, as sensitive training data may be inadvertently memorized and…

Cryptography and Security · Computer Science 2025-05-02 Hao Du , Shang Liu , Yang Cao

Motivated by the increasing deployment of reinforcement learning in the real world, involving a large consumption of personal data, we introduce a differentially private (DP) policy gradient algorithm. We show that, in this setting, the…

Machine Learning · Computer Science 2025-02-03 Alexandre Rio , Merwan Barlier , Igor Colin

Differential privacy (DP) has become the standard for private data analysis. Certain machine learning applications only require privacy protection for specific protected attributes. Using naive variants of differential privacy in such use…

Cryptography and Security · Computer Science 2025-06-25 Saeed Mahloujifar , Chuan Guo , G. Edward Suh , Kamalika Chaudhuri

The increasing availability of personal data has enabled significant advances in fields such as machine learning, healthcare, and cybersecurity. However, this data abundance also raises serious privacy concerns, especially in light of…

Cryptography and Security · Computer Science 2026-04-24 Napsu Karmitsa , Antti Airola , Tapio Pahikkala , Tinja Pitkämäki

In statistical disclosure control, the goal of data analysis is twofold: The released information must provide accurate and useful statistics about the underlying population of interest, while minimizing the potential for an individual…

Methodology · Statistics 2016-07-15 Jing Lei , Anne-Sophie Charest , Aleksandra Slavkovic , Adam Smith , Stephen Fienberg

Learning often involves sensitive data and as such, privacy preserving extensions to Stochastic Gradient Descent (SGD) and other machine learning algorithms have been developed using the definitions of Differential Privacy (DP). In…

Machine Learning · Computer Science 2021-10-14 Friedrich Dörmann , Osvald Frisk , Lars Nørvang Andersen , Christian Fischer Pedersen

Smart power grids offer to revolutionize power distribution by sharing granular power usage data, though this same data sharing can reveal a great deal about users, and there are serious privacy concerns for customers. In this paper, we…

Optimization and Control · Mathematics 2019-02-19 Matthew Hale , Prabir Barooah , Kendall Parker , Kasra Yazdani

Empirical defenses for machine learning privacy forgo the provable guarantees of differential privacy in the hope of achieving higher utility while resisting realistic adversaries. We identify severe pitfalls in existing empirical privacy…

Cryptography and Security · Computer Science 2024-09-06 Michael Aerni , Jie Zhang , Florian Tramèr

Deep learning techniques based on neural networks have shown significant success in a wide range of AI tasks. Large-scale training datasets are one of the critical factors for their success. However, when the training datasets are…

Cryptography and Security · Computer Science 2019-12-23 Lei Yu , Ling Liu , Calton Pu , Mehmet Emre Gursoy , Stacey Truex

In order to both learn and protect sensitive training data, there has been a growing interest in privacy preserving machine learning methods. Differential privacy has emerged as an important measure of privacy. We are interested in the…

Cryptography and Security · Computer Science 2025-02-11 Antoine Barczewski , Amal Mawass , Jan Ramon