English
Related papers

Related papers: Auditing Differentially Private Machine Learning: …

200 papers

Differential privacy is a widely used notion of security that enables the processing of sensitive information. In short, differentially private algorithms map "neighbouring" inputs to close output distributions. Prior work proposed several…

Quantum Physics · Physics 2023-07-11 Armando Angrisani , Mina Doosti , Elham Kashefi

The application of differential privacy to the training of deep neural networks holds the promise of allowing large-scale (decentralized) use of sensitive data while providing rigorous privacy guarantees to the individual. The predominant…

Machine Learning · Computer Science 2021-08-11 Moritz Knolle , Dmitrii Usynin , Alexander Ziller , Marcus R. Makowski , Daniel Rueckert , Georgios Kaissis

This paper addresses the challenge of balancing learner data privacy with the use of data in learning analytics (LA) by proposing a novel framework by applying Differential Privacy (DP). The need for more robust privacy protection keeps…

Cryptography and Security · Computer Science 2025-01-06 Qinyi Liu , Ronas Shakya , Mohammad Khalil , Jelena Jovanovic

In public health interventions such as distributing preexposure prophylaxis (PrEP) for HIV prevention, decision makers often use seeding algorithms to identify key individuals who can amplify intervention impact. However, building a…

Social and Information Networks · Computer Science 2025-11-27 Yuxin Liu , M. Amin Rahimian , Fang-Yi Yu

How can agents exchange information to learn while protecting privacy? Healthcare centers collaborating on clinical trials must balance knowledge sharing with safeguarding sensitive patient data. We address this challenge by using…

Machine Learning · Computer Science 2025-03-19 Marios Papachristou , M. Amin Rahimian

Learning a privacy-preserving model from sensitive data which are distributed across multiple devices is an increasingly important problem. The problem is often formulated in the federated learning context, with the aim of learning a single…

Machine Learning · Computer Science 2023-04-20 Mikko A. Heikkilä , Matthew Ashman , Siddharth Swaroop , Richard E. Turner , Antti Honkela

Creation of a synthetic dataset that faithfully represents the data distribution and simultaneously preserves privacy is a major research challenge. Many space partitioning based approaches have emerged in recent years for answering…

Cryptography and Security · Computer Science 2023-06-26 Eleonora Kreačić , Navid Nouri , Vamsi K. Potluru , Tucker Balch , Manuela Veloso

Machine learning models can be trained with formal privacy guarantees via differentially private optimizers such as DP-SGD. In this work, we focus on a threat model where the adversary has access only to the final model, with no visibility…

Machine Learning · Computer Science 2025-05-30 Tudor Cebere , Aurélien Bellet , Nicolas Papernot

Ensuring the privacy of sensitive data used to train modern machine learning models is of paramount importance in many areas of practice. One recent popular approach to study these concerns is using the differential privacy via a…

Cryptography and Security · Computer Science 2020-07-29 Lichao Sun , Ji Wang , Philip S. Yu , Lifang He

Differential Privacy (DP) provides an elegant mathematical framework for defining a provable disclosure risk in the presence of arbitrary adversaries; it guarantees that whether an individual is in a database or not, the results of a DP…

Cryptography and Security · Computer Science 2021-08-19 Aleksandra Slavkovic , Roberto Molinari

Preserving privacy in contemporary NLP models allows us to work with sensitive data, but unfortunately comes at a price. We know that stricter privacy guarantees in differentially-private stochastic gradient descent (DP-SGD) generally…

Computation and Language · Computer Science 2023-02-01 Manuel Senge , Timour Igamberdiev , Ivan Habernal

In differentially private (DP) machine learning, the privacy guarantees of DP mechanisms are often reported and compared on the basis of a single $(\varepsilon, \delta)$-pair. This practice overlooks that DP guarantees can vary…

Cryptography and Security · Computer Science 2025-05-06 Georgios Kaissis , Stefan Kolek , Borja Balle , Jamie Hayes , Daniel Rueckert

Broad adoption of machine learning techniques has increased privacy concerns for models trained on sensitive data such as medical records. Existing techniques for training differentially private (DP) models give rigorous privacy guarantees,…

Machine Learning · Statistics 2019-10-04 Zhengli Zhao , Nicolas Papernot , Sameer Singh , Neoklis Polyzotis , Augustus Odena

Recent developments in deep learning have led to great success in various natural language processing (NLP) tasks. However, these applications may involve data that contain sensitive information. Therefore, how to achieve good performance…

Computation and Language · Computer Science 2023-10-24 Lijie Hu , Ivan Habernal , Lei Shen , Di Wang

Differential privacy, a notion of algorithmic stability, is a gold standard for measuring the additional risk an algorithm's output poses to the privacy of a single record in the dataset. Differential privacy is defined as the distance…

Machine Learning · Computer Science 2019-07-05 Kamalika Chaudhuri , Jacob Imola , Ashwin Machanavajjhala

Despite recent widespread deployment of differential privacy, relatively little is known about what users think of differential privacy. In this work, we seek to explore users' privacy expectations related to differential privacy.…

Computers and Society · Computer Science 2021-10-14 Rachel Cummings , Gabriel Kaptchuk , Elissa M. Redmiles

Using real-world study data usually requires contractual agreements where research results may only be published in anonymized form. Requiring formal privacy guarantees, such as differential privacy, could be helpful for data-driven…

Cryptography and Security · Computer Science 2024-07-08 Jonas Allmann , Saskia Nuñez von Voigt , Florian Tschorsch

Designing privacy-preserving machine learning algorithms has received great attention in recent years, especially in the setting when the data contains sensitive information. Differential privacy (DP) is a widely used mechanism for data…

Machine Learning · Computer Science 2025-09-11 Chunyang Liao , Deanna Needell , Hayden Schaeffer , Alexander Xue

Recent advances in synthetic data generation (SDG) have been hailed as a solution to the difficult problem of sharing sensitive data while protecting privacy. SDG aims to learn statistical properties of real data in order to generate…

Machine Learning · Computer Science 2024-05-10 Meenatchi Sundaram Muthu Selva Annamalai , Andrea Gadotti , Luc Rocher

Sequential querying of differentially private mechanisms degrades the overall privacy level. In this paper, we answer the fundamental question of characterizing the level of overall privacy degradation as a function of the number of queries…

Data Structures and Algorithms · Computer Science 2015-12-08 Peter Kairouz , Sewoong Oh , Pramod Viswanath