English
Related papers

Related papers: PrivacyGuard: A Modular Framework for Privacy Audi…

200 papers

Empirical defenses for machine learning privacy forgo the provable guarantees of differential privacy in the hope of achieving higher utility while resisting realistic adversaries. We identify severe pitfalls in existing empirical privacy…

Cryptography and Security · Computer Science 2024-09-06 Michael Aerni , Jie Zhang , Florian Tramèr

In this work we address the practical challenges of training machine learning models on privacy-sensitive datasets by introducing a modular approach that minimizes changes to training algorithms, provides a variety of configuration…

Machine Learning · Computer Science 2019-03-05 H. Brendan McMahan , Galen Andrew , Ulfar Erlingsson , Steve Chien , Ilya Mironov , Nicolas Papernot , Peter Kairouz

Applying machine learning (ML) to sensitive domains requires privacy protection of the underlying training data through formal privacy frameworks, such as differential privacy (DP). Yet, usually, the privacy of the training data comes at…

Machine Learning · Computer Science 2022-11-09 Franziska Boenisch , Christopher Mühl , Roy Rinberg , Jannis Ihrig , Adam Dziedzic

Data holders are increasingly seeking to protect their user's privacy, whilst still maximizing their ability to produce machine models with high quality predictions. In this work, we empirically evaluate various implementations of…

Cryptography and Security · Computer Science 2020-09-16 Benjamin Zi Hao Zhao , Mohamed Ali Kaafar , Nicolas Kourtellis

Differential privacy (DP) has become the standard for private data analysis. Certain machine learning applications only require privacy protection for specific protected attributes. Using naive variants of differential privacy in such use…

Cryptography and Security · Computer Science 2025-06-25 Saeed Mahloujifar , Chuan Guo , G. Edward Suh , Kamalika Chaudhuri

Machine learning (ML) can help fight pandemics like COVID-19 by enabling rapid screening of large volumes of images. To perform data analysis while maintaining patient privacy, we create ML models that satisfy Differential Privacy (DP).…

Machine Learning · Computer Science 2026-02-03 Lucas Lange , Maja Schneider , Peter Christen , Erhard Rahm

Malicious adversaries can attack machine learning models to infer sensitive information or damage the system by launching a series of evasion attacks. Although various work addresses privacy and security concerns, they focus on individual…

Machine Learning · Computer Science 2024-01-22 Janvi Thakkar , Giulio Zizzo , Sergio Maffeis

Differential Privacy can provide provable privacy guarantees for training data in machine learning. However, the presence of proofs does not preclude the presence of errors. Inspired by recent advances in auditing which have been used for…

Machine Learning · Computer Science 2022-03-29 Florian Tramer , Andreas Terzis , Thomas Steinke , Shuang Song , Matthew Jagielski , Nicholas Carlini

Differential privacy provides strong privacy guarantees for machine learning applications. Much recent work has been focused on developing differentially private models, however there has been a gap in other stages of the machine learning…

Machine Learning · Computer Science 2021-09-07 Ashly Lau , Jonathan Passerat-Palmbach

Machine learning models are increasingly made available to the masses through public query interfaces. Recent academic work has demonstrated that malicious users who can query such models are able to infer sensitive information about…

Cryptography and Security · Computer Science 2017-12-27 Yunhui Long , Vincent Bindschaedler , Carl A. Gunter

Machine learning models can be trained with formal privacy guarantees via differentially private optimizers such as DP-SGD. In this work, we focus on a threat model where the adversary has access only to the final model, with no visibility…

Machine Learning · Computer Science 2025-05-30 Tudor Cebere , Aurélien Bellet , Nicolas Papernot

With the growing adoption of privacy-preserving machine learning algorithms, such as Differentially Private Stochastic Gradient Descent (DP-SGD), training or fine-tuning models on private datasets has become increasingly prevalent. This…

Cryptography and Security · Computer Science 2025-03-05 Hong Guan , Lei Yu , Lixi Zhou , Li Xiong , Kanchan Chowdhury , Lulu Xie , Xusheng Xiao , Jia Zou

Differentially private training algorithms provide protection against one of the most popular attacks in machine learning: the membership inference attack. However, these privacy algorithms incur a loss of the model's classification…

Cryptography and Security · Computer Science 2021-10-13 Jiaxiang Liu , Simon Oya , Florian Kerschbaum

In the realm of multimedia data analysis, the extensive use of image datasets has escalated concerns over privacy protection within such data. Current research predominantly focuses on privacy protection either in data sharing or upon the…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Huaxi Huang , Xin Yuan , Qiyu Liao , Dadong Wang , Tongliang Liu

Machine learning models trained with differentially-private (DP) algorithms such as DP-SGD enjoy resilience against a wide range of privacy attacks. Although it is possible to derive bounds for some attacks based solely on an…

Cryptography and Security · Computer Science 2024-02-23 Giovanni Cherubin , Boris Köpf , Andrew Paverd , Shruti Tople , Lukas Wutschitz , Santiago Zanella-Béguelin

The increasing availability of personal data has enabled significant advances in fields such as machine learning, healthcare, and cybersecurity. However, this data abundance also raises serious privacy concerns, especially in light of…

Cryptography and Security · Computer Science 2026-04-24 Napsu Karmitsa , Antti Airola , Tapio Pahikkala , Tinja Pitkämäki

Machine learning (ML) has become prominent in applications that directly affect people's quality of life, including in healthcare, justice, and finance. ML models have been found to exhibit discrimination based on sensitive attributes such…

Machine Learning · Computer Science 2022-05-25 Sikha Pentyala , David Melanson , Martine De Cock , Golnoosh Farnadi

We investigate whether Differentially Private SGD offers better privacy in practice than what is guaranteed by its state-of-the-art analysis. We do so via novel data poisoning attacks, which we show correspond to realistic privacy attacks.…

Cryptography and Security · Computer Science 2020-06-16 Matthew Jagielski , Jonathan Ullman , Alina Oprea

Within the machine learning community, reconstruction attacks are a principal concern and have been identified even in federated learning (FL), which was designed with privacy preservation in mind. In response to these threats, the privacy…

Training data privacy has been a top concern in AI modeling. While methods like differentiated private learning allow data contributors to quantify acceptable privacy loss, model utility is often significantly damaged. In practice,…

Machine Learning · Computer Science 2024-10-31 Yuechun Gu , Jiajie He , Keke Chen