English
Related papers

Related papers: Confidence Is All You Need for MI Attacks

200 papers

A membership inference attack allows an adversary to query a trained machine learning model to predict whether or not a particular example was contained in the model's training dataset. These attacks are currently evaluated using…

Cryptography and Security · Computer Science 2022-04-13 Nicholas Carlini , Steve Chien , Milad Nasr , Shuang Song , Andreas Terzis , Florian Tramer

Machine learning models are vulnerable to membership inference attacks in which an adversary aims to predict whether or not a particular sample was contained in the target model's training dataset. Existing attack methods have commonly…

Cryptography and Security · Computer Science 2022-09-01 Yiyong Liu , Zhengyu Zhao , Michael Backes , Yang Zhang

Machine learning (ML) has been widely adopted in various privacy-critical applications, e.g., face recognition and medical image analysis. However, recent research has shown that ML models are vulnerable to attacks against their training…

Machine Learning · Computer Science 2021-09-20 Zheng Li , Yang Zhang

Machine learning (ML) has become a core component of many real-world applications and training data is a key factor that drives current progress. This huge success has led Internet companies to deploy machine learning as a service (MLaaS).…

Cryptography and Security · Computer Science 2018-12-18 Ahmed Salem , Yang Zhang , Mathias Humbert , Pascal Berrang , Mario Fritz , Michael Backes

A large body of research has shown that machine learning models are vulnerable to membership inference (MI) attacks that violate the privacy of the participants in the training data. Most MI research focuses on the case of a single…

Machine Learning · Computer Science 2022-05-16 Matthew Jagielski , Stanley Wu , Alina Oprea , Jonathan Ullman , Roxana Geambasu

Machine learning has revolutionized numerous domains, playing a crucial role in driving advancements and enabling data-centric processes. The significance of data in training models and shaping their performance cannot be overstated. Recent…

Cryptography and Security · Computer Science 2024-10-01 Rui Wen , Michael Backes , Yang Zhang

Membership inference attacks (MIA) can reveal whether a particular data point was part of the training dataset, potentially exposing sensitive information about individuals. This article provides theoretical guarantees by exploring the…

Machine Learning · Statistics 2025-10-08 Eric Aubinais , Elisabeth Gassiat , Pablo Piantanida

The arms race between attacks and defenses for machine learning models has come to a forefront in recent years, in both the security community and the privacy community. However, one big limitation of previous research is that the security…

Machine Learning · Statistics 2019-08-27 Liwei Song , Reza Shokri , Prateek Mittal

Modern machine learning (ML) ecosystems offer a surging number of ML frameworks and code repositories that can greatly facilitate the development of ML models. Today, even ordinary data holders who are not ML experts can apply off-the-shelf…

Cryptography and Security · Computer Science 2024-07-03 Zitao Chen , Karthik Pattabiraman

With the wide-spread application of machine learning models, it has become critical to study the potential data leakage of models trained on sensitive data. Recently, various membership inference (MI) attacks are proposed to determine if a…

Cryptography and Security · Computer Science 2023-05-01 Shahbaz Rezaei , Xin Liu

Recently issued data privacy regulations like GDPR (General Data Protection Regulation) grant individuals the right to be forgotten. In the context of machine learning, this requires a model to forget about a training data sample if…

Cryptography and Security · Computer Science 2022-06-13 Hongsheng Hu , Zoran Salcic , Gillian Dobbie , Jinjun Chen , Lichao Sun , Xuyun Zhang

Membership inference attacks are designed to determine, using black box access to trained models, whether a particular example was used in training or not. Membership inference can be formalized as a hypothesis testing problem. The most…

Machine Learning · Computer Science 2023-07-10 Martin Bertran , Shuai Tang , Michael Kearns , Jamie Morgenstern , Aaron Roth , Zhiwei Steven Wu

Membership inference attacks (MIAs) against machine learning (ML) models aim to determine whether a given data point was part of the model training data. These attacks may pose significant privacy risks to individuals whose sensitive data…

Cryptography and Security · Computer Science 2025-11-24 Mona Khalil , Alberto Blanco-Justicia , Najeeb Jebreel , Josep Domingo-Ferrer

Membership Inference Attacks (MIAs) infer whether a data point is in the training data of a machine learning model. It is a threat while being in the training data is private information of a data point. MIA correctly infers some data…

Cryptography and Security · Computer Science 2022-10-31 Mauro Conti , Jiaxin Li , Stjepan Picek

Recently, diffusion models have become popular tools for image synthesis because of their high-quality outputs. However, like other large-scale models, they may leak private information about their training data. Here, we demonstrate a…

Machine Learning · Computer Science 2023-12-11 Shuai Tang , Zhiwei Steven Wu , Sergul Aydore , Michael Kearns , Aaron Roth

With an increase in low-cost machine learning APIs, advanced machine learning models may be trained on private datasets and monetized by providing them as a service. However, privacy researchers have demonstrated that these models may leak…

Membership inference attacks (MIAs) aim to determine whether a specific sample was used to train a predictive model. Knowing this may indeed lead to a privacy breach. Most MIAs, however, make use of the model's prediction scores - the…

Machine Learning · Computer Science 2023-01-25 Dominik Hintersdorf , Lukas Struppek , Kristian Kersting

The usage of deep learning is being escalated in many applications. Due to its outstanding performance, it is being used in a variety of security and privacy-sensitive areas in addition to conventional applications. One of the key aspects…

Cryptography and Security · Computer Science 2022-05-17 Zhaoxi Zhang , Leo Yu Zhang , Xufei Zheng , Bilal Hussain Abbasi , Shengshan Hu

Machine learning algorithms, when applied to sensitive data, pose a distinct threat to privacy. A growing body of prior work demonstrates that models produced by these algorithms may leak specific private information in the training data to…

Cryptography and Security · Computer Science 2018-05-08 Samuel Yeom , Irene Giacomelli , Matt Fredrikson , Somesh Jha

Determining whether a dataset was part of a machine learning model's training data pool can reveal privacy vulnerabilities, a challenge often addressed through membership inference attacks (MIAs). Traditional MIAs typically require access…

Machine Learning · Computer Science 2025-06-03 Yongchao Huang