English
Related papers

Related papers: Membership Inference Attacks and Defenses in Class…

200 papers

Among all privacy attacks against Machine Learning (ML), membership inference attacks (MIA) attracted the most attention. In these attacks, the attacker is given an ML model and a data point, and they must infer whether the data point was…

Cryptography and Security · Computer Science 2025-12-02 Bram van Dartel , Marc Damie , Florian Hahn

An efficient scheme is introduced that extends the generalized membership inference attack to every point in a model's training data set. Our approach leverages data partitioning to create variable sized training sets for the reference…

Membership inference (MI) attacks threaten user privacy through determining if a given data example has been used to train a target model. However, it has been increasingly recognized that the "comparing different MI attacks" methodology…

Modern machine learning (ML) ecosystems offer a surging number of ML frameworks and code repositories that can greatly facilitate the development of ML models. Today, even ordinary data holders who are not ML experts can apply off-the-shelf…

Cryptography and Security · Computer Science 2024-07-03 Zitao Chen , Karthik Pattabiraman

While significant research advances have been made in the field of deep reinforcement learning, there have been no concrete adversarial attack strategies in literature tailored for studying the vulnerability of deep reinforcement learning…

Machine Learning · Computer Science 2022-11-17 Maziar Gomrokchi , Susan Amin , Hossein Aboutalebi , Alexander Wong , Doina Precup

Membership inference attacks serves as useful tool for fair use of language models, such as detecting potential copyright infringement and auditing data leakage. However, many current state-of-the-art attacks require access to models'…

Safety classifiers are essential safeguards within generative AI systems, filtering harmful content or identifying at-risk users when interacting with large language models. Despite their necessity, these models are trained on sensitive…

Machine Learning · Computer Science 2026-05-25 Anthony Hughes , Alexander Goldberg , Prince Jha , Adam Perer , Nikolaos Aletras , Niloofar Mireshghallah

Differential Privacy (DP) is the de facto standard for reasoning about the privacy guarantees of a training algorithm. Despite the empirical observation that DP reduces the vulnerability of models to existing membership inference (MI)…

Machine Learning · Computer Science 2022-12-20 Anvith Thudi , Ilia Shumailov , Franziska Boenisch , Nicolas Papernot

Membership Inference Attacks (MIAs) infer whether a data point is in the training data of a machine learning model. It is a threat while being in the training data is private information of a data point. MIA correctly infers some data…

Cryptography and Security · Computer Science 2022-10-31 Mauro Conti , Jiaxin Li , Stjepan Picek

Membership inference attacks allow a malicious entity to predict whether a sample is used during training of a victim model or not. State-of-the-art membership inference attacks have shown to achieve good accuracy which poses a great…

Machine Learning · Computer Science 2022-03-07 Shahbaz Rezaei , Xin Liu

Model Inversion (MI) attacks aim at leveraging the output information of target models to reconstruct privacy-sensitive training data, raising critical concerns regarding the privacy vulnerabilities of Deep Neural Networks (DNNs).…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Yixiang Qiu , Hongyao Yu , Hao Fang , Tianqu Zhuang , Wenbo Yu , Bin Chen , Xuan Wang , Shu-Tao Xia , Ke Xu

An over-the-air membership inference attack (MIA) is presented to leak private information from a wireless signal classifier. Machine learning (ML) provides powerful means to classify wireless signals, e.g., for PHY-layer authentication. As…

Cryptography and Security · Computer Science 2021-07-27 Yi Shi , Yalin E. Sagduyu

In the text processing context, most ML models are built on word embeddings. These embeddings are themselves trained on some datasets, potentially containing sensitive data. In some cases this training is done independently, in other cases,…

Computation and Language · Computer Science 2021-06-23 Saeed Mahloujifar , Huseyin A. Inan , Melissa Chase , Esha Ghosh , Marcello Hasegawa

Recent years have witnessed the tremendous success of diffusion models in data synthesis. However, when diffusion models are applied to sensitive data, they also give rise to severe privacy concerns. In this paper, we systematically present…

Cryptography and Security · Computer Science 2023-01-25 Hailong Hu , Jun Pang

Membership Inference Attacks (MIAs) aim to identify specific data samples within the private training dataset of machine learning models, leading to serious privacy violations and other sophisticated threats. Many practical black-box MIAs…

Machine Learning · Computer Science 2023-10-13 Jihye Choi , Shruti Tople , Varun Chandrasekaran , Somesh Jha

In a Membership Inference (MI) game, an attacker tries to infer whether a target point was included or not in the input of an algorithm. Existing works show that some target points are easier to identify, while others are harder. This paper…

Machine Learning · Computer Science 2025-03-07 Achraf Azize , Debabrota Basu

With the increasing adoption of AI, inherent security and privacy vulnerabilities formachine learning systems are being discovered. One such vulnerability makes itpossible for an adversary to obtain private information about the types of…

Machine Learning · Computer Science 2019-10-11 Samyadeep Basu , Rauf Izmailov , Chris Mesterharm

Since machine learning model is often trained on a limited data set, the model is trained multiple times on the same data sample, which causes the model to memorize most of the training set data. Membership Inference Attacks (MIAs) exploit…

Machine Learning · Computer Science 2024-11-19 Depeng Chen , Xiao Liu , Jie Cui , Hong Zhong

Masked Image Modeling (MIM) has achieved significant success in the realm of self-supervised learning (SSL) for visual recognition. The image encoder pre-trained through MIM, involving the masking and subsequent reconstruction of input…

Cryptography and Security · Computer Science 2024-08-14 Zheng Li , Xinlei He , Ning Yu , Yang Zhang

Machine learning (ML) models are vulnerable to membership inference attacks (MIAs), which determine whether a given input is used for training the target model. While there have been many efforts to mitigate MIAs, they often suffer from…

Cryptography and Security · Computer Science 2023-07-06 Zitao Chen , Karthik Pattabiraman