English
Related papers

Related papers: Assessing Per-Sample Membership Inference Vulnerab…

200 papers

Training a machine learning model with data following a meaningful order, i.e., from easy to hard, has been proven to be effective in accelerating the training process and achieving better model performance. The key enabling technique is…

Cryptography and Security · Computer Science 2023-10-17 Joann Qiongna Chen , Xinlei He , Zheng Li , Yang Zhang , Zhou Li

The rise of Large Language Models (LLMs) has triggered legal and ethical concerns, especially regarding the unauthorized use of copyrighted materials in their training datasets. This has led to lawsuits against tech companies accused of…

Cryptography and Security · Computer Science 2025-01-17 Cédric Eichler , Nathan Champeil , Nicolas Anciaux , Alexandra Bensamoun , Heber Hwang Arcolezi , José Maria De Fuentes

Membership inference attacks (MIAs) attempt to predict whether a particular datapoint is a member of a target model's training data. Despite extensive research on traditional machine learning models, there has been limited work studying MIA…

Diffusion-based generative models have shown great potential for image synthesis, but there is a lack of research on the security and privacy risks they may pose. In this paper, we investigate the vulnerability of diffusion models to…

Computer Vision and Pattern Recognition · Computer Science 2023-05-31 Jinhao Duan , Fei Kong , Shiqi Wang , Xiaoshuang Shi , Kaidi Xu

Deep learning models, while achieving remarkable performances, are vulnerable to membership inference attacks (MIAs). Although various defenses have been proposed, there is still substantial room for improvement in the privacy-utility…

Cryptography and Security · Computer Science 2025-09-29 Yuefeng Peng , Ali Naseh , Amir Houmansadr

In this evolving era of machine learning security, membership inference attacks have emerged as a potent threat to the confidentiality of sensitive data. In this attack, adversaries aim to determine whether a particular point was used…

Machine Learning · Computer Science 2024-06-21 Abhishek Sinha , Himanshi Tibrewal , Mansi Gupta , Nikhar Waghela , Shivank Garg

Large language models (LLMs) are trained on massive web-scale corpora, raising growing concerns about privacy and copyright. Membership inference attacks (MIAs) aim to determine whether a given example was used during training. Existing LLM…

Machine Learning · Computer Science 2026-04-02 Ravi Ranjan , Utkarsh Grover , Xiaomin Lin , Agoritsa Polyzou

Membership inference attacks (MIAs) on code completion models offer an effective way to assess privacy risks by inferring whether a given code snippet was part of the training data. Existing black- and gray-box MIAs rely on expensive…

Software Engineering · Computer Science 2025-11-20 Yuan Jiang , Zehao Li , Shan Huang , Christoph Treude , Xiaohong Su , Tiantian Wang

Since machine learning model is often trained on a limited data set, the model is trained multiple times on the same data sample, which causes the model to memorize most of the training set data. Membership Inference Attacks (MIAs) exploit…

Machine Learning · Computer Science 2024-11-19 Depeng Chen , Xiao Liu , Jie Cui , Hong Zhong

Synthetic data generators and machine learning models can memorize their training data, posing privacy concerns. Membership inference attacks (MIAs) are a standard method of estimating the privacy risk of these systems. The risk of…

Machine Learning · Computer Science 2025-10-17 Nataša Krčo , Florent Guépin , Matthieu Meeus , Bogdan Kulynych , Yves-Alexandre de Montjoye

In the age of agentic AI, the growing deployment of multi-modal models (MMs) has introduced new attack vectors that can leak sensitive training data in MMs, causing privacy leakage. This paper investigates a black-box privacy attack, i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 David Amebley , Sayanton Dibbo

Recent studies have shown that deep learning models are vulnerable to membership inference attacks (MIAs), which aim to infer whether a data record was used to train a target model or not. To analyze and study these vulnerabilities, various…

Machine Learning · Statistics 2025-08-12 Chenxu Zhao , Wei Qian , Aobo Chen , Mengdi Huai

We study the privacy implications of training recurrent neural networks (RNNs) with sensitive training datasets. Considering membership inference attacks (MIAs), which aim to infer whether or not specific data records have been used in…

Cryptography and Security · Computer Science 2023-01-23 Yunhao Yang , Parham Gohari , Ufuk Topcu

Large language models (LLMs) are increasingly trained on tabular data, which, unlike unstructured text, often contains personally identifiable information (PII) in a highly structured and explicit format. As a result, privacy risks arise,…

Cryptography and Security · Computer Science 2025-07-24 Eyal German , Sagiv Antebi , Daniel Samira , Asaf Shabtai , Yuval Elovici

In recent years, the widespread adoption of Machine Learning as a Service (MLaaS), particularly in sensitive environments, has raised considerable privacy concerns. Of particular importance are membership inference attacks (MIAs), which…

Cryptography and Security · Computer Science 2026-02-16 Osama Zafar , Shaojie Zhan , Tianxi Ji , Erman Ayday

Optimization algorithms that seek flatter minima, such as Sharpness-Aware Minimization (SAM), are credited with improved generalization and robustness to noise. We ask whether such gains impact membership privacy. Surprisingly, we find that…

Machine Learning · Computer Science 2026-01-29 Young In Kim , Andrea Agiollo , Pratiksha Agrawal , Johannes O. Royset , Rajiv Khanna

Transfer learning (TL) has been demonstrated to improve DNN model performance when faced with a scarcity of training samples. However, the suitability of TL as a solution to reduce vulnerability of overfitted DNNs to privacy attacks is…

Machine learning algorithms, when applied to sensitive data, pose a potential threat to privacy. A growing body of prior work has demonstrated that membership inference attack (MIA) can disclose specific private information in the training…

Cryptography and Security · Computer Science 2020-01-27 Bo Zhang , Ruotong Yu , Haipei Sun , Yanying Li , Jun Xu , Hui Wang

Safety classifiers are essential safeguards within generative AI systems, filtering harmful content or identifying at-risk users when interacting with large language models. Despite their necessity, these models are trained on sensitive…

Machine Learning · Computer Science 2026-05-25 Anthony Hughes , Alexander Goldberg , Prince Jha , Adam Perer , Nikolaos Aletras , Niloofar Mireshghallah

Given the rising popularity of AI-generated art and the associated copyright concerns, identifying whether an artwork was used to train a diffusion model is an important research topic. The work approaches this problem from the membership…

Cryptography and Security · Computer Science 2025-08-14 Jingwei Li , Jing Dong , Tianxing He , Jingzhao Zhang