中文
相关论文

相关论文: Embedding-Space Data Augmentation to Prevent Membe…

200 篇论文

Membership inference attacks (MIAs) pose a critical privacy threat to fine-tuned large language models (LLMs), especially when models are adapted to domain-specific tasks using sensitive data. While prior black-box MIA techniques rely on…

密码学与安全 · 计算机科学 2025-12-23 Zhexi Lu , Hongliang Chi , Nathalie Baracaldo , Swanand Ravindra Kadhe , Yuseok Jeon , Lei Yu

Membership inference attacks (MIAs) pose a critical threat to the privacy of training data in deep learning. Despite significant progress in attack methodologies, our understanding of when and how models encode membership information during…

机器学习 · 计算机科学 2025-08-05 Yuetian Chen , Zhiqi Wang , Nathalie Baracaldo , Swanand Ravindra Kadhe , Lei Yu

Retrieval-Augmented Generation (RAG) and Supervised Finetuning (SFT) have become the predominant paradigms for equipping Large Language Models (LLMs) with external knowledge for diverse, knowledge-intensive tasks. However, while such…

密码学与安全 · 计算机科学 2025-12-04 Haowei Fu , Bo Ni , Han Xu , Kunpeng Liu , Dan Lin , Tyler Derr

A Membership Inference Attack (MIA) assesses how much a target machine learning model reveals about its training data by determining whether specific query instances were part of the training set. State-of-the-art MIAs rely on training…

密码学与安全 · 计算机科学 2026-01-13 Yuntao Du , Yuetian Chen , Hanshen Xiao , Bruno Ribeiro , Ninghui Li

Machine learning models are prone to memorizing sensitive data, making them vulnerable to membership inference attacks in which an adversary aims to infer whether an input sample was used to train the model. Over the past few years,…

密码学与安全 · 计算机科学 2022-08-23 Xinlei He , Zheng Li , Weilin Xu , Cory Cornelius , Yang Zhang

Safety classifiers are essential safeguards within generative AI systems, filtering harmful content or identifying at-risk users when interacting with large language models. Despite their necessity, these models are trained on sensitive…

机器学习 · 计算机科学 2026-05-25 Anthony Hughes , Alexander Goldberg , Prince Jha , Adam Perer , Nikolaos Aletras , Niloofar Mireshghallah

Location data is frequently collected from populations and shared in aggregate form to guide policy and decision making. However, the prevalence of aggregated data also raises the privacy concern of membership inference attacks (MIAs). MIAs…

密码学与安全 · 计算机科学 2024-06-28 Vincent Guan , Florent Guépin , Ana-Maria Cretu , Yves-Alexandre de Montjoye

Tabular data synthesis using diffusion models has gained significant attention for its potential to balance data utility and privacy. However, existing privacy evaluations often rely on heuristic metrics or weak membership inference attacks…

机器学习 · 计算机科学 2025-03-18 Xiaoyu Wu , Yifei Pang , Terrance Liu , Steven Wu

Large Language Models (LLMs) are prone to memorizing training data, which poses serious privacy risks. Two of the most prominent concerns are training data extraction and Membership Inference Attacks (MIAs). Prior research has shown that…

机器学习 · 计算机科学 2026-03-02 Ali Al Sahili , Ali Chehab , Razane Tajeddine

Membership inference attacks (MIAs) aim to infer whether a data point has been used to train a machine learning model. These attacks can be employed to identify potential privacy vulnerabilities and detect unauthorized use of personal data.…

机器学习 · 计算机科学 2023-10-03 Myeongseob Ko , Ming Jin , Chenguang Wang , Ruoxi Jia

A Membership Inference Attack (MIA) assesses how much a trained machine learning model reveals about its training data by determining whether specific query instances were included in the dataset. We classify existing MIAs into adaptive or…

密码学与安全 · 计算机科学 2025-09-09 Yuntao Du , Jiacheng Li , Yuetian Chen , Kaiyuan Zhang , Zhizhen Yuan , Hanshen Xiao , Bruno Ribeiro , Ninghui Li

Diffusion models have achieved tremendous success in image generation, but they also raise significant concerns regarding privacy and copyright issues. Membership Inference Attacks (MIAs) are designed to ascertain whether specific data was…

密码学与安全 · 计算机科学 2026-05-29 Puwei Lian , Yujun Cai , Songze Li , Bingkun Bao

Deep learning models often raise privacy concerns as they leak information about their training data. This enables an adversary to determine whether a data point was in a model's training set by conducting a membership inference attack…

机器学习 · 计算机科学 2020-06-11 Yigitcan Kaya , Sanghyun Hong , Tudor Dumitras

Membership Inference Attacks (MIAs) have emerged as a valuable framework for evaluating privacy leakage by machine learning models. Score-based MIAs are distinguished, in particular, by their ability to exploit the confidence scores that…

机器学习 · 计算机科学 2025-02-28 Gauri Pradhan , Joonas Jälkö , Marlon Tobaben , Antti Honkela

Membership inference attacks (MIAs) have become the standard tool for evaluating privacy leakage in machine learning (ML). Among them, the Likelihood-Ratio Attack (LiRA) is widely regarded as the state of the art when sufficient shadow…

密码学与安全 · 计算机科学 2026-03-10 Najeeb Jebreel , Mona Khalil , David Sánchez , Josep Domingo-Ferrer

Membership inference attacks (MIAs) are used to test practical privacy of machine learning models. MIAs complement formal guarantees from differential privacy (DP) under a more realistic adversary model. We analyse MIA vulnerability of…

密码学与安全 · 计算机科学 2026-02-03 Marlon Tobaben , Hibiki Ito , Joonas Jälkö , Yuan He , Antti Honkela

Membership Inference Attacks (MIAs) infer whether a data point is in the training data of a machine learning model. It is a threat while being in the training data is private information of a data point. MIA correctly infers some data…

密码学与安全 · 计算机科学 2022-10-31 Mauro Conti , Jiaxin Li , Stjepan Picek

Membership Inference Attack (MIA) determines the presence of a record in a machine learning model's training data by querying the model. Prior work has shown that the attack is feasible when the model is overfitted to its training data or…

密码学与安全 · 计算机科学 2018-02-15 Yunhui Long , Vincent Bindschaedler , Lei Wang , Diyue Bu , Xiaofeng Wang , Haixu Tang , Carl A. Gunter , Kai Chen

A membership inference attack (MIA) against a machine-learning model enables an attacker to determine whether a given data record was part of the model's training data or not. In this paper, we provide an in-depth study of the phenomenon of…

机器学习 · 计算机科学 2021-09-20 Bogdan Kulynych , Mohammad Yaghini , Giovanni Cherubin , Michael Veale , Carmela Troncoso

Data augmentation is widely used to mitigate data bias in the training dataset. However, data augmentation exposes machine learning models to privacy attacks, such as membership inference attacks. In this paper, we propose an effective…

机器学习 · 计算机科学 2024-04-23 Zhixin Pan , Emma Andrews , Laura Chang , Prabhat Mishra