中文
相关论文

相关论文: Exploring the limits of strong membership inferenc…

200 篇论文

Fine-tuned language models pose significant privacy risks, as they may memorize and expose sensitive information from their training data. Membership inference attacks (MIAs) provide a principled framework for auditing these risks, yet…

计算与语言 · 计算机科学 2026-04-14 David Ilić , David Stanojević , Kostadin Cvejoski

Large language models (LLMs) based recommender systems (RecSys) can adapt to different domains flexibly. It utilizes in-context learning (ICL), i.e., prompts, to customize the recommendation functions, which include sensitive historical…

信息检索 · 计算机科学 2026-01-23 Jiajie He , Min-Chun Chen , Xintong Chen , Xinyang Fang , Yuechun Gu , Keke Chen

Membership inference attacks (MIA) try to detect if data samples were used to train a neural network model, e.g. to detect copyright abuses. We show that models with higher dimensional input and output are more vulnerable to MIA, and…

机器学习 · 计算机科学 2021-08-19 Avital Shafran , Shmuel Peleg , Yedid Hoshen

We present the first systematic Membership Inference Attack (MIA) evaluation of Large Audio Language Models (LALMs). As audio encodes non-semantic information, it induces severe train and test distribution shifts and can lead to spurious…

声音 · 计算机科学 2026-03-31 Jia-Kai Dong , Yu-Xiang Lin , Hung-Yi Lee

A membership inference attack (MIA) against a machine-learning model enables an attacker to determine whether a given data record was part of the model's training data or not. In this paper, we provide an in-depth study of the phenomenon of…

机器学习 · 计算机科学 2021-09-20 Bogdan Kulynych , Mohammad Yaghini , Giovanni Cherubin , Michael Veale , Carmela Troncoso

Membership inference attacks (MIAs) pose a critical privacy threat to fine-tuned large language models (LLMs), especially when models are adapted to domain-specific tasks using sensitive data. While prior black-box MIA techniques rely on…

密码学与安全 · 计算机科学 2025-12-23 Zhexi Lu , Hongliang Chi , Nathalie Baracaldo , Swanand Ravindra Kadhe , Yuseok Jeon , Lei Yu

Membership Inference Attacks (MIAs) are currently a dominant approach for evaluating privacy in machine learning applications. Despite their significance in identifying records belonging to the training dataset, several concerns remain…

机器学习 · 计算机科学 2026-01-23 Cristina Pêra , Tânia Carvalho , Maxime Cordy , Luís Antunes

Large language models (LLMs) have achieved remarkable success and are widely adopted for diverse applications. However, fine-tuning these models often involves private or sensitive information, raising critical privacy concerns. In this…

A Membership Inference Attack (MIA) assesses how much a target machine learning model reveals about its training data by determining whether specific query instances were part of the training set. State-of-the-art MIAs rely on training…

密码学与安全 · 计算机科学 2026-01-13 Yuntao Du , Yuetian Chen , Hanshen Xiao , Bruno Ribeiro , Ninghui Li

This report summarizes all the MIA experiments (Membership Inference Attacks) of the Embedding Attack Project, including threat models, experimental setup, experimental results, findings and discussion. Current results cover the evaluation…

机器学习 · 计算机科学 2024-01-26 Jiameng Pu , Zafar Takhirov

Deep learning models often raise privacy concerns as they leak information about their training data. This enables an adversary to determine whether a data point was in a model's training set by conducting a membership inference attack…

机器学习 · 计算机科学 2020-06-11 Yigitcan Kaya , Sanghyun Hong , Tudor Dumitras

Safety classifiers are essential safeguards within generative AI systems, filtering harmful content or identifying at-risk users when interacting with large language models. Despite their necessity, these models are trained on sensitive…

机器学习 · 计算机科学 2026-05-25 Anthony Hughes , Alexander Goldberg , Prince Jha , Adam Perer , Nikolaos Aletras , Niloofar Mireshghallah

A number of recent works have demonstrated that API access to machine learning models leaks information about the dataset records used to train the models. Further, the work of \cite{somesh-overfit} shows that such membership inference…

密码学与安全 · 计算机科学 2019-10-15 Benjamin Zi Hao Zhao , Hassan Jameel Asghar , Raghav Bhaskar , Mohamed Ali Kaafar

The wide adoption and application of Masked language models~(MLMs) on sensitive data (from legal to medical) necessitates a thorough quantitative investigation into their privacy vulnerabilities -- to what extent do MLMs leak information…

机器学习 · 计算机科学 2022-11-07 Fatemehsadat Mireshghallah , Kartik Goyal , Archit Uniyal , Taylor Berg-Kirkpatrick , Reza Shokri

Recently, large language models (LLMs) have been gaining a lot of interest due to their adaptability and extensibility in emerging applications, including communication networks. It is anticipated that ZSM networks will be able to support…

密码学与安全 · 计算机科学 2025-01-07 Sunder Ali Khowaja , Parus Khuwaja , Kapal Dev , Hussam Al Hamadi , Engin Zeydan

As large language models (LLMs) are trained on increasingly opaque corpora, membership inference attacks (MIAs) have been proposed to audit whether copyrighted texts were used during training, despite growing concerns about their…

密码学与安全 · 计算机科学 2026-01-21 Murat Bilgehan Ertan , Emirhan Böge , Min Chen , Kaleel Mahmood , Marten van Dijk

Recent studies have shown that deep learning models are vulnerable to membership inference attacks (MIAs), which aim to infer whether a data record was used to train a target model or not. To analyze and study these vulnerabilities, various…

机器学习 · 统计学 2025-08-12 Chenxu Zhao , Wei Qian , Aobo Chen , Mengdi Huai

Membership Inference Attack (MIA) aims to determine whether a specific data sample was included in the training dataset of a target model. Traditional MIA approaches rely on shadow models to mimic target model behavior, but their…

信息检索 · 计算机科学 2026-03-20 Li Cuihong , Huang Xiaowen , Yin Chuanhuan , Sang Jitao

Large vision-language models (LVLMs) derive their capabilities from extensive training on vast corpora of visual and textual data. Empowered by large-scale parameters, these models often exhibit strong memorization of their training data,…

密码学与安全 · 计算机科学 2025-11-05 Jinhua Yin , Peiru Yang , Chen Yang , Huili Wang , Zhiyang Hu , Shangguang Wang , Yongfeng Huang , Tao Qi

Diffusion Language Models (DLMs) represent a promising alternative to autoregressive language models, using bidirectional masked token prediction. Yet their susceptibility to privacy leakage via Membership Inference Attacks (MIA) remains…

机器学习 · 计算机科学 2026-02-10 Yuetian Chen , Kaiyuan Zhang , Yuntao Du , Edoardo Stoppa , Charles Fleming , Ashish Kundu , Bruno Ribeiro , Ninghui Li