中文
相关论文

相关论文: Detecting Data Contamination in Large Language Mod…

200 篇论文

The rapid advancements of Large Language Models (LLMs) tightly associate with the expansion of the training data size. However, the unchecked ultra-large-scale training sets introduce a series of potential risks like data contamination,…

机器学习 · 计算机科学 2024-06-04 Wentao Ye , Jiaqi Hu , Liyao Li , Haobo Wang , Gang Chen , Junbo Zhao

The rapid scaling of large language models (LLMs) has raised concerns about the transparency and fair use of the data used in their pretraining. Detecting such content is challenging due to the scale of the data and limited exposure of each…

计算与语言 · 计算机科学 2025-05-26 Roy Xie , Junlin Wang , Ruomin Huang , Minxing Zhang , Rong Ge , Jian Pei , Neil Zhenqiang Gong , Bhuwan Dhingra

Membership Inference Attacks (MIAs) are widely used to quantify training data memorization and assess privacy risks. Standard evaluation requires repeated retraining, which is computationally costly for large models. One-run methods (single…

机器学习 · 计算机科学 2026-02-06 Mathieu Even , Clément Berenfeld , Linus Bleistein , Tudor Cebere , Julie Josse , Aurélien Bellet

Detecting LLM training data is generally framed as a membership inference attack (MIA) problem. However, conventional MIAs operate passively on fixed model weights, using log-likelihoods or text generations. In this work, we introduce…

机器学习 · 计算机科学 2026-02-24 Junjie Oscar Yin , John X. Morris , Vitaly Shmatikov , Sewon Min , Hannaneh Hajishirzi

Recently, adapting the idea of self-supervised learning (SSL) on continuous speech has started gaining attention. SSL models pre-trained on a huge amount of unlabeled audio can generate general-purpose representations that benefit a wide…

密码学与安全 · 计算机科学 2022-08-16 Wei-Cheng Tseng , Wei-Tsung Kao , Hung-yi Lee

Retrieval-augmented generation (RAG) mitigates the hallucination problem in large language models (LLMs) and has proven effective for personalized usages. However, delivering private retrieved documents directly to LLMs introduces…

计算与语言 · 计算机科学 2025-11-25 Yujin Choi , Youngjoo Park , Junyoung Byun , Jaewook Lee , Jinseong Park

Membership inference attacks (MIAs) against machine learning (ML) models aim to determine whether a given data point was part of the model training data. These attacks may pose significant privacy risks to individuals whose sensitive data…

密码学与安全 · 计算机科学 2025-11-24 Mona Khalil , Alberto Blanco-Justicia , Najeeb Jebreel , Josep Domingo-Ferrer

Large language models (LLMs) are increasingly deployed in interactive and retrieval-augmented settings, raising significant privacy concerns. While attacks such as Membership Inference (MIA), Attribute Inference (AIA), Data Extraction…

密码学与安全 · 计算机科学 2026-05-05 Karima Makhlouf , Lamiaa Basyoni , Syed Khaderi , Gabriel Marquez , Peter Sotomango , Mahmoud Awawdah , Sami Zhioua

Membership Inference Attack (MIA) determines the presence of a record in a machine learning model's training data by querying the model. Prior work has shown that the attack is feasible when the model is overfitted to its training data or…

密码学与安全 · 计算机科学 2018-02-15 Yunhui Long , Vincent Bindschaedler , Lei Wang , Diyue Bu , Xiaofeng Wang , Haixu Tang , Carl A. Gunter , Kai Chen

Large Language Models (LLMs) embed sensitive, human-generated data, prompting the need for unlearning methods. Although certified unlearning offers strong privacy guarantees, its restrictive assumptions make it unsuitable for LLMs, giving…

机器学习 · 计算机科学 2025-06-03 Rongzhe Wei , Mufei Li , Mohsen Ghassemi , Eleonora Kreačić , Yifan Li , Xiang Yue , Bo Li , Vamsi K. Potluru , Pan Li , Eli Chien

Questions of fair use of copyright-protected content to train Large Language Models (LLMs) are being actively debated. Document-level inference has been proposed as a new task: inferring from black-box access to the trained model whether a…

计算与语言 · 计算机科学 2024-06-06 Matthieu Meeus , Igor Shilov , Manuel Faysse , Yves-Alexandre de Montjoye

Vision-language models (VLMs) are trained on large-scale image-text corpora that may contain private, copyrighted, or otherwise sensitive data, motivating membership inference as a tool for training-data auditing. This is especially…

计算机视觉与模式识别 · 计算机科学 2026-05-14 Hongyi Tang , Zhihao Zhu , Yi Yang

Retrieval-Augmented Generation (RAG) and Supervised Finetuning (SFT) have become the predominant paradigms for equipping Large Language Models (LLMs) with external knowledge for diverse, knowledge-intensive tasks. However, while such…

密码学与安全 · 计算机科学 2025-12-04 Haowei Fu , Bo Ni , Han Xu , Kunpeng Liu , Dan Lin , Tyler Derr

Membership Inference Attacks (MIAs) are currently a dominant approach for evaluating privacy in machine learning applications. Despite their significance in identifying records belonging to the training dataset, several concerns remain…

机器学习 · 计算机科学 2026-01-23 Cristina Pêra , Tânia Carvalho , Maxime Cordy , Luís Antunes

Safety classifiers are essential safeguards within generative AI systems, filtering harmful content or identifying at-risk users when interacting with large language models. Despite their necessity, these models are trained on sensitive…

机器学习 · 计算机科学 2026-05-25 Anthony Hughes , Alexander Goldberg , Prince Jha , Adam Perer , Nikolaos Aletras , Niloofar Mireshghallah

Cognitive diagnosis models (CDMs) are pivotal for creating fine-grained learner profiles in modern intelligent education platforms. However, these models are trained on sensitive student data, raising significant privacy concerns. While…

密码学与安全 · 计算机科学 2025-11-10 Mingliang Hou , Yinuo Wang , Teng Guo , Zitao Liu , Wenzhou Dou , Jiaqi Zheng , Renqiang Luo , Mi Tian , Weiqi Luo

Recent studies have shown that deep learning models are vulnerable to membership inference attacks (MIAs), which aim to infer whether a data record was used to train a target model or not. To analyze and study these vulnerabilities, various…

机器学习 · 统计学 2025-08-12 Chenxu Zhao , Wei Qian , Aobo Chen , Mengdi Huai

Deep learning models often raise privacy concerns as they leak information about their training data. This enables an adversary to determine whether a data point was in a model's training set by conducting a membership inference attack…

机器学习 · 计算机科学 2020-06-11 Yigitcan Kaya , Sanghyun Hong , Tudor Dumitras

Federated Learning (FL) enables collaborative model training while keeping training data localized, allowing us to preserve privacy in various domains including remote sensing. However, recent studies show that FL models may still leak…

密码学与安全 · 计算机科学 2026-01-13 Anh-Kiet Duong , Petra Gomez-Krämer , Hoàng-Ân Lê , Minh-Tan Pham

Membership inference attacks (MIAs) aim to determine whether specific data were used to train a model. While extensively studied on classification models, their impact on time series forecasting remains largely unexplored. We address this…

机器学习 · 计算机科学 2026-02-13 Nicolas Johansson , Tobias Olsson , Daniel Nilsson , Johan Östman , Fazeleh Hoseini