English
Related papers

Related papers: Membership Inference Attacks on Tokenizers of Larg…

200 papers

Membership Inference Attacks (MIAs) on pre-trained Large Language Models (LLMs) aim at determining if a data point was part of the model's training set. Prior MIAs that are built for classification models fail at LLMs, due to ignoring the…

Computation and Language · Computer Science 2025-09-17 Hongyan Chang , Ali Shahin Shamsabadi , Kleomenis Katevas , Hamed Haddadi , Reza Shokri

Membership inference attack (MIA) has become one of the most widely used and effective methods for evaluating the privacy risks of machine learning models. These attacks aim to determine whether a specific sample is part of the model's…

Cryptography and Security · Computer Science 2025-06-04 Jing Xue , Zhishen Sun , Haishan Ye , Luo Luo , Xiangyu Chang , Ivor Tsang , Guang Dai

Adapting Large Language Models (LLMs) to specific tasks introduces concerns about computational efficiency, prompting an exploration of efficient methods such as In-Context Learning (ICL). However, the vulnerability of ICL to privacy…

Cryptography and Security · Computer Science 2024-09-04 Rui Wen , Zheng Li , Michael Backes , Yang Zhang

The proliferation of large language models (LLMs) in the real world has come with a rise in copyright cases against companies for training their models on unlicensed data from the internet. Recent works have presented methods to identify if…

Machine Learning · Computer Science 2024-06-11 Pratyush Maini , Hengrui Jia , Nicolas Papernot , Adam Dziedzic

The rise of Large Language Models (LLMs) has triggered legal and ethical concerns, especially regarding the unauthorized use of copyrighted materials in their training datasets. This has led to lawsuits against tech companies accused of…

Cryptography and Security · Computer Science 2025-01-17 Cédric Eichler , Nathan Champeil , Nicolas Anciaux , Alexandra Bensamoun , Heber Hwang Arcolezi , José Maria De Fuentes

Recent advances in Large Language Models (LLMs) have enabled them to overcome their context window limitations, and demonstrate exceptional retrieval and reasoning capacities on longer context. Quesion-answering systems augmented with…

Computation and Language · Computer Science 2024-11-19 Zixiong Wang , Gaoyang Liu , Yang Yang , Chen Wang

Transfer learning, successful in knowledge translation across related tasks, faces a substantial privacy threat from membership inference attacks (MIAs). These attacks, despite posing significant risk to ML model's training data, remain…

Cryptography and Security · Computer Science 2025-01-22 Cong Wu , Jing Chen , Qianru Fang , Kun He , Ziming Zhao , Hao Ren , Guowen Xu , Yang Liu , Yang Xiang

Membership inference attacks (MIAs) pose a serious threat to the privacy of machine learning models by allowing adversaries to determine whether a specific data sample was included in the training set. Although federated learning (FL) is…

Cryptography and Security · Computer Science 2026-01-27 Mohammad Zare , Pirooz Shamsinejadbabaki

Large Reasoning Models (LRMs) have rapidly gained prominence for their strong performance in solving complex tasks. Many modern black-box LRMs expose the intermediate reasoning traces through APIs to improve transparency (e.g., Gemini-2.5…

Cryptography and Security · Computer Science 2026-01-21 Ruihan Hu , Yu-Ming Shang , Wei Luo , Ye Tao , Xi Zhang

The potential of transformer-based LLMs risks being hindered by privacy concerns due to their reliance on extensive datasets, possibly including sensitive information. Regulatory measures like GDPR and CCPA call for using robust auditing…

Cryptography and Security · Computer Science 2024-06-25 Filippo Galli , Luca Melis , Tommaso Cucinotta

OpenLVLM-MIA is a new benchmark that highlights fundamental challenges in evaluating membership inference attacks (MIA) against large vision-language models (LVLMs). While prior work has reported high attack success rates, our analysis…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Ryoto Miyamoto , Xin Fan , Fuyuko Kido , Tsuneo Matsumoto , Hayato Yamana

Large language models (LLMs) based recommender systems (RecSys) can adapt to different domains flexibly. It utilizes in-context learning (ICL), i.e., prompts, to customize the recommendation functions, which include sensitive historical…

Information Retrieval · Computer Science 2026-01-23 Jiajie He , Min-Chun Chen , Xintong Chen , Xinyang Fang , Yuechun Gu , Keke Chen

Large Language Models (LLMs) utilize large amounts of data for their training, some of which may come from copyrighted sources. Membership Inference Attacks (MIA) aim to detect those documents and whether they have been included in the…

Artificial Intelligence · Computer Science 2026-04-22 Juliusz Janicki , Savvas Chamezopoulos , Evangelos Kanoulas , Georgios Tsatsaronis

Video large language models (VideoLLMs) are increasingly trained or instruction-tuned on large-scale video--text corpora collected from heterogeneous sources, raising an immediate privacy question: can an external auditor determine whether…

Cryptography and Security · Computer Science 2026-05-01 Wei Song , Yuxin Cao , Ziqi Ding , Yi Liu , Gelei Deng , Yuekang Li

With the widespread application of large language models (LLM), concerns about the privacy leakage of model training data have increasingly become a focus. Membership Inference Attacks (MIAs) have emerged as a critical tool for evaluating…

Robotics · Computer Science 2024-12-24 Zichen Song , Sitan Huang , Zhongfeng Kang

Membership Inference Attacks (MIAs) act as a crucial auditing tool for the opaque training data of Large Language Models (LLMs). However, existing techniques predominantly rely on inaccessible model internals (e.g., logits) or suffer from…

Computation and Language · Computer Science 2026-01-19 Jiatong Yi , Yanyang Li

Small language models (SLMs) are increasingly valued for their efficiency and deployability in resource-constrained environments, making them useful for on-device, privacy-sensitive, and edge computing applications. On the other hand,…

Artificial Intelligence · Computer Science 2025-08-05 Roya Arkhmammadova , Hosein Madadi Tamar , M. Emre Gursoy

Large language models (LLMs) are trained on massive corpora that may contain sensitive information, creating privacy risks under membership inference attacks (MIAs). Knowledge distillation is widely used to compress LLMs into smaller…

Machine Learning · Computer Science 2026-01-13 Ziyao Cui , Minxing Zhang , Jian Pei

The lack of data transparency in Large Language Models (LLMs) has highlighted the importance of Membership Inference Attack (MIA), which differentiates trained (member) and untrained (non-member) data. Though it shows success in previous…

Computation and Language · Computer Science 2024-12-19 Bowen Chen , Namgi Han , Yusuke Miyao

Membership inference attacks (MIA) can reveal whether a particular data point was part of the training dataset, potentially exposing sensitive information about individuals. This article provides theoretical guarantees by exploring the…

Machine Learning · Statistics 2025-10-08 Eric Aubinais , Elisabeth Gassiat , Pablo Piantanida