English
Related papers

Related papers: Win-k: Improved Membership Inference Attacks on Sm…

200 papers

All prior membership inference attacks for fine-tuned language models use hand-crafted heuristics (e.g., loss thresholding, Min-K\%, reference calibration), each bounded by the designer's intuition. We introduce the first transferable…

Computation and Language · Computer Science 2026-04-06 David Ilić , Kostadin Cvejoski , David Stanojević , Evgeny Grigorenko

Large language models (LLMs) are increasingly augmented with long-term memory systems to overcome finite context windows and enable persistent reasoning across interactions. However, recent research finds that LLMs become more vulnerable…

Machine Learning · Computer Science 2026-02-18 Mitchell Piehl , Zhaohan Xi , Zuobin Xiong , Pan He , Muchao Ye

The problem of pre-training data detection for large language models (LLMs) has received growing attention due to its implications in critical issues like copyright violation and test data contamination. Despite improved performance,…

Computation and Language · Computer Science 2025-02-13 Jingyang Zhang , Jingwei Sun , Eric Yeats , Yang Ouyang , Martin Kuo , Jianyi Zhang , Hao Frank Yang , Hai Li

Most existing membership inference attacks (MIAs) utilize metrics (e.g., loss) calculated on the model's final state, while recent advanced attacks leverage metrics computed at various stages, including both intermediate and final stages,…

Cryptography and Security · Computer Science 2024-07-23 Hao Li , Zheng Li , Siyuan Wu , Chengrui Hu , Yutong Ye , Min Zhang , Dengguo Feng , Yang Zhang

Retrieval-augmented generation (RAG) has become central to large language model (LLM) deployments, grounding responses in enterprise or proprietary data to reduce hallucinations. However, this design introduces a new privacy risk: model…

Cryptography and Security · Computer Science 2026-05-26 Nguyen Linh Bao Nguyen , Wanlun Ma , Viet Vo , Alsharif Abuadbba , Minghong Fang , Jun Zhang , Yang Xiang

A membership inference attack (MIA) against a machine-learning model enables an attacker to determine whether a given data record was part of the model's training data or not. In this paper, we provide an in-depth study of the phenomenon of…

Machine Learning · Computer Science 2021-09-20 Bogdan Kulynych , Mohammad Yaghini , Giovanni Cherubin , Michael Veale , Carmela Troncoso

Cognitive diagnosis models (CDMs) are pivotal for creating fine-grained learner profiles in modern intelligent education platforms. However, these models are trained on sensitive student data, raising significant privacy concerns. While…

Cryptography and Security · Computer Science 2025-11-10 Mingliang Hou , Yinuo Wang , Teng Guo , Zitao Liu , Wenzhou Dou , Jiaqi Zheng , Renqiang Luo , Mi Tian , Weiqi Luo

Transfer learning, successful in knowledge translation across related tasks, faces a substantial privacy threat from membership inference attacks (MIAs). These attacks, despite posing significant risk to ML model's training data, remain…

Cryptography and Security · Computer Science 2025-01-22 Cong Wu , Jing Chen , Qianru Fang , Kun He , Ziming Zhao , Hao Ren , Guowen Xu , Yang Liu , Yang Xiang

Membership Inference Attack (MIA) determines the presence of a record in a machine learning model's training data by querying the model. Prior work has shown that the attack is feasible when the model is overfitted to its training data or…

Cryptography and Security · Computer Science 2018-02-15 Yunhui Long , Vincent Bindschaedler , Lei Wang , Diyue Bu , Xiaofeng Wang , Haixu Tang , Carl A. Gunter , Kai Chen

Large vision-language models (LVLMs) have demonstrated outstanding performance in many downstream tasks. However, LVLMs are trained on large-scale datasets, which can pose privacy risks if training images contain sensitive information.…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Zongyu Wu , Minhua Lin , Zhiwei Zhang , Fali Wang , Xianren Zhang , Xiang Zhang , Suhang Wang

Machine learning models are susceptible to membership inference attacks (MIAs), which aim to infer whether a sample is in the training set. Existing work utilizes gradient ascent to enlarge the loss variance of training data, alleviating…

Machine Learning · Computer Science 2024-06-19 Zhenlong Liu , Lei Feng , Huiping Zhuang , Xiaofeng Cao , Hongxin Wei

Federated Learning enables collaborative learning among clients via a coordinating server while avoiding direct data sharing, offering a perceived solution to preserve privacy. However, recent studies on Membership Inference Attacks (MIAs)…

Cryptography and Security · Computer Science 2025-08-04 Quan Nguyen , Minh N. Vu , Truc Nguyen , My T. Thai

Large Language Models (LLMs) and Multimodal Large Language Models (MLLMs) have made significant advancements in reasoning capabilities. However, they still face challenges such as high computational demands and privacy concerns. This paper…

Membership Inference Attacks (MIAs) serve as a fundamental auditing tool for evaluating training data leakage in machine learning models. However, existing methodologies predominantly rely on static, handcrafted heuristics that lack…

Cryptography and Security · Computer Science 2026-04-02 Ruhao Liu , Weiqi Huang , Qi Li , Xinchao Wang

Recently, large language models (LLMs) have been gaining a lot of interest due to their adaptability and extensibility in emerging applications, including communication networks. It is anticipated that ZSM networks will be able to support…

Cryptography and Security · Computer Science 2025-01-07 Sunder Ali Khowaja , Parus Khuwaja , Kapal Dev , Hussam Al Hamadi , Engin Zeydan

Membership Inference Attacks (MIAs) pose a significant privacy risk by enabling adversaries to determine if a specific data point was part of a model's training set. This work empirically investigates whether MU algorithms can function as a…

Membership inference attacks allow adversaries to determine whether a particular example was contained in the model's training dataset. While previous works have confirmed the feasibility of such attacks in various applications, none has…

Cryptography and Security · Computer Science 2023-11-28 Guangke Chen , Yedi Zhang , Fu Song

The rapid scaling of large language models (LLMs) has raised concerns about the transparency and fair use of the data used in their pretraining. Detecting such content is challenging due to the scale of the data and limited exposure of each…

Computation and Language · Computer Science 2025-05-26 Roy Xie , Junlin Wang , Ruomin Huang , Minxing Zhang , Rong Ge , Jian Pei , Neil Zhenqiang Gong , Bhuwan Dhingra

Machine learning models can leak private information about their training data. The standard methods to measure this privacy risk, based on membership inference attacks (MIAs), only check if a given data point \textit{exactly} matches a…

Machine Learning · Computer Science 2025-09-11 Jiashu Tao , Reza Shokri

Large Reasoning Models (LRMs) have rapidly gained prominence for their strong performance in solving complex tasks. Many modern black-box LRMs expose the intermediate reasoning traces through APIs to improve transparency (e.g., Gemini-2.5…

Cryptography and Security · Computer Science 2026-01-21 Ruihan Hu , Yu-Ming Shang , Wei Luo , Ye Tao , Xi Zhang