English
Related papers

Related papers: PerProb: Indirectly Evaluating Memorization in Lar…

200 papers

Machine learning models can leak private information about their training data. The standard methods to measure this privacy risk, based on membership inference attacks (MIAs), only check if a given data point \textit{exactly} matches a…

Machine Learning · Computer Science 2025-09-11 Jiashu Tao , Reza Shokri

Membership inference attacks (MIAs) aim to infer whether a data point has been used to train a machine learning model. These attacks can be employed to identify potential privacy vulnerabilities and detect unauthorized use of personal data.…

Machine Learning · Computer Science 2023-10-03 Myeongseob Ko , Ming Jin , Chenguang Wang , Ruoxi Jia

Membership inference attacks (MIAs) have become the standard tool for evaluating privacy leakage in machine learning (ML). Among them, the Likelihood-Ratio Attack (LiRA) is widely regarded as the state of the art when sufficient shadow…

Cryptography and Security · Computer Science 2026-03-10 Najeeb Jebreel , Mona Khalil , David Sánchez , Josep Domingo-Ferrer

Training a machine learning model with data following a meaningful order, i.e., from easy to hard, has been proven to be effective in accelerating the training process and achieving better model performance. The key enabling technique is…

Cryptography and Security · Computer Science 2023-10-17 Joann Qiongna Chen , Xinlei He , Zheng Li , Yang Zhang , Zhou Li

With the rapid advancement of deep learning technology, pre-trained encoder models have demonstrated exceptional feature extraction capabilities, playing a pivotal role in the research and application of deep learning. However, their…

Cryptography and Security · Computer Science 2025-06-09 Ruining Sun , Hongsheng Hu , Wei Luo , Zhaoxi Zhang , Yanjun Zhang , Haizhuan Yuan , Leo Yu Zhang

Large capacity machine learning (ML) models are prone to membership inference attacks (MIAs), which aim to infer whether the target sample is a member of the target model's training dataset. The serious privacy concerns due to the…

Machine Learning · Computer Science 2021-01-01 Virat Shejwalkar , Amir Houmansadr

Membership Inference Attacks (MIAs) infer whether a data point is in the training data of a machine learning model. It is a threat while being in the training data is private information of a data point. MIA correctly infers some data…

Cryptography and Security · Computer Science 2022-10-31 Mauro Conti , Jiaxin Li , Stjepan Picek

Membership inference attacks (MIAs) test whether a target data record belongs to a system's private data, and have become a standard tool to measure privacy leakage in machine learning systems. Prior work has primarily focused on training…

Cryptography and Security · Computer Science 2026-05-28 Kai Chen , Yan Pang , Tianhao Wang

Vision-Language Models (VLMs) have achieved remarkable success, yet their reliance on massive datasets and unintended memorization of training data raise significant data security risk. Membership Inference Attacks (MIAs) aim to assess…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Jiaqing Li , Yajuan Lu , Xiaochuan Shi , Gang Wu , ZhongYuan Wang , Chao Liang

Diffusion Language Models (DLMs) represent a promising alternative to autoregressive language models, using bidirectional masked token prediction. Yet their susceptibility to privacy leakage via Membership Inference Attacks (MIA) remains…

Machine Learning · Computer Science 2026-02-10 Yuetian Chen , Kaiyuan Zhang , Yuntao Du , Edoardo Stoppa , Charles Fleming , Ashish Kundu , Bruno Ribeiro , Ninghui Li

With the rise of large language models (LLMs), increasing research has recognized their risk of leaking personally identifiable information (PII) under malicious attacks. Although efforts have been made to protect PII in LLMs, existing…

Computation and Language · Computer Science 2025-03-12 Martin Kuo , Jingyang Zhang , Jianyi Zhang , Minxue Tang , Louis DiValentin , Aolin Ding , Jingwei Sun , William Chen , Amin Hass , Tianlong Chen , Yiran Chen , Hai Li

Membership Inference Attacks (MIAs) have emerged as a valuable framework for evaluating privacy leakage by machine learning models. Score-based MIAs are distinguished, in particular, by their ability to exploit the confidence scores that…

Machine Learning · Computer Science 2025-02-28 Gauri Pradhan , Joonas Jälkö , Marlon Tobaben , Antti Honkela

Federated large language models (FedLLMs) enable cross-silo collaborative training among institutions while preserving data locality, making them appealing for privacy-sensitive domains such as law, finance, and healthcare. However, the…

Computation and Language · Computer Science 2026-02-26 Yingqi Hu , Zhuo Zhang , Jingyuan Zhang , Jinghua Wang , Qifan Wang , Lizhen Qu , Zenglin Xu

Transfer learning, successful in knowledge translation across related tasks, faces a substantial privacy threat from membership inference attacks (MIAs). These attacks, despite posing significant risk to ML model's training data, remain…

Cryptography and Security · Computer Science 2025-01-22 Cong Wu , Jing Chen , Qianru Fang , Kun He , Ziming Zhao , Hao Ren , Guowen Xu , Yang Liu , Yang Xiang

With the rapid advancements of large-scale text-to-image diffusion models, various practical applications have emerged, bringing significant convenience to society. However, model developers may misuse the unauthorized data to train…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Qiao Li , Xiaomeng Fu , Xi Wang , Jin Liu , Xingyu Gao , Jiao Dai , Jizhong Han

Membership Inference Attacks (MIAs) have recently been employed to determine whether a specific text was part of the pre-training data of Large Language Models (LLMs). However, existing methods often misinfer non-members as members, leading…

Machine Learning · Computer Science 2025-05-07 Saleh Zare Zade , Yao Qiang , Xiangyu Zhou , Hui Zhu , Mohammad Amin Roshani , Prashant Khanduri , Dongxiao Zhu

Determining whether a dataset was part of a machine learning model's training data pool can reveal privacy vulnerabilities, a challenge often addressed through membership inference attacks (MIAs). Traditional MIAs typically require access…

Machine Learning · Computer Science 2025-06-03 Yongchao Huang

Membership inference attacks (MIA) try to detect if data samples were used to train a neural network model, e.g. to detect copyright abuses. We show that models with higher dimensional input and output are more vulnerable to MIA, and…

Machine Learning · Computer Science 2021-08-19 Avital Shafran , Shmuel Peleg , Yedid Hoshen

Membership inference attacks (MIAs) aim to determine whether a specific example was used to train a given language model. While prior work has explored prompt-based attacks such as ReCALL, these methods rely heavily on the assumption that…

Computation and Language · Computer Science 2026-01-27 Gyuwan Kim , Yang Li , Evangelia Spiliopoulou , Jie Ma , William Yang Wang

The rapid advancement of large language models (LLMs) has revolutionized natural language processing, enabling applications in diverse domains such as healthcare, finance and education. However, the growing reliance on extensive data for…

Cryptography and Security · Computer Science 2024-12-10 Guoshenghui Zhao , Eric Song