English
Related papers

Related papers: Learning the Signature of Memorization in Autoregr…

200 papers

Diffusion Language Models (DLMs) represent a promising alternative to autoregressive language models, using bidirectional masked token prediction. Yet their susceptibility to privacy leakage via Membership Inference Attacks (MIA) remains…

Machine Learning · Computer Science 2026-02-10 Yuetian Chen , Kaiyuan Zhang , Yuntao Du , Edoardo Stoppa , Charles Fleming , Ashish Kundu , Bruno Ribeiro , Ninghui Li

Membership inference attacks (MIAs) are widely used to assess the privacy risks associated with machine learning models. However, when these attacks are applied to pre-trained large language models (LLMs), they encounter significant…

Cryptography and Security · Computer Science 2026-05-26 Meng Tong , Yuntao Du , Kejiang Chen , Weiming Zhang , Ninghui Li

Generative models based on the Flow Matching objective, particularly Rectified Flow, have emerged as a dominant paradigm for efficient, high-fidelity image synthesis. However, while existing research heavily prioritizes generation quality…

Machine Learning · Computer Science 2026-03-17 Mingxing Rao , Daniel Moyer

Large Language Models (LLMs) utilize large amounts of data for their training, some of which may come from copyrighted sources. Membership Inference Attacks (MIA) aim to detect those documents and whether they have been included in the…

Artificial Intelligence · Computer Science 2026-04-22 Juliusz Janicki , Savvas Chamezopoulos , Evangelos Kanoulas , Georgios Tsatsaronis

Membership inference attacks (MIAs), which enable adversaries to determine whether specific data points were part of a model's training dataset, have emerged as an important framework to understand, assess, and quantify the potential…

Cryptography and Security · Computer Science 2026-03-23 Toan Tran , Olivera Kotevska , Li Xiong

Membership inference attacks (MIA) attempt to verify the membership of a given data sample in the training set for a model. MIA has become relevant in recent years, following the rapid development of large language models (LLM). Many are…

Computation and Language · Computer Science 2025-02-04 Haritz Puerto , Martin Gubri , Sangdoo Yun , Seong Joon Oh

Diffusion models have achieved remarkable progress in image generation, but their increasing deployment raises serious concerns about privacy. In particular, fine-tuned models are highly vulnerable, as they are often fine-tuned on small and…

Cryptography and Security · Computer Science 2026-01-30 Puwei Lian , Yujun Cai , Songze Li , Bingkun Bao

The lack of data transparency in Large Language Models (LLMs) has highlighted the importance of Membership Inference Attack (MIA), which differentiates trained (member) and untrained (non-member) data. Though it shows success in previous…

Computation and Language · Computer Science 2024-12-19 Bowen Chen , Namgi Han , Yusuke Miyao

Membership inference attacks (MIAs) have become the standard tool for evaluating privacy leakage in machine learning (ML). Among them, the Likelihood-Ratio Attack (LiRA) is widely regarded as the state of the art when sufficient shadow…

Cryptography and Security · Computer Science 2026-03-10 Najeeb Jebreel , Mona Khalil , David Sánchez , Josep Domingo-Ferrer

A Membership Inference Attack (MIA) assesses how much a target machine learning model reveals about its training data by determining whether specific query instances were part of the training set. State-of-the-art MIAs rely on training…

Cryptography and Security · Computer Science 2026-01-13 Yuntao Du , Yuetian Chen , Hanshen Xiao , Bruno Ribeiro , Ninghui Li

Membership inference attacks (MIAs) attempt to predict whether a particular datapoint is a member of a target model's training data. Despite extensive research on traditional machine learning models, there has been limited work studying MIA…

Membership Inference Attack (MIA) aims to determine whether a specific data sample was included in the training dataset of a target model. Traditional MIA approaches rely on shadow models to mimic target model behavior, but their…

Information Retrieval · Computer Science 2026-03-20 Li Cuihong , Huang Xiaowen , Yin Chuanhuan , Sang Jitao

Detecting LLM training data is generally framed as a membership inference attack (MIA) problem. However, conventional MIAs operate passively on fixed model weights, using log-likelihoods or text generations. In this work, we introduce…

Machine Learning · Computer Science 2026-02-24 Junjie Oscar Yin , John X. Morris , Vitaly Shmatikov , Sewon Min , Hannaneh Hajishirzi

Transfer learning, successful in knowledge translation across related tasks, faces a substantial privacy threat from membership inference attacks (MIAs). These attacks, despite posing significant risk to ML model's training data, remain…

Cryptography and Security · Computer Science 2025-01-22 Cong Wu , Jing Chen , Qianru Fang , Kun He , Ziming Zhao , Hao Ren , Guowen Xu , Yang Liu , Yang Xiang

Machine learning models are known to leak sensitive information, as they inevitably memorize (parts of) their training data. More alarmingly, large language models (LLMs) are now trained on nearly all available data, which amplifies the…

Machine Learning · Computer Science 2025-10-10 Jiashu Tao , Reza Shokri

Membership inference attacks (MIAs) on code completion models offer an effective way to assess privacy risks by inferring whether a given code snippet was part of the training data. Existing black- and gray-box MIAs rely on expensive…

Software Engineering · Computer Science 2025-11-20 Yuan Jiang , Zehao Li , Shan Huang , Christoph Treude , Xiaohong Su , Tiantian Wang

Membership inference attacks (MIAs) pose a critical privacy threat to fine-tuned large language models (LLMs), especially when models are adapted to domain-specific tasks using sensitive data. While prior black-box MIA techniques rely on…

Cryptography and Security · Computer Science 2025-12-23 Zhexi Lu , Hongliang Chi , Nathalie Baracaldo , Swanand Ravindra Kadhe , Yuseok Jeon , Lei Yu

Small language models (SLMs) are increasingly valued for their efficiency and deployability in resource-constrained environments, making them useful for on-device, privacy-sensitive, and edge computing applications. On the other hand,…

Artificial Intelligence · Computer Science 2025-08-05 Roya Arkhmammadova , Hosein Madadi Tamar , M. Emre Gursoy

Machine learning (ML) models have been widely applied to various applications, including image classification, text generation, audio recognition, and graph data analysis. However, recent studies have shown that ML models are vulnerable to…

Machine Learning · Computer Science 2022-02-04 Hongsheng Hu , Zoran Salcic , Lichao Sun , Gillian Dobbie , Philip S. Yu , Xuyun Zhang

The rise of generative image models leads to privacy concerns when it comes to the huge datasets used to train such models. This paper investigates the possibility of inferring if a set of face images was used for fine-tuning a Latent…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Lauritz Christian Holme , Anton Mosquera Storgaard , Siavash Arjomand Bigdeli