English
Related papers

Related papers: Learning the Signature of Memorization in Autoregr…

200 papers

Membership inference attacks (MIAs) aim to determine whether a sample was part of a model's training set, posing serious privacy risks for modern machine-learning systems. Existing MIAs primarily rely on static indicators, such as loss or…

Artificial Intelligence · Computer Science 2026-02-06 Amit Kravchik Taub , Fred M. Grabovski , Guy Amit , Yisroel Mirsky

Membership inference attacks (MIAs) aim to determine whether a specific example was used to train a given language model. While prior work has explored prompt-based attacks such as ReCALL, these methods rely heavily on the assumption that…

Computation and Language · Computer Science 2026-01-27 Gyuwan Kim , Yang Li , Evangelia Spiliopoulou , Jie Ma , William Yang Wang

Large vision-language models (LVLMs) derive their capabilities from extensive training on vast corpora of visual and textual data. Empowered by large-scale parameters, these models often exhibit strong memorization of their training data,…

Cryptography and Security · Computer Science 2025-11-05 Jinhua Yin , Peiru Yang , Chen Yang , Huili Wang , Zhiyang Hu , Shangguang Wang , Yongfeng Huang , Tao Qi

Membership Inference Attacks (MIAs) determine whether a specific data point was included in the training set of a target model. In this paper, we introduce the Semantic Membership Inference Attack (SMIA), a novel approach that enhances MIA…

Machine Learning · Computer Science 2024-06-17 Hamid Mozaffari , Virendra J. Marathe

Masked Diffusion Language Models MDLMs replace autoregressive generation with iterative demasking and their privacy properties are largely unstudied. We study membership inference attacks MIA on fine tuned MDLMs and show they are…

Machine Learning · Computer Science 2026-05-20 Shailesh Kasivelrajan

Recent work in the privacy literature shows that sample-targeted membership inference attacks (MIAs) significantly outperform untargeted approaches by a wide margin. Motivated by this observation, we address the following question: can the…

Machine Learning · Statistics 2026-05-27 Valentin Dorseuil , Jamal Atif , Olivier Cappé

The high cost of model training makes it increasingly desirable to develop techniques for unlearning. These techniques seek to remove the influence of a training example without having to retrain the model from scratch. Intuitively, once a…

Machine Learning · Computer Science 2024-05-22 Jamie Hayes , Ilia Shumailov , Eleni Triantafillou , Amr Khalifa , Nicolas Papernot

The rapid advancement of diffusion-based image generation models has raised serious concerns regarding potential copyright and privacy infringements involving human-created data. Membership inference attacks (MIAs) have emerged as a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Tao Qi , Huili Wang , Yuanhong Huang , Wendan Wang , Lianchao Zhao , Jinrui Wang , Zichen Qin , Shangguang Wang , Yongfeng Huang

Transfer learning (TL) has been demonstrated to improve DNN model performance when faced with a scarcity of training samples. However, the suitability of TL as a solution to reduce vulnerability of overfitted DNNs to privacy attacks is…

Membership Inference Attacks (MIAs) on pre-trained Large Language Models (LLMs) aim at determining if a data point was part of the model's training set. Prior MIAs that are built for classification models fail at LLMs, due to ignoring the…

Computation and Language · Computer Science 2025-09-17 Hongyan Chang , Ali Shahin Shamsabadi , Kleomenis Katevas , Hamed Haddadi , Reza Shokri

Large language models (LLMs) are trained on massive web-scale corpora, raising growing concerns about privacy and copyright. Membership inference attacks (MIAs) aim to determine whether a given example was used during training. Existing LLM…

Machine Learning · Computer Science 2026-04-02 Ravi Ranjan , Utkarsh Grover , Xiaomin Lin , Agoritsa Polyzou

Most existing membership inference attacks (MIAs) utilize metrics (e.g., loss) calculated on the model's final state, while recent advanced attacks leverage metrics computed at various stages, including both intermediate and final stages,…

Cryptography and Security · Computer Science 2024-07-23 Hao Li , Zheng Li , Siyuan Wu , Chengrui Hu , Yutong Ye , Min Zhang , Dengguo Feng , Yang Zhang

Membership inference attacks (MIAs) aim to determine whether a specific data point was part of a model's training set, serving as effective tools for evaluating privacy leakage of vision models. However, existing MIAs implicitly assume…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Ruize Gao , Kaiwen Zhou , Yongqiang Chen , Feng Liu

While being deployed in many critical applications as core components, machine learning (ML) models are vulnerable to various security and privacy attacks. One major privacy attack in this domain is membership inference, where an adversary…

Cryptography and Security · Computer Science 2020-09-11 Yang Zou , Zhikun Zhang , Michael Backes , Yang Zhang

The rise of Large Language Models (LLMs) has triggered legal and ethical concerns, especially regarding the unauthorized use of copyrighted materials in their training datasets. This has led to lawsuits against tech companies accused of…

Cryptography and Security · Computer Science 2025-01-17 Cédric Eichler , Nathan Champeil , Nicolas Anciaux , Alexandra Bensamoun , Heber Hwang Arcolezi , José Maria De Fuentes

As the capabilities of pre-trained large language models (LLMs) continue to advance, the "pre-train and fine-tune" paradigm has become increasingly mainstream, leading to the development of various fine-tuning methods. However, the privacy…

Computation and Language · Computer Science 2025-07-02 Jie Hou , Chuxiong Wu , Lannan Luo , Qiang Zeng

Large language models (LLMs) are increasingly trained on tabular data, which, unlike unstructured text, often contains personally identifiable information (PII) in a highly structured and explicit format. As a result, privacy risks arise,…

Cryptography and Security · Computer Science 2025-07-24 Eyal German , Sagiv Antebi , Daniel Samira , Asaf Shabtai , Yuval Elovici

Membership inference attack is one of the most popular privacy attacks in machine learning, which aims to predict whether a given sample was contained in the target model's training set. Label-only membership inference attack is a variant…

Machine Learning · Computer Science 2023-06-08 JiaCheng Xu , ChengXiang Tan

The proliferation of large language models (LLMs) in the real world has come with a rise in copyright cases against companies for training their models on unlicensed data from the internet. Recent works have presented methods to identify if…

Machine Learning · Computer Science 2024-06-11 Pratyush Maini , Hengrui Jia , Nicolas Papernot , Adam Dziedzic

Most membership inference attacks (MIAs) against Large Language Models (LLMs) rely on global signals, like average loss, to identify training data. This approach, however, dilutes the subtle, localized signals of memorization, reducing…

Computation and Language · Computer Science 2026-03-09 Yuetian Chen , Yuntao Du , Kaiyuan Zhang , Ashish Kundu , Charles Fleming , Bruno Ribeiro , Ninghui Li