English
Related papers

Related papers: Learning the Signature of Memorization in Autoregr…

200 papers

Membership inference attacks (MIAs) pose a critical threat to the privacy of training data in deep learning. Despite significant progress in attack methodologies, our understanding of when and how models encode membership information during…

Machine Learning · Computer Science 2025-08-05 Yuetian Chen , Zhiqi Wang , Nathalie Baracaldo , Swanand Ravindra Kadhe , Lei Yu

How much does a machine learning algorithm leak about its training data, and why? Membership inference attacks are used as an auditing tool to quantify this leakage. In this paper, we present a comprehensive \textit{hypothesis testing…

Machine Learning · Computer Science 2022-09-14 Jiayuan Ye , Aadyaa Maddi , Sasi Kumar Murakonda , Vincent Bindschaedler , Reza Shokri

Machine Learning (ML) has made unprecedented progress in the past several decades. However, due to the memorability of the training data, ML is susceptible to various attacks, especially Membership Inference Attacks (MIAs), the objective of…

Machine Learning · Computer Science 2022-05-16 Shuhao Li , Yajie Wang , Yuanzhang Li , Yu-an Tan

With the rapid advancement of deep learning technology, pre-trained encoder models have demonstrated exceptional feature extraction capabilities, playing a pivotal role in the research and application of deep learning. However, their…

Cryptography and Security · Computer Science 2025-06-09 Ruining Sun , Hongsheng Hu , Wei Luo , Zhaoxi Zhang , Yanjun Zhang , Haizhuan Yuan , Leo Yu Zhang

A number of recent works have demonstrated that API access to machine learning models leaks information about the dataset records used to train the models. Further, the work of \cite{somesh-overfit} shows that such membership inference…

Cryptography and Security · Computer Science 2019-10-15 Benjamin Zi Hao Zhao , Hassan Jameel Asghar , Raghav Bhaskar , Mohamed Ali Kaafar

Membership inference attacks (MIAs) against machine learning (ML) models aim to determine whether a given data point was part of the model training data. These attacks may pose significant privacy risks to individuals whose sensitive data…

Cryptography and Security · Computer Science 2025-11-24 Mona Khalil , Alberto Blanco-Justicia , Najeeb Jebreel , Josep Domingo-Ferrer

Multi-domain graph pre-training has emerged as a pivotal technique in developing graph foundation models. While it greatly improves the generalization of graph neural networks, its privacy risks under membership inference attacks (MIAs),…

Machine Learning · Computer Science 2025-11-25 Jiayi Luo , Qingyun Sun , Yuecen Wei , Haonan Yuan , Xingcheng Fu , Jianxin Li

As large language models (LLMs) are trained on increasingly opaque corpora, membership inference attacks (MIAs) have been proposed to audit whether copyrighted texts were used during training, despite growing concerns about their…

Cryptography and Security · Computer Science 2026-01-21 Murat Bilgehan Ertan , Emirhan Böge , Min Chen , Kaleel Mahmood , Marten van Dijk

Membership inference attacks allow adversaries to determine whether a particular example was contained in the model's training dataset. While previous works have confirmed the feasibility of such attacks in various applications, none has…

Cryptography and Security · Computer Science 2023-11-28 Guangke Chen , Yedi Zhang , Fu Song

Membership inference attacks (MIAs) threaten the privacy of machine learning models by revealing whether a specific data point was used during training. Existing MIAs often rely on impractical assumptions such as access to public datasets,…

Machine Learning · Computer Science 2026-02-24 Abdullah Caglar Oksuz , Anisa Halimi , Erman Ayday

Membership inference attacks (MIAs) on diffusion models have emerged as potential evidence of unauthorized data usage in training pre-trained diffusion models. These attacks aim to detect the presence of specific images in training datasets…

Machine Learning · Computer Science 2024-10-07 Chumeng Liang , Jiaxuan You

The primary promise of decentralized learning is to allow users to engage in the training of machine learning models in a collaborative manner while keeping their data on their premises and without relying on any central entity. However,…

Machine Learning · Computer Science 2025-11-14 Ousmane Touat , Jezekael Brunon , Yacine Belal , Julien Nicolas , César Sabater , Mohamed Maouche , Sonia Ben Mokhtar

To perform few-shot learning, language models extract signals from a few input-label pairs, aggregate these into a learned prediction rule, and apply this rule to new inputs. How is this implemented in the forward pass of modern transformer…

Machine Learning · Computer Science 2025-10-10 Xinyan Hu , Kayo Yin , Michael I. Jordan , Jacob Steinhardt , Lijie Chen

In a membership inference attack (MIA), an attacker exploits the overconfidence exhibited by typical machine learning models to determine whether a specific data point was used to train a target model. In this paper, we analyze the…

Information Theory · Computer Science 2025-06-10 Meiyi Zhu , Caili Guo , Chunyan Feng , Osvaldo Simeone

Machine learning poses severe privacy concerns as it has been shown that the learned models can reveal sensitive information about their training data. Many works have investigated the effect of widely adopted data augmentation and…

Machine Learning · Computer Science 2024-03-26 Xiao Li , Qiongxiu Li , Zhanhao Hu , Xiaolin Hu

In the text processing context, most ML models are built on word embeddings. These embeddings are themselves trained on some datasets, potentially containing sensitive data. In some cases this training is done independently, in other cases,…

Computation and Language · Computer Science 2021-06-23 Saeed Mahloujifar , Huseyin A. Inan , Melissa Chase , Esha Ghosh , Marcello Hasegawa

Training a machine learning model with data following a meaningful order, i.e., from easy to hard, has been proven to be effective in accelerating the training process and achieving better model performance. The key enabling technique is…

Cryptography and Security · Computer Science 2023-10-17 Joann Qiongna Chen , Xinlei He , Zheng Li , Yang Zhang , Zhou Li

We propose new methodologies for both unlearning random set of samples and class unlearning and show that they outperform existing methods. The main driver of our unlearning methods is the similarity of predictions to a retrained model on…

Machine Learning · Computer Science 2025-12-09 Ali Ebrahimpour-Boroojeny

Among all privacy attacks against Machine Learning (ML), membership inference attacks (MIA) attracted the most attention. In these attacks, the attacker is given an ML model and a data point, and they must infer whether the data point was…

Cryptography and Security · Computer Science 2025-12-02 Bram van Dartel , Marc Damie , Florian Hahn

Image AutoRegressive generation has emerged as a new powerful paradigm with image autoregressive models (IARs) matching state-of-the-art diffusion models (DMs) in image quality (FID: 1.48 vs. 1.58) while allowing for a higher generation…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Antoni Kowalczuk , Jan Dubiński , Franziska Boenisch , Adam Dziedzic