English
Related papers

Related papers: Membership Inference Attacks against Synthetic Dat…

200 papers

The proliferation of large language models (LLMs) in the real world has come with a rise in copyright cases against companies for training their models on unlicensed data from the internet. Recent works have presented methods to identify if…

Machine Learning · Computer Science 2024-06-11 Pratyush Maini , Hengrui Jia , Nicolas Papernot , Adam Dziedzic

Foundation-style ECG encoders pretrained with self-supervised learning are increasingly reused across tasks, institutions, and deployment contexts, often through model-as-a-service interfaces that expose scalar scores or latent…

Machine learning models have been shown to leak information violating the privacy of their training set. We focus on membership inference attacks on machine learning models which aim to determine whether a data point was used to train the…

Cryptography and Security · Computer Science 2020-09-02 Shadi Rahimian , Tribhuvanesh Orekondy , Mario Fritz

Machine learning poses severe privacy concerns as it has been shown that the learned models can reveal sensitive information about their training data. Many works have investigated the effect of widely adopted data augmentation and…

Machine Learning · Computer Science 2024-03-26 Xiao Li , Qiongxiu Li , Zhanhao Hu , Xiaolin Hu

The lack of data transparency in Large Language Models (LLMs) has highlighted the importance of Membership Inference Attack (MIA), which differentiates trained (member) and untrained (non-member) data. Though it shows success in previous…

Computation and Language · Computer Science 2024-12-19 Bowen Chen , Namgi Han , Yusuke Miyao

Membership inference attacks (MIAs) are popular methods for empirically assessing the leakage of sensitive information in the training data through models or statistics learned from the data. The MIA vulnerability is often evaluated through…

Machine Learning · Computer Science 2026-05-26 Joonas Jälkö , Gauri Pradhan , Ossi Räisä , Antti Honkela

This report summarizes all the MIA experiments (Membership Inference Attacks) of the Embedding Attack Project, including threat models, experimental setup, experimental results, findings and discussion. Current results cover the evaluation…

Machine Learning · Computer Science 2024-01-26 Jiameng Pu , Zafar Takhirov

Federated Learning (FL) offers a promising framework for collaboratively training machine learning models across decentralized genomic datasets without direct data sharing. While this approach preserves data locality, it remains susceptible…

Cryptography and Security · Computer Science 2025-05-13 Chetan Pathade , Shubham Patil

Membership inference attacks (MIAs) pose a critical privacy threat to fine-tuned large language models (LLMs), especially when models are adapted to domain-specific tasks using sensitive data. While prior black-box MIA techniques rely on…

Cryptography and Security · Computer Science 2025-12-23 Zhexi Lu , Hongliang Chi , Nathalie Baracaldo , Swanand Ravindra Kadhe , Yuseok Jeon , Lei Yu

We demonstrate how a target model's generalization gap leads directly to an effective deterministic black box membership inference attack (MIA). This provides an upper bound on how secure a model can be to MIA based on a simple metric.…

Machine Learning · Computer Science 2020-09-15 Jason W. Bentley , Daniel Gibney , Gary Hoppenworth , Sumit Kumar Jha

The vulnerability of the Lottery Ticket Hypothesis has not been studied from the purview of Membership Inference Attacks. Through this work, we are the first to empirically show that the lottery ticket networks are equally vulnerable to…

Machine Learning · Computer Science 2021-08-10 Aadesh Bagmar , Shishira R Maiya , Shruti Bidwalka , Amol Deshpande

The vulnerability of machine learning models to Membership Inference Attacks (MIAs) has garnered considerable attention in recent years. These attacks determine whether a data sample belongs to the model's training set or not. Recent…

Cryptography and Security · Computer Science 2024-09-05 Yu He , Boheng Li , Yao Wang , Mengda Yang , Juan Wang , Hongxin Hu , Xingyu Zhao

Recent work in the privacy literature shows that sample-targeted membership inference attacks (MIAs) significantly outperform untargeted approaches by a wide margin. Motivated by this observation, we address the following question: can the…

Machine Learning · Statistics 2026-05-27 Valentin Dorseuil , Jamal Atif , Olivier Cappé

In Member Inference (MI) attacks, the adversary try to determine whether an instance is used to train a machine learning (ML) model. MI attacks are a major privacy concern when using private data to train ML models. Most MI attacks in the…

Cryptography and Security · Computer Science 2024-05-30 Jiacheng Li , Ninghui Li , Bruno Ribeiro

Machine learning algorithms, when applied to sensitive data, pose a distinct threat to privacy. A growing body of prior work demonstrates that models produced by these algorithms may leak specific private information in the training data to…

Cryptography and Security · Computer Science 2018-05-08 Samuel Yeom , Irene Giacomelli , Matt Fredrikson , Somesh Jha

We develop practical and theoretically grounded membership inference attacks (MIAs) against both independent and identically distributed (i.i.d.) data and graph-structured data. Building on the Bayesian decision-theoretic framework of…

Machine Learning · Computer Science 2025-10-29 Marcus Lassila , Johan Östman , Khac-Hoang Ngo , Alexandre Graell i Amat

Diffusion Models (DMs) benefit from large and diverse datasets for their training. Since this data is often scraped from the Internet without permission from the data owners, this raises concerns about copyright and intellectual property…

Machine Learning · Computer Science 2025-06-24 Jan Dubiński , Antoni Kowalczuk , Franziska Boenisch , Adam Dziedzic

Recent years have witnessed the tremendous success of diffusion models in data synthesis. However, when diffusion models are applied to sensitive data, they also give rise to severe privacy concerns. In this paper, we systematically present…

Cryptography and Security · Computer Science 2023-01-25 Hailong Hu , Jun Pang

Membership inference attacks (MIAs) against machine learning models can lead to serious privacy risks for the training dataset used in the model training. In this paper, we propose a novel and effective Neuron-Guided Defense method named…

Cryptography and Security · Computer Science 2022-12-14 Nuo Xu , Binghui Wang , Ran Ran , Wujie Wen , Parv Venkitasubramaniam

Membership inference attack (MIA) poses a significant privacy threat in federated learning (FL) as it allows adversaries to determine whether a client's private dataset contains a specific data sample. While defenses against membership…

Machine Learning · Computer Science 2026-02-10 Quan Minh Nguyen , Min-Seon Kim , Hoang M. Ngo , Trong Nghia Hoang , Hyuk-Yoon Kwon , My T. Thai