English
Related papers

Related papers: Membership Inference of Diffusion Models

200 papers

Many current Internet services rely on inferences from models trained on user data. Commonly, both the training and inference tasks are carried out using cloud resources fed by personal data collected at scale from users. Holding and using…

Machine Learning · Computer Science 2018-04-04 Sandra Servia-Rodriguez , Liang Wang , Jianxin R. Zhao , Richard Mortier , Hamed Haddadi

A typical setup in many machine learning scenarios involves a server that holds a model and a user that possesses data, and the challenge is to perform inference while safeguarding the privacy of both parties. Private Inference has been…

Information Theory · Computer Science 2023-11-27 Zirui Deng , Vinayak Ramkumar , Rawad Bitar , Netanel Raviv

Among all privacy attacks against Machine Learning (ML), membership inference attacks (MIA) attracted the most attention. In these attacks, the attacker is given an ML model and a data point, and they must infer whether the data point was…

Cryptography and Security · Computer Science 2025-12-02 Bram van Dartel , Marc Damie , Florian Hahn

Recent studies have demonstrated the vulnerability of recommender systems to data privacy attacks. However, research on the threat to model privacy in recommender systems, such as model stealing attacks, is still in its infancy. Some…

Cryptography and Security · Computer Science 2023-12-27 Zhihao Zhu , Rui Fan , Chenwang Wu , Yi Yang , Defu Lian , Enhong Chen

In modern settings of data analysis, we may be running our algorithms on datasets that are sensitive in nature. However, classical machine learning and statistical algorithms were not designed with these risks in mind, and it has been…

Data Structures and Algorithms · Computer Science 2021-08-21 Huanyu Zhang

Large language models (LLMs) are increasingly deployed in interactive and retrieval-augmented settings, raising significant privacy concerns. While attacks such as Membership Inference (MIA), Attribute Inference (AIA), Data Extraction…

Cryptography and Security · Computer Science 2026-05-05 Karima Makhlouf , Lamiaa Basyoni , Syed Khaderi , Gabriel Marquez , Peter Sotomango , Mahmoud Awawdah , Sami Zhioua

Analyzing time-series data that contains personal information, particularly in the medical field, presents serious privacy concerns. Sensitive health data from patients is often used to train machine learning models for diagnostics and…

Machine Learning · Computer Science 2024-09-24 Noam Koren , Abigail Goldsteen , Guy Amit , Ariel Farkash

Membership inference (MI) attacks exploit the fact that machine learning algorithms sometimes leak information about their training data through the learned model. In this work, we study membership inference in the white-box setting in…

Machine Learning · Computer Science 2020-06-26 Klas Leino , Matt Fredrikson

Membership inference attacks are used as a key tool for disclosure auditing. They aim to infer whether an individual record was used to train a model. While such evaluations are useful to demonstrate risk, they are computationally expensive…

Machine Learning · Computer Science 2024-12-20 Anshuman Suri , Xiao Zhang , David Evans

Sequence models, such as Large Language Models (LLMs) and autoregressive image generators, have a tendency to memorize and inadvertently leak sensitive information. While this tendency has critical legal implications, existing tools are…

Cryptography and Security · Computer Science 2025-06-06 Lorenzo Rossi , Michael Aerni , Jie Zhang , Florian Tramèr

Membership inference attacks are a key measure to evaluate privacy leakage in machine learning (ML) models. These attacks aim to distinguish training members from non-members by exploiting differential behavior of the models on member and…

Cryptography and Security · Computer Science 2021-10-19 Xinyu Tang , Saeed Mahloujifar , Liwei Song , Virat Shejwalkar , Milad Nasr , Amir Houmansadr , Prateek Mittal

We introduce a new attack paradigm that embeds hidden adversarial capabilities directly into diffusion models via fine-tuning, without altering their observable behavior or requiring modifications during inference. Unlike prior approaches…

Machine Learning · Computer Science 2025-04-15 Lucas Beerens , Desmond J. Higham

Diffusion models have shown great potential for vision-related tasks, particularly for image generation. However, their training is typically conducted in a centralized manner, relying on data collected from publicly available sources. This…

Machine Learning · Computer Science 2023-11-29 Ye Lin Tun , Chu Myaet Thwal , Ji Su Yoon , Sun Moo Kang , Chaoning Zhang , Choong Seon Hong

The rapid advancement of diffusion-based image generation models has raised serious concerns regarding potential copyright and privacy infringements involving human-created data. Membership inference attacks (MIAs) have emerged as a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Tao Qi , Huili Wang , Yuanhong Huang , Wendan Wang , Lianchao Zhao , Jinrui Wang , Zichen Qin , Shangguang Wang , Yongfeng Huang

While modern machine learning models rely on increasingly large training datasets, data is often limited in privacy-sensitive domains. Generative models trained with differential privacy (DP) on sensitive data can sidestep this challenge,…

Machine Learning · Statistics 2024-01-02 Tim Dockhorn , Tianshi Cao , Arash Vahdat , Karsten Kreis

Gradient leakage has been identified as a potential source of privacy breaches in modern image processing systems, where the adversary can completely reconstruct the training images from leaked gradients. However, existing methods are…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Jiayang Meng , Tao Huang , Hong Chen , Cuiping Li

Membership inference attacks (MIAs) pose a significant threat to the privacy of machine learning models and are widely used as tools for privacy assessment, auditing, and machine unlearning. While prior MIA research has primarily focused on…

Machine Learning · Computer Science 2025-07-04 Zhiqi Wang , Chengyu Zhang , Yuetian Chen , Nathalie Baracaldo , Swanand Kadhe , Lei Yu

Recently, the membership inference attack poses a serious threat to the privacy of confidential training data of machine learning models. This paper proposes a novel adversarial example based privacy-preserving technique (AEPPT), which adds…

Cryptography and Security · Computer Science 2022-07-05 Mingfu Xue , Chengxiang Yuan , Can He , Zhiyu Wu , Yushu Zhang , Zhe Liu , Weiqiang Liu

The membership inference problem for publicly released statistics from a private dataset is well-studied. When developing and formally analyzing attack strategies, however, the focus has been on attacks that model the population using only…

Cryptography and Security · Computer Science 2026-05-29 Lisa Oakley , Sam Stites , Cameron Moy , Steven Holtzen , Alina Oprea , Marco Gaboardi

In the realm of multimedia data analysis, the extensive use of image datasets has escalated concerns over privacy protection within such data. Current research predominantly focuses on privacy protection either in data sharing or upon the…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Huaxi Huang , Xin Yuan , Qiyu Liao , Dadong Wang , Tongliang Liu