English
Related papers

Related papers: Res-MIA: A Training-Free Resolution-Based Membersh…

200 papers

Membership inference attacks (MIAs) on diffusion models have emerged as potential evidence of unauthorized data usage in training pre-trained diffusion models. These attacks aim to detect the presence of specific images in training datasets…

Machine Learning · Computer Science 2024-10-07 Chumeng Liang , Jiaxuan You

Retrieval-Augmented Generation (RAG) and Supervised Finetuning (SFT) have become the predominant paradigms for equipping Large Language Models (LLMs) with external knowledge for diverse, knowledge-intensive tasks. However, while such…

Cryptography and Security · Computer Science 2025-12-04 Haowei Fu , Bo Ni , Han Xu , Kunpeng Liu , Dan Lin , Tyler Derr

Large capacity machine learning (ML) models are prone to membership inference attacks (MIAs), which aim to infer whether the target sample is a member of the target model's training dataset. The serious privacy concerns due to the…

Machine Learning · Computer Science 2021-01-01 Virat Shejwalkar , Amir Houmansadr

Small language models (SLMs) are increasingly valued for their efficiency and deployability in resource-constrained environments, making them useful for on-device, privacy-sensitive, and edge computing applications. On the other hand,…

Artificial Intelligence · Computer Science 2025-08-05 Roya Arkhmammadova , Hosein Madadi Tamar , M. Emre Gursoy

Diffusion-based generative models have shown great potential for image synthesis, but there is a lack of research on the security and privacy risks they may pose. In this paper, we investigate the vulnerability of diffusion models to…

Computer Vision and Pattern Recognition · Computer Science 2023-05-31 Jinhao Duan , Fei Kong , Shiqi Wang , Xiaoshuang Shi , Kaidi Xu

Image AutoRegressive generation has emerged as a new powerful paradigm with image autoregressive models (IARs) matching state-of-the-art diffusion models (DMs) in image quality (FID: 1.48 vs. 1.58) while allowing for a higher generation…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Antoni Kowalczuk , Jan Dubiński , Franziska Boenisch , Adam Dziedzic

Membership inference attacks seek to infer membership of individual training instances of a model to which an adversary has black-box access through a machine learning-as-a-service API. In providing an in-depth characterization of…

Cryptography and Security · Computer Science 2019-02-04 Stacey Truex , Ling Liu , Mehmet Emre Gursoy , Lei Yu , Wenqi Wei

The potential of transformer-based LLMs risks being hindered by privacy concerns due to their reliance on extensive datasets, possibly including sensitive information. Regulatory measures like GDPR and CCPA call for using robust auditing…

Cryptography and Security · Computer Science 2024-06-25 Filippo Galli , Luca Melis , Tommaso Cucinotta

Machine learning models are prone to memorizing sensitive data, making them vulnerable to membership inference attacks in which an adversary aims to guess if an input sample was used to train the model. In this paper, we show that prior…

Cryptography and Security · Computer Science 2020-12-10 Liwei Song , Prateek Mittal

The rise of generative image models leads to privacy concerns when it comes to the huge datasets used to train such models. This paper investigates the possibility of inferring if a set of face images was used for fine-tuning a Latent…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Lauritz Christian Holme , Anton Mosquera Storgaard , Siavash Arjomand Bigdeli

Recently, diffusion models have achieved remarkable success in generating tasks, including image and audio generation. However, like other generative models, diffusion models are prone to privacy issues. In this paper, we propose an…

Sound · Computer Science 2023-10-10 Fei Kong , Jinhao Duan , RuiPeng Ma , Hengtao Shen , Xiaofeng Zhu , Xiaoshuang Shi , Kaidi Xu

The state-of-the-art for membership inference attacks on machine learning models is a class of attacks based on shadow models that mimic the behavior of the target model on subsets of held-out nonmember data. However, we find that this…

Machine Learning · Computer Science 2025-10-28 Pratiksha Thaker , Neil Kale , Zhiwei Steven Wu , Virginia Smith

Large vision-language models (LVLMs) derive their capabilities from extensive training on vast corpora of visual and textual data. Empowered by large-scale parameters, these models often exhibit strong memorization of their training data,…

Cryptography and Security · Computer Science 2025-11-05 Jinhua Yin , Peiru Yang , Chen Yang , Huili Wang , Zhiyang Hu , Shangguang Wang , Yongfeng Huang , Tao Qi

In membership inference attacks (MIAs), an adversary observes the predictions of a model to determine whether a sample is part of the model's training data. Existing MIA defenses conceal the presence of a target sample through strong…

Cryptography and Security · Computer Science 2022-03-03 Ismat Jarin , Birhanu Eshete

Machine learning models are susceptible to membership inference attacks (MIAs), which aim to infer whether a sample is in the training set. Existing work utilizes gradient ascent to enlarge the loss variance of training data, alleviating…

Machine Learning · Computer Science 2024-06-19 Zhenlong Liu , Lei Feng , Huiping Zhuang , Xiaofeng Cao , Hongxin Wei

Federated Learning (FL) has emerged as a promising paradigm for collaborative model training without the need to share clients' personal data, thereby preserving privacy. However, the non-IID nature of the clients' data introduces major…

Machine Learning · Computer Science 2025-03-13 Kangsoo Jung , Sayan Biswas , Catuscia Palamidessi

Membership inference attacks (MIAs) against Diffusion Models (DMs) raise pressing privacy concerns by revealing whether a sample was part of the training set. While existing methods typically rely on measuring reconstruction error across…

Machine Learning · Computer Science 2026-04-27 Mingxing Rao , Bowen Qu , Daniel Moyer

Membership inference attacks (MIAs) are critical tools for assessing privacy risks and ensuring compliance with regulations like the General Data Protection Regulation (GDPR). However, their potential for auditing unauthorized use of data…

Cryptography and Security · Computer Science 2024-11-28 Depeng Chen , Hao Chen , Hulin Jin , Jie Cui , Hong Zhong

Machine learning (ML) has become a core component of many real-world applications and training data is a key factor that drives current progress. This huge success has led Internet companies to deploy machine learning as a service (MLaaS).…

Cryptography and Security · Computer Science 2018-12-18 Ahmed Salem , Yang Zhang , Mathias Humbert , Pascal Berrang , Mario Fritz , Michael Backes

The proliferation of large language models (LLMs) in the real world has come with a rise in copyright cases against companies for training their models on unlicensed data from the internet. Recent works have presented methods to identify if…

Machine Learning · Computer Science 2024-06-11 Pratyush Maini , Hengrui Jia , Nicolas Papernot , Adam Dziedzic