English
Related papers

Related papers: Membership Inference Attack against Large Language…

200 papers

Membership inference attacks (MIAs) against Diffusion Models (DMs) raise pressing privacy concerns by revealing whether a sample was part of the training set. While existing methods typically rely on measuring reconstruction error across…

Machine Learning · Computer Science 2026-04-27 Mingxing Rao , Bowen Qu , Daniel Moyer

Deep learning models, while achieving remarkable performances, are vulnerable to membership inference attacks (MIAs). Although various defenses have been proposed, there is still substantial room for improvement in the privacy-utility…

Cryptography and Security · Computer Science 2025-09-29 Yuefeng Peng , Ali Naseh , Amir Houmansadr

Diffusion-based generative models have shown great potential for image synthesis, but there is a lack of research on the security and privacy risks they may pose. In this paper, we investigate the vulnerability of diffusion models to…

Computer Vision and Pattern Recognition · Computer Science 2023-05-31 Jinhao Duan , Fei Kong , Shiqi Wang , Xiaoshuang Shi , Kaidi Xu

Large language models (LLMs) have achieved remarkable success and are widely adopted for diverse applications. However, fine-tuning these models often involves private or sensitive information, raising critical privacy concerns. In this…

Cryptography and Security · Computer Science 2025-06-13 Kaiyuan Zhang , Siyuan Cheng , Hanxi Guo , Yuetian Chen , Zian Su , Shengwei An , Yuntao Du , Charles Fleming , Ashish Kundu , Xiangyu Zhang , Ninghui Li

Most existing membership inference attacks (MIAs) utilize metrics (e.g., loss) calculated on the model's final state, while recent advanced attacks leverage metrics computed at various stages, including both intermediate and final stages,…

Cryptography and Security · Computer Science 2024-07-23 Hao Li , Zheng Li , Siyuan Wu , Chengrui Hu , Yutong Ye , Min Zhang , Dengguo Feng , Yang Zhang

Model Inversion (MI) attacks aim to recover the private training data from the target model, which has raised security concerns about the deployment of DNNs in practice. Recent advances in generative adversarial models have rendered them…

Computer Vision and Pattern Recognition · Computer Science 2023-09-04 Gege Qi , YueFeng Chen , Xiaofeng Mao , Binyuan Hui , Xiaodan Li , Rong Zhang , Hui Xue

Retrieval-Augmented Generation (RAG) is a state-of-the-art technique that mitigates issues such as hallucinations and knowledge staleness in Large Language Models (LLMs) by retrieving relevant knowledge from an external database to assist…

Cryptography and Security · Computer Science 2024-09-27 Yuying Li , Gaoyang Liu , Chen Wang , Yang Yang

The high cost of model training makes it increasingly desirable to develop techniques for unlearning. These techniques seek to remove the influence of a training example without having to retrain the model from scratch. Intuitively, once a…

Machine Learning · Computer Science 2024-05-22 Jamie Hayes , Ilia Shumailov , Eleni Triantafillou , Amr Khalifa , Nicolas Papernot

Federated Learning (FL) is an emerging solution to the data scarcity problem for training deep learning models in hardware assurance. While FL is designed to enhance privacy by not sharing raw data, it remains vulnerable to Membership…

Cryptography and Security · Computer Science 2026-04-23 Gijung Lee , Wavid Bowman , Olivia P. Dizon-Paradis , Reiner N. Dizon-Paradis , Ronald Wilson , Damon L. Woodard , Domenic Forte

Membership inference (MI) determines if a sample was part of a victim model training set. Recent development of MI attacks focus on record-level membership inference which limits their application in many real-world scenarios. For example,…

Machine Learning · Computer Science 2022-04-27 Guoyao Li , Shahbaz Rezaei , Xin Liu

The vulnerability of the Lottery Ticket Hypothesis has not been studied from the purview of Membership Inference Attacks. Through this work, we are the first to empirically show that the lottery ticket networks are equally vulnerable to…

Machine Learning · Computer Science 2021-08-10 Aadesh Bagmar , Shishira R Maiya , Shruti Bidwalka , Amol Deshpande

Federated Learning (FL) is a promising approach for training machine learning models on decentralized data while preserving privacy. However, privacy risks, particularly Membership Inference Attacks (MIAs), which aim to determine whether a…

Machine Learning · Computer Science 2025-03-28 Gongxi Zhu , Donghao Li , Hanlin Gu , Yuan Yao , Lixin Fan , Yuxing Han

Safety classifiers are essential safeguards within generative AI systems, filtering harmful content or identifying at-risk users when interacting with large language models. Despite their necessity, these models are trained on sensitive…

Machine Learning · Computer Science 2026-05-25 Anthony Hughes , Alexander Goldberg , Prince Jha , Adam Perer , Nikolaos Aletras , Niloofar Mireshghallah

Previous studies have developed fairness methods for biased models that exhibit discriminatory behaviors towards specific subgroups. While these models have shown promise in achieving fair predictions, recent research has identified their…

Machine Learning · Computer Science 2024-08-28 Huan Tian , Guangsheng Zhang , Bo Liu , Tianqing Zhu , Ming Ding , Wanlei Zhou

Growing concerns over data privacy and security highlight the importance of machine unlearning--removing specific data influences from trained models without full retraining. Techniques like Membership Inference Attacks (MIAs) are widely…

Machine Learning · Computer Science 2025-06-09 Cheng-Long Wang , Qi Li , Zihang Xiang , Yinzhi Cao , Di Wang

Machine learning models can leak private information about their training data. The standard methods to measure this privacy risk, based on membership inference attacks (MIAs), only check if a given data point \textit{exactly} matches a…

Machine Learning · Computer Science 2025-09-11 Jiashu Tao , Reza Shokri

Membership inference attacks (MIAs) on diffusion models have emerged as potential evidence of unauthorized data usage in training pre-trained diffusion models. These attacks aim to detect the presence of specific images in training datasets…

Machine Learning · Computer Science 2024-10-07 Chumeng Liang , Jiaxuan You

Neural models for vulnerability prediction (VP) have achieved impressive performance by learning from large-scale code repositories. However, their susceptibility to Membership Inference Attacks (MIAs), where adversaries aim to infer…

Cryptography and Security · Computer Science 2025-12-10 Yihan Liao , Jacky Keung , Xiaoxue Ma , Jingyu Zhang , Yicheng Sun

Membership Inference Attacks (MIAs) are currently a dominant approach for evaluating privacy in machine learning applications. Despite their significance in identifying records belonging to the training dataset, several concerns remain…

Machine Learning · Computer Science 2026-01-23 Cristina Pêra , Tânia Carvalho , Maxime Cordy , Luís Antunes

Data is the foundation of most science. Unfortunately, sharing data can be obstructed by the risk of violating data privacy, impeding research in fields like healthcare. Synthetic data is a potential solution. It aims to generate data that…

Machine Learning · Computer Science 2023-02-27 Boris van Breugel , Hao Sun , Zhaozhi Qian , Mihaela van der Schaar