English
Related papers

Related papers: Membership Inference Attacks on Large-Scale Models…

200 papers

Image AutoRegressive generation has emerged as a new powerful paradigm with image autoregressive models (IARs) matching state-of-the-art diffusion models (DMs) in image quality (FID: 1.48 vs. 1.58) while allowing for a higher generation…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Antoni Kowalczuk , Jan Dubiński , Franziska Boenisch , Adam Dziedzic

Deep Neural Network (DNN) models have been shown to have high empirical privacy leakages. Clinical language models (CLMs) trained on clinical data have been used to improve performance in biomedical natural language processing tasks. In…

Computation and Language · Computer Science 2021-04-20 Abhyuday Jagannatha , Bhanu Pratap Singh Rawat , Hong Yu

Multi-domain graph pre-training has emerged as a pivotal technique in developing graph foundation models. While it greatly improves the generalization of graph neural networks, its privacy risks under membership inference attacks (MIAs),…

Machine Learning · Computer Science 2025-11-25 Jiayi Luo , Qingyun Sun , Yuecen Wei , Haonan Yuan , Xingcheng Fu , Jianxin Li

Data is the foundation of most science. Unfortunately, sharing data can be obstructed by the risk of violating data privacy, impeding research in fields like healthcare. Synthetic data is a potential solution. It aims to generate data that…

Machine Learning · Computer Science 2023-02-27 Boris van Breugel , Hao Sun , Zhaozhi Qian , Mihaela van der Schaar

Large language models have revolutionized the field of NLP by achieving state-of-the-art performance on various tasks. However, there is a concern that these models may disclose information in the training data. In this study, we focus on…

Computation and Language · Computer Science 2023-10-23 Ruixiang Tang , Gord Lueck , Rodolfo Quispe , Huseyin A Inan , Janardhan Kulkarni , Xia Hu

The rapid advancement of large language models (LLMs) has revolutionized natural language processing, enabling applications in diverse domains such as healthcare, finance and education. However, the growing reliance on extensive data for…

Cryptography and Security · Computer Science 2024-12-10 Guoshenghui Zhao , Eric Song

Learned recommender systems may inadvertently leak information about their training data, leading to privacy violations. We investigate privacy threats faced by recommender systems through the lens of membership inference. In such attacks,…

Information Retrieval · Computer Science 2022-06-29 Zihan Wang , Na Huang , Fei Sun , Pengjie Ren , Zhumin Chen , Hengliang Luo , Maarten de Rijke , Zhaochun Ren

Sequence models, such as Large Language Models (LLMs) and autoregressive image generators, have a tendency to memorize and inadvertently leak sensitive information. While this tendency has critical legal implications, existing tools are…

Cryptography and Security · Computer Science 2025-06-06 Lorenzo Rossi , Michael Aerni , Jie Zhang , Florian Tramèr

Large Language Models (LLMs) pose significant privacy risks, potentially leaking training data due to implicit memorization. Existing privacy attacks primarily focus on membership inference attacks (MIAs) or data extraction attacks, but…

Computation and Language · Computer Science 2025-06-11 Wenlong Meng , Zhenyuan Guo , Lenan Wu , Chen Gong , Wenyan Liu , Weixian Li , Chengkun Wei , Wenzhi Chen

Multimodal retrieval-augmented generation (RAG) systems enhance large vision-language models by integrating cross-modal knowledge, enabling their increasing adoption across real-world multimodal tasks. These knowledge databases may contain…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Peiru Yang , Jinhua Yin , Haoran Zheng , Xueying Bai , Huili Wang , Yufei Sun , Xintian Li , Shangguang Wang , Yongfeng Huang , Tao Qi

Vision-Language Models (VLMs) have achieved remarkable success, yet their reliance on massive datasets and unintended memorization of training data raise significant data security risk. Membership Inference Attacks (MIAs) aim to assess…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Jiaqing Li , Yajuan Lu , Xiaochuan Shi , Gang Wu , ZhongYuan Wang , Chao Liang

Modern machine learning (ML) ecosystems offer a surging number of ML frameworks and code repositories that can greatly facilitate the development of ML models. Today, even ordinary data holders who are not ML experts can apply off-the-shelf…

Cryptography and Security · Computer Science 2024-07-03 Zitao Chen , Karthik Pattabiraman

Membership Inference Attacks (MIAs) pose a significant privacy risk by enabling adversaries to determine if a specific data point was part of a model's training set. This work empirically investigates whether MU algorithms can function as a…

Membership Inference Attacks (MIAs) serve as a fundamental auditing tool for evaluating training data leakage in machine learning models. However, existing methodologies predominantly rely on static, handcrafted heuristics that lack…

Cryptography and Security · Computer Science 2026-04-02 Ruhao Liu , Weiqi Huang , Qi Li , Xinchao Wang

Machine learning (ML) models have significantly grown in complexity and utility, driving advances across multiple domains. However, substantial computational resources and specialized expertise have historically restricted their wide…

Cryptography and Security · Computer Science 2025-08-28 Kaixiang Zhao , Lincan Li , Kaize Ding , Neil Zhenqiang Gong , Yue Zhao , Yushun Dong

The increasing parameters and expansive dataset of large language models (LLMs) highlight the urgent demand for a technical solution to audit the underlying privacy risks and copyright issues associated with LLMs. Existing studies have…

Computation and Language · Computer Science 2024-12-30 Wenjie Fu , Huandong Wang , Chen Gao , Guanghua Liu , Yong Li , Tao Jiang

The increasing prominence of deep learning applications and reliance on personalized data underscore the urgent need to address privacy vulnerabilities, particularly Membership Inference Attacks (MIAs). Despite numerous MIA studies,…

Machine Learning · Computer Science 2024-07-02 Chenxi Li , Abhinav Kumar , Zhen Guo , Jie Hou , Reza Tourani

Ensuring the privacy of research participants is vital, even more so in healthcare environments. Deep learning approaches to neuroimaging require large datasets, and this often necessitates sharing data between multiple sites, which is…

Quantitative Methods · Quantitative Biology 2021-06-04 Umang Gupta , Dimitris Stripelis , Pradeep K. Lam , Paul M. Thompson , José Luis Ambite , Greg Ver Steeg

Model explanations improve the transparency of black-box machine learning (ML) models and their decisions; however, they can also be exploited to carry out privacy threats such as membership inference attacks (MIA). Existing works have only…

Artificial Intelligence · Computer Science 2024-04-11 Kavita Kumari , Murtuza Jadliwala , Sumit Kumar Jha , Anindya Maiti

This report summarizes all the MIA experiments (Membership Inference Attacks) of the Embedding Attack Project, including threat models, experimental setup, experimental results, findings and discussion. Current results cover the evaluation…

Machine Learning · Computer Science 2024-01-26 Jiameng Pu , Zafar Takhirov