English
Related papers

Related papers: Membership Inference Attacks on Vision-Language-Ac…

200 papers

Deep Neural Network (DNN) models have been shown to have high empirical privacy leakages. Clinical language models (CLMs) trained on clinical data have been used to improve performance in biomedical natural language processing tasks. In…

Computation and Language · Computer Science 2021-04-20 Abhyuday Jagannatha , Bhanu Pratap Singh Rawat , Hong Yu

Foundation-style ECG encoders pretrained with self-supervised learning are increasingly reused across tasks, institutions, and deployment contexts, often through model-as-a-service interfaces that expose scalar scores or latent…

Recently, diffusion models have achieved remarkable success in generating tasks, including image and audio generation. However, like other generative models, diffusion models are prone to privacy issues. In this paper, we propose an…

Sound · Computer Science 2023-10-10 Fei Kong , Jinhao Duan , RuiPeng Ma , Hengtao Shen , Xiaofeng Zhu , Xiaoshuang Shi , Kaidi Xu

In several jurisdictions, the regulatory framework on the release and sharing of personal data is being extended to machine learning (ML). The implicit assumption is that disclosing a trained ML model entails a privacy risk for any personal…

Cryptography and Security · Computer Science 2025-11-14 Josep Domingo-Ferrer

Generative AI systems are quickly improving, now able to produce believable output in several modalities including images, text, and audio. However, this fast development has prompted increased scrutiny concerning user privacy and the use…

Cryptography and Security · Computer Science 2025-12-29 Kurtis Chow , Omar Samiullah , Vinesh Sridhar , Hewen Zhang

Federated learning (FL) has emerged as a promising privacy-aware paradigm that allows multiple clients to jointly train a model without sharing their private data. Recently, many studies have shown that FL is vulnerable to membership…

Cryptography and Security · Computer Science 2021-09-14 Hongsheng Hu , Zoran Salcic , Lichao Sun , Gillian Dobbie , Xuyun Zhang

Deep learning models often raise privacy concerns as they leak information about their training data. This enables an adversary to determine whether a data point was in a model's training set by conducting a membership inference attack…

Machine Learning · Computer Science 2020-06-11 Yigitcan Kaya , Sanghyun Hong , Tudor Dumitras

Text-to-image generation models have recently attracted unprecedented attention as they unlatch imaginative applications in all areas of life. However, developing such models requires huge amounts of data that might contain…

Cryptography and Security · Computer Science 2022-10-04 Yixin Wu , Ning Yu , Zheng Li , Michael Backes , Yang Zhang

Membership inference (MI) attacks exploit the fact that machine learning algorithms sometimes leak information about their training data through the learned model. In this work, we study membership inference in the white-box setting in…

Machine Learning · Computer Science 2020-06-26 Klas Leino , Matt Fredrikson

Membership Inference Attacks (MIAs) aim to identify specific data samples within the private training dataset of machine learning models, leading to serious privacy violations and other sophisticated threats. Many practical black-box MIAs…

Machine Learning · Computer Science 2023-10-13 Jihye Choi , Shruti Tople , Varun Chandrasekaran , Somesh Jha

Large language models (LLMs) are increasingly augmented with long-term memory systems to overcome finite context windows and enable persistent reasoning across interactions. However, recent research finds that LLMs become more vulnerable…

Machine Learning · Computer Science 2026-02-18 Mitchell Piehl , Zhaohan Xi , Zuobin Xiong , Pan He , Muchao Ye

Membership Inference Attacks (MIAs) have emerged as a valuable framework for evaluating privacy leakage by machine learning models. Score-based MIAs are distinguished, in particular, by their ability to exploit the confidence scores that…

Machine Learning · Computer Science 2025-02-28 Gauri Pradhan , Joonas Jälkö , Marlon Tobaben , Antti Honkela

Large language models (LLMs) have demonstrated great performance across various benchmarks, showing potential as general-purpose task solvers. However, as LLMs are typically trained on vast amounts of data, a significant concern in their…

Computation and Language · Computer Science 2025-05-13 Yujuan Fu , Ozlem Uzuner , Meliha Yetisgen , Fei Xia

Machine learning algorithms, when applied to sensitive data, pose a potential threat to privacy. A growing body of prior work has demonstrated that membership inference attack (MIA) can disclose specific private information in the training…

Cryptography and Security · Computer Science 2020-01-27 Bo Zhang , Ruotong Yu , Haipei Sun , Yanying Li , Jun Xu , Hui Wang

Membership inference attacks aim to detect if a particular data point was used in training a model. We design a novel statistical test to perform robust membership inference attacks (RMIA) with low computational overhead. We achieve this by…

Machine Learning · Statistics 2024-06-13 Sajjad Zarifzadeh , Philippe Liu , Reza Shokri

Today, the training of large language models (LLMs) can involve personally identifiable information and copyrighted material, incurring dataset misuse. To mitigate the problem of dataset misuse, this paper explores \textit{dataset…

Cryptography and Security · Computer Science 2025-12-09 Ruikai Zhou , Kang Yang , Xun Chen , Wendy Hui Wang , Guanhong Tao , Jun Xu

Membership inference attacks are one of the simplest forms of privacy leakage for machine learning models: given a data point and model, determine whether the point was used to train the model. Existing membership inference attacks exploit…

Cryptography and Security · Computer Science 2021-12-07 Christopher A. Choquette-Choo , Florian Tramer , Nicholas Carlini , Nicolas Papernot

Recent work in the privacy literature shows that sample-targeted membership inference attacks (MIAs) significantly outperform untargeted approaches by a wide margin. Motivated by this observation, we address the following question: can the…

Machine Learning · Statistics 2026-05-27 Valentin Dorseuil , Jamal Atif , Olivier Cappé

Membership inference attacks (MIAs) are widely used to empirically assess privacy risks in machine learning models, both providing model-level vulnerability metrics and identifying the most vulnerable training samples. State-of-the-art…

Machine Learning · Computer Science 2025-06-13 Joseph Pollock , Igor Shilov , Euodia Dodd , Yves-Alexandre de Montjoye

Modern machine learning (ML) ecosystems offer a surging number of ML frameworks and code repositories that can greatly facilitate the development of ML models. Today, even ordinary data holders who are not ML experts can apply off-the-shelf…

Cryptography and Security · Computer Science 2024-07-03 Zitao Chen , Karthik Pattabiraman