English
Related papers

Related papers: Better Membership Inference Privacy Measurement th…

200 papers

Deep Neural Network (DNN) models have been shown to have high empirical privacy leakages. Clinical language models (CLMs) trained on clinical data have been used to improve performance in biomedical natural language processing tasks. In…

Computation and Language · Computer Science 2021-04-20 Abhyuday Jagannatha , Bhanu Pratap Singh Rawat , Hong Yu

With the emergence of powerful large-scale foundation models, the training paradigm is increasingly shifting from from-scratch training to transfer learning. This enables high utility training with small, domain-specific datasets typical in…

Machine Learning · Computer Science 2025-10-09 Yuxuan Bai , Gauri Pradhan , Marlon Tobaben , Antti Honkela

Membership Inference Attacks (MIAs) have emerged as a principled framework for auditing the privacy of synthetic data generated by tabular generative models, where many diverse methods have been proposed that each exploit different privacy…

Cryptography and Security · Computer Science 2025-09-09 Joshua Ward , Yuxuan Yang , Chi-Hua Wang , Guang Cheng

Machine learning models' goal is to make correct predictions for specific tasks by learning important properties and patterns from data. By doing so, there is a chance that the model learns properties that are unrelated to its primary task.…

Cryptography and Security · Computer Science 2021-04-28 Mathias P. M. Parisot , Balazs Pejo , Dayana Spagnuelo

Artificial intelligence, machine learning, and deep learning as a service have become the status quo for many industries, leading to the widespread deployment of models that handle sensitive data. Well-performing models, the industry seeks,…

While significant research advances have been made in the field of deep reinforcement learning, there have been no concrete adversarial attack strategies in literature tailored for studying the vulnerability of deep reinforcement learning…

Machine Learning · Computer Science 2022-11-17 Maziar Gomrokchi , Susan Amin , Hossein Aboutalebi , Alexander Wong , Doina Precup

Machine learning models are known to leak sensitive information, as they inevitably memorize (parts of) their training data. More alarmingly, large language models (LLMs) are now trained on nearly all available data, which amplifies the…

Machine Learning · Computer Science 2025-10-10 Jiashu Tao , Reza Shokri

Membership inference attacks are used as a key tool for disclosure auditing. They aim to infer whether an individual record was used to train a model. While such evaluations are useful to demonstrate risk, they are computationally expensive…

Machine Learning · Computer Science 2024-12-20 Anshuman Suri , Xiao Zhang , David Evans

Deep learning models, while achieving remarkable performances, are vulnerable to membership inference attacks (MIAs). Although various defenses have been proposed, there is still substantial room for improvement in the privacy-utility…

Cryptography and Security · Computer Science 2025-09-29 Yuefeng Peng , Ali Naseh , Amir Houmansadr

Training deep neural networks via federated learning allows clients to share, instead of the original data, only the model trained on their data. Prior work has demonstrated that in practice a client's private information, unrelated to the…

Cryptography and Security · Computer Science 2021-06-01 Fan Mo , Anastasia Borovykh , Mohammad Malekzadeh , Hamed Haddadi , Soteris Demetriou

In this paper we consider the setting where machine learning models are retrained on updated datasets in order to incorporate the most up-to-date information or reflect distribution shifts. We investigate whether one can infer information…

Machine Learning · Computer Science 2024-01-04 Tian Hui , Farhad Farokhi , Olga Ohrimenko

Within the realm of privacy-preserving machine learning, empirical privacy defenses have been proposed as a solution to achieve satisfactory levels of training data privacy without a significant drop in model utility. Most existing defenses…

Cryptography and Security · Computer Science 2023-10-19 Caelin G. Kaplan , Chuan Xu , Othmane Marfoq , Giovanni Neglia , Anderson Santana de Oliveira

Malicious adversaries can attack machine learning models to infer sensitive information or damage the system by launching a series of evasion attacks. Although various work addresses privacy and security concerns, they focus on individual…

Machine Learning · Computer Science 2024-01-22 Janvi Thakkar , Giulio Zizzo , Sergio Maffeis

Privacy attacks on Machine Learning (ML) models often focus on inferring the existence of particular data points in the training data. However, what the adversary really wants to know is if a particular individual's (subject's) data was…

Machine Learning · Computer Science 2023-06-05 Anshuman Suri , Pallika Kanani , Virendra J. Marathe , Daniel W. Peterson

Recent studies propose membership inference (MI) attacks on deep models, where the goal is to infer if a sample has been used in the training process. Despite their apparent success, these studies only report accuracy, precision, and recall…

Machine Learning · Computer Science 2021-03-24 Shahbaz Rezaei , Xin Liu

Among all privacy attacks against Machine Learning (ML), membership inference attacks (MIA) attracted the most attention. In these attacks, the attacker is given an ML model and a data point, and they must infer whether the data point was…

Cryptography and Security · Computer Science 2025-12-02 Bram van Dartel , Marc Damie , Florian Hahn

Membership Inference Attacks (MIAs) aim to identify specific data samples within the private training dataset of machine learning models, leading to serious privacy violations and other sophisticated threats. Many practical black-box MIAs…

Machine Learning · Computer Science 2023-10-13 Jihye Choi , Shruti Tople , Varun Chandrasekaran , Somesh Jha

Differential privacy allows bounding the influence that training data records have on a machine learning model. To use differential privacy in machine learning, data scientists must choose privacy parameters $(\epsilon,\delta)$. Choosing…

Cryptography and Security · Computer Science 2021-07-21 Daniel Bernau , Günther Eibl , Philip W. Grassal , Hannah Keller , Florian Kerschbaum

Recent research shows that large language models are susceptible to privacy attacks that infer aspects of the training data. However, it is unclear if simpler generative models, like topic models, share similar vulnerabilities. In this…

Cryptography and Security · Computer Science 2024-09-24 Nico Manzonelli , Wanrong Zhang , Salil Vadhan

While Membership Inference Attacks (MIAs) are the prevailing method for identifying training data, their application has expanded into privacy auditing and machine unlearning. Nevertheless, the field lacks a systematic framework for…

Machine Learning · Computer Science 2026-05-29 Ding Chen , Xinwen Cheng , Xuyang Zhong , Xinping Chen , Xiaolin Huang , Chen Liu