English
Related papers

Related papers: Improved Membership Inference Attacks Against Lang…

200 papers

Machine learning (ML) has become a core component of many real-world applications and training data is a key factor that drives current progress. This huge success has led Internet companies to deploy machine learning as a service (MLaaS).…

Cryptography and Security · Computer Science 2018-12-18 Ahmed Salem , Yang Zhang , Mathias Humbert , Pascal Berrang , Mario Fritz , Michael Backes

Membership Inference Attacks have emerged as a dominant method for empirically measuring privacy leakage from machine learning models. Here, privacy is measured by the {\em{advantage}} or gap between a score or a function computed on the…

Machine Learning · Computer Science 2024-05-27 Ruihan Wu , Pengrun Huang , Kamalika Chaudhuri

The raise of machine learning and deep learning led to significant improvement in several domains. This change is supported by both the dramatic rise in computation power and the collection of large datasets. Such massive datasets often…

Machine Learning · Computer Science 2022-11-24 Hamid Jalalzai , Elie Kadoche , Rémi Leluc , Vincent Plassier

Membership inference attack (MIA) has become one of the most widely used and effective methods for evaluating the privacy risks of machine learning models. These attacks aim to determine whether a specific sample is part of the model's…

Cryptography and Security · Computer Science 2025-06-04 Jing Xue , Zhishen Sun , Haishan Ye , Luo Luo , Xiangyu Chang , Ivor Tsang , Guang Dai

Recent research shows that large language models are susceptible to privacy attacks that infer aspects of the training data. However, it is unclear if simpler generative models, like topic models, share similar vulnerabilities. In this…

Cryptography and Security · Computer Science 2024-09-24 Nico Manzonelli , Wanrong Zhang , Salil Vadhan

It is observed in the literature that data augmentation can significantly mitigate membership inference (MI) attack. However, in this work, we challenge this observation by proposing new MI attacks to utilize the information of augmented…

Machine Learning · Computer Science 2021-03-01 Da Yu , Huishuai Zhang , Wei Chen , Jian Yin , Tie-Yan Liu

Recent years have witnessed the tremendous success of diffusion models in data synthesis. However, when diffusion models are applied to sensitive data, they also give rise to severe privacy concerns. In this paper, we systematically present…

Cryptography and Security · Computer Science 2023-01-25 Hailong Hu , Jun Pang

As machine learning expanding application, there are more and more unignorable privacy and safety issues. Especially inference attacks against Machine Learning models allow adversaries to infer sensitive information about the target model,…

Cryptography and Security · Computer Science 2022-12-22 Yang Yang

Large language models (LLMs) are increasingly deployed in interactive and retrieval-augmented settings, raising significant privacy concerns. While attacks such as Membership Inference (MIA), Attribute Inference (AIA), Data Extraction…

Cryptography and Security · Computer Science 2026-05-05 Karima Makhlouf , Lamiaa Basyoni , Syed Khaderi , Gabriel Marquez , Peter Sotomango , Mahmoud Awawdah , Sami Zhioua

Text-to-image generation models have recently attracted unprecedented attention as they unlatch imaginative applications in all areas of life. However, developing such models requires huge amounts of data that might contain…

Cryptography and Security · Computer Science 2022-10-04 Yixin Wu , Ning Yu , Zheng Li , Michael Backes , Yang Zhang

With an increase in low-cost machine learning APIs, advanced machine learning models may be trained on private datasets and monetized by providing them as a service. However, privacy researchers have demonstrated that these models may leak…

Recently, recommender systems have achieved promising performances and become one of the most widely used web applications. However, recommender systems are often trained on highly sensitive user data, thus potential data leakage from…

Cryptography and Security · Computer Science 2021-09-17 Minxing Zhang , Zhaochun Ren , Zihan Wang , Pengjie Ren , Zhumin Chen , Pengfei Hu , Yang Zhang

Data privacy is an important issue for "machine learning as a service" providers. We focus on the problem of membership inference attacks: given a data sample and black-box access to a model's API, determine whether the sample existed in…

Machine Learning · Computer Science 2020-03-17 Sorami Hisamoto , Matt Post , Kevin Duh

Artificial intelligence, machine learning, and deep learning as a service have become the status quo for many industries, leading to the widespread deployment of models that handle sensitive data. Well-performing models, the industry seeks,…

Machine learning models can leak private information about their training data. The standard methods to measure this privacy risk, based on membership inference attacks (MIAs), only check if a given data point \textit{exactly} matches a…

Machine Learning · Computer Science 2025-09-11 Jiashu Tao , Reza Shokri

Machine learning models are prone to memorizing sensitive data, making them vulnerable to membership inference attacks in which an adversary aims to infer whether an input sample was used to train the model. Over the past few years,…

Cryptography and Security · Computer Science 2022-08-23 Xinlei He , Zheng Li , Weilin Xu , Cory Cornelius , Yang Zhang

It is critical to understand the privacy and robustness vulnerabilities of machine learning models, as their implementation expands in scope. In membership inference attacks, adversaries can determine whether a particular set of data was…

Cryptography and Security · Computer Science 2019-11-06 Michael Lomnitz , Nina Lopatina , Paul Gamble , Zigfried Hampel-Arias , Lucas Tindall , Felipe A. Mejia , Maria Alejandra Barrios

Deep learning has achieved overwhelming success, spanning from discriminative models to generative models. In particular, deep generative models have facilitated a new level of performance in a myriad of areas, ranging from media…

Machine Learning · Computer Science 2020-11-24 Dingfan Chen , Ning Yu , Yang Zhang , Mario Fritz

Membership Inference Attacks exploit the vulnerabilities of exposing models trained on customer data to queries by an adversary. In a recently proposed implementation of an auditing tool for measuring privacy leakage from sensitive…

Machine Learning · Computer Science 2020-09-21 Abhinav Aggarwal , Zekun Xu , Oluwaseyi Feyisetan , Nathanael Teissier

Membership inference attacks (MIAs) aim to determine whether a data sample was included in a machine learning (ML) model's training set and have become the de facto standard for measuring privacy leakages in ML. We propose an evaluation…

Cryptography and Security · Computer Science 2026-03-25 Najeeb Jebreel , David Sánchez , Josep Domingo-Ferrer