中文
相关论文

相关论文: Blind Baselines Beat Membership Inference Attacks …

200 篇论文

We introduce a new class of attacks on machine learning models. We show that an adversary who can poison a training dataset can cause models trained on this dataset to leak significant private details of training points belonging to other…

密码学与安全 · 计算机科学 2022-10-07 Florian Tramèr , Reza Shokri , Ayrton San Joaquin , Hoang Le , Matthew Jagielski , Sanghyun Hong , Nicholas Carlini

Deep neural networks are susceptible to various inference attacks as they remember information about their training data. We design white-box inference attacks to perform a comprehensive privacy analysis of deep learning models. We measure…

机器学习 · 统计学 2020-06-09 Milad Nasr , Reza Shokri , Amir Houmansadr

With the emergence of powerful large-scale foundation models, the training paradigm is increasingly shifting from from-scratch training to transfer learning. This enables high utility training with small, domain-specific datasets typical in…

机器学习 · 计算机科学 2025-10-09 Yuxuan Bai , Gauri Pradhan , Marlon Tobaben , Antti Honkela

Deep learning models often raise privacy concerns as they leak information about their training data. This enables an adversary to determine whether a data point was in a model's training set by conducting a membership inference attack…

机器学习 · 计算机科学 2020-06-11 Yigitcan Kaya , Sanghyun Hong , Tudor Dumitras

Machine learning models are prone to memorizing sensitive data, making them vulnerable to membership inference attacks in which an adversary aims to guess if an input sample was used to train the model. In this paper, we show that prior…

密码学与安全 · 计算机科学 2020-12-10 Liwei Song , Prateek Mittal

Membership inference attacks aim to detect if a particular data point was used in training a model. We design a novel statistical test to perform robust membership inference attacks (RMIA) with low computational overhead. We achieve this by…

机器学习 · 统计学 2024-06-13 Sajjad Zarifzadeh , Philippe Liu , Reza Shokri

Since machine learning model is often trained on a limited data set, the model is trained multiple times on the same data sample, which causes the model to memorize most of the training set data. Membership Inference Attacks (MIAs) exploit…

机器学习 · 计算机科学 2024-11-19 Depeng Chen , Xiao Liu , Jie Cui , Hong Zhong

Model inversion (MI) attacks aim to infer and reconstruct private training data by abusing access to a model. MI attacks have raised concerns about the leaking of sensitive information (e.g. private face images used in training a face…

机器学习 · 计算机科学 2023-06-16 Ngoc-Bao Nguyen , Keshigeyan Chandrasegaran , Milad Abdollahzadeh , Ngai-Man Cheung

The integration of machine learning (ML) in numerous critical applications introduces a range of privacy concerns for individuals who provide their datasets for model training. One such privacy risk is Membership Inference (MI), in which an…

机器学习 · 计算机科学 2024-01-18 Harsh Chaudhari , Giorgio Severi , Alina Oprea , Jonathan Ullman

Membership Inference Attack (MIA) aims to determine whether a specific data sample was included in the training dataset of a target model. Traditional MIA approaches rely on shadow models to mimic target model behavior, but their…

信息检索 · 计算机科学 2026-03-20 Li Cuihong , Huang Xiaowen , Yin Chuanhuan , Sang Jitao

The increasing reliance on diffusion models for generating synthetic images has amplified concerns about the unauthorized use of personal data, particularly facial images, in model training. In this paper, we introduce a novel identity…

计算机视觉与模式识别 · 计算机科学 2024-10-15 Jayneel Vora , Aditya Krishnan , Nader Bouacida , Prabhu RV Shankar , Prasant Mohapatra

Federated Learning (FL) is an emerging solution to the data scarcity problem for training deep learning models in hardware assurance. While FL is designed to enhance privacy by not sharing raw data, it remains vulnerable to Membership…

Collaborative machine learning and related techniques such as federated learning allow multiple participants, each with his own training dataset, to build a joint model by training locally and periodically exchanging model updates. We…

密码学与安全 · 计算机科学 2018-11-02 Luca Melis , Congzheng Song , Emiliano De Cristofaro , Vitaly Shmatikov

Quantizing machine learning models has demonstrated its effectiveness in lowering memory and inference costs while maintaining performance levels comparable to those of the original models. In this work, we investigate the impact of…

机器学习 · 统计学 2026-05-27 Eric Aubinais , Philippe Formont , Pablo Piantanida , Elisabeth Gassiat

Learned recommender systems may inadvertently leak information about their training data, leading to privacy violations. We investigate privacy threats faced by recommender systems through the lens of membership inference. In such attacks,…

信息检索 · 计算机科学 2022-06-29 Zihan Wang , Na Huang , Fei Sun , Pengjie Ren , Zhumin Chen , Hengliang Luo , Maarten de Rijke , Zhaochun Ren

Large language models have revolutionized the field of NLP by achieving state-of-the-art performance on various tasks. However, there is a concern that these models may disclose information in the training data. In this study, we focus on…

计算与语言 · 计算机科学 2023-10-23 Ruixiang Tang , Gord Lueck , Rodolfo Quispe , Huseyin A Inan , Janardhan Kulkarni , Xia Hu

Deep neural networks have been shown to be vulnerable to membership inference attacks wherein the attacker aims to detect whether specific input data were used to train the model. These attacks can potentially leak private or proprietary…

机器学习 · 计算机科学 2020-09-18 Sumit Kumar Jha , Susmit Jha , Rickard Ewetz , Sunny Raj , Alvaro Velasquez , Laura L. Pullum , Ananthram Swami

Analyzing time-series data that contains personal information, particularly in the medical field, presents serious privacy concerns. Sensitive health data from patients is often used to train machine learning models for diagnostics and…

机器学习 · 计算机科学 2024-09-24 Noam Koren , Abigail Goldsteen , Guy Amit , Ariel Farkash

Generative models have demonstrated revolutionary success in various visual creation tasks, but in the meantime, they have been exposed to the threat of leaking private information of their training data. Several membership inference…

密码学与安全 · 计算机科学 2023-10-31 Minxing Zhang , Ning Yu , Rui Wen , Michael Backes , Yang Zhang

Large language models (LLMs) can leak sensitive training data through memorization and membership inference attacks. Prior work has primarily focused on strong adversarial assumptions, including attacker access to entire samples or long,…

机器学习 · 计算机科学 2025-05-21 Lucas Rosenblatt , Bin Han , Robert Wolfe , Bill Howe