中文
相关论文

相关论文: Debiasing Learning for Membership Inference Attack…

200 篇论文

Membership inference attacks (MIAs) aim to determine whether a sample was part of a model's training set, posing serious privacy risks for modern machine-learning systems. Existing MIAs primarily rely on static indicators, such as loss or…

人工智能 · 计算机科学 2026-02-06 Amit Kravchik Taub , Fred M. Grabovski , Guy Amit , Yisroel Mirsky

Attacks that aim to identify the training data of public neural networks represent a severe threat to the privacy of individuals participating in the training data set. A possible protection is offered by anonymization of the training data…

密码学与安全 · 计算机科学 2020-05-27 Daniel Bernau , Philip-William Grassal , Jonas Robl , Florian Kerschbaum

Safety classifiers are essential safeguards within generative AI systems, filtering harmful content or identifying at-risk users when interacting with large language models. Despite their necessity, these models are trained on sensitive…

机器学习 · 计算机科学 2026-05-25 Anthony Hughes , Alexander Goldberg , Prince Jha , Adam Perer , Nikolaos Aletras , Niloofar Mireshghallah

In membership inference attacks (MIAs), an adversary observes the predictions of a model to determine whether a sample is part of the model's training data. Existing MIA defenses conceal the presence of a target sample through strong…

密码学与安全 · 计算机科学 2022-03-03 Ismat Jarin , Birhanu Eshete

The remarkable proliferation of deep learning across various industries has underscored the importance of data privacy and security in AI pipelines. As the evolution of sophisticated Membership Inference Attacks (MIAs) threatens the secrecy…

密码学与安全 · 计算机科学 2023-06-06 Eugenio Lomurno , Alberto Archetti , Francesca Ausonio , Matteo Matteucci

Membership inference attacks (MIAs) threaten the privacy of machine learning models by revealing whether a specific data point was used during training. Existing MIAs often rely on impractical assumptions such as access to public datasets,…

机器学习 · 计算机科学 2026-02-24 Abdullah Caglar Oksuz , Anisa Halimi , Erman Ayday

With the widespread application of large language models (LLM), concerns about the privacy leakage of model training data have increasingly become a focus. Membership Inference Attacks (MIAs) have emerged as a critical tool for evaluating…

机器人学 · 计算机科学 2024-12-24 Zichen Song , Sitan Huang , Zhongfeng Kang

Membership inference attack (MIA) poses a significant privacy threat in federated learning (FL) as it allows adversaries to determine whether a client's private dataset contains a specific data sample. While defenses against membership…

机器学习 · 计算机科学 2026-02-10 Quan Minh Nguyen , Min-Seon Kim , Hoang M. Ngo , Trong Nghia Hoang , Hyuk-Yoon Kwon , My T. Thai

The advent of the information age has led to the problems of information overload and unclear demands. As an information filtering system, personalized recommendation systems predict users' behavior and preference for items and improves…

密码学与安全 · 计算机科学 2023-01-11 Dazhi Hu

While being deployed in many critical applications as core components, machine learning (ML) models are vulnerable to various security and privacy attacks. One major privacy attack in this domain is membership inference, where an adversary…

密码学与安全 · 计算机科学 2020-09-11 Yang Zou , Zhikun Zhang , Michael Backes , Yang Zhang

Recently, adapting the idea of self-supervised learning (SSL) on continuous speech has started gaining attention. SSL models pre-trained on a huge amount of unlabeled audio can generate general-purpose representations that benefit a wide…

密码学与安全 · 计算机科学 2022-08-16 Wei-Cheng Tseng , Wei-Tsung Kao , Hung-yi Lee

Large Language Models (LLMs) embed sensitive, human-generated data, prompting the need for unlearning methods. Although certified unlearning offers strong privacy guarantees, its restrictive assumptions make it unsuitable for LLMs, giving…

机器学习 · 计算机科学 2025-06-03 Rongzhe Wei , Mufei Li , Mohsen Ghassemi , Eleonora Kreačić , Yifan Li , Xiang Yue , Bo Li , Vamsi K. Potluru , Pan Li , Eli Chien

Federated learning (FL) is a popular approach to facilitate privacy-aware machine learning since it allows multiple clients to collaboratively train a global model without granting others access to their private data. It is, however, known…

密码学与安全 · 计算机科学 2023-10-03 Hongsheng Hu , Xuyun Zhang , Zoran Salcic , Lichao Sun , Kim-Kwang Raymond Choo , Gillian Dobbie

Federated Learning (FL) is an emerging solution to the data scarcity problem for training deep learning models in hardware assurance. While FL is designed to enhance privacy by not sharing raw data, it remains vulnerable to Membership…

Given a trained model and a data sample, membership-inference (MI) attacks predict whether the sample was in the model's training set. A common countermeasure against MI attacks is to utilize differential privacy (DP) during model training…

密码学与安全 · 计算机科学 2022-04-14 Saeed Mahloujifar , Alexandre Sablayrolles , Graham Cormode , Somesh Jha

Machine learning models are known to leak sensitive information, as they inevitably memorize (parts of) their training data. More alarmingly, large language models (LLMs) are now trained on nearly all available data, which amplifies the…

机器学习 · 计算机科学 2025-10-10 Jiashu Tao , Reza Shokri

Decentralized training has become a resource-efficient framework to democratize the training of large language models (LLMs). However, the privacy risks associated with this framework, particularly due to the potential inclusion of…

密码学与安全 · 计算机科学 2025-02-25 Chenxi Dai , Lin Lu , Pan Zhou

Machine learning models have been shown to be vulnerable to membership inference attacks, i.e., inferring whether individuals' data have been used for training models. The lack of understanding about factors contributing success of these…

机器学习 · 计算机科学 2020-04-29 Farhad Farokhi , Mohamed Ali Kaafar

Membership inference attacks (MIAs) aim to determine whether a specific example was used to train a given language model. While prior work has explored prompt-based attacks such as ReCALL, these methods rely heavily on the assumption that…

计算与语言 · 计算机科学 2026-01-27 Gyuwan Kim , Yang Li , Evangelia Spiliopoulou , Jie Ma , William Yang Wang

The raise of machine learning and deep learning led to significant improvement in several domains. This change is supported by both the dramatic rise in computation power and the collection of large datasets. Such massive datasets often…

机器学习 · 计算机科学 2022-11-24 Hamid Jalalzai , Elie Kadoche , Rémi Leluc , Vincent Plassier