English
Related papers

Related papers: Towards Lifecycle Unlearning Commitment Management…

200 papers

Membership inference attacks (MIAs) are used to test practical privacy of machine learning models. MIAs complement formal guarantees from differential privacy (DP) under a more realistic adversary model. We analyse MIA vulnerability of…

Cryptography and Security · Computer Science 2026-02-03 Marlon Tobaben , Hibiki Ito , Joonas Jälkö , Yuan He , Antti Honkela

A membership inference attack (MIA) against a machine-learning model enables an attacker to determine whether a given data record was part of the model's training data or not. In this paper, we provide an in-depth study of the phenomenon of…

Machine Learning · Computer Science 2021-09-20 Bogdan Kulynych , Mohammad Yaghini , Giovanni Cherubin , Michael Veale , Carmela Troncoso

Machine unlearning offers a promising solution to privacy and safety concerns in large language models (LLMs) by selectively removing targeted knowledge while preserving utility. However, current methods are highly sensitive to downstream…

Machine unlearning enables the removal of specific data from ML models to uphold the right to be forgotten. While approximate unlearning algorithms offer efficient alternatives to full retraining, this work reveals that they fail to…

Machine Learning · Computer Science 2025-07-29 Yaxin Xiao , Qingqing Ye , Li Hu , Huadi Zheng , Haibo Hu , Zi Liang , Haoyang Li , Yijie Jiao

Safety classifiers are essential safeguards within generative AI systems, filtering harmful content or identifying at-risk users when interacting with large language models. Despite their necessity, these models are trained on sensitive…

Machine Learning · Computer Science 2026-05-25 Anthony Hughes , Alexander Goldberg , Prince Jha , Adam Perer , Nikolaos Aletras , Niloofar Mireshghallah

Machine learning models are known to leak sensitive information, as they inevitably memorize (parts of) their training data. More alarmingly, large language models (LLMs) are now trained on nearly all available data, which amplifies the…

Machine Learning · Computer Science 2025-10-10 Jiashu Tao , Reza Shokri

Large Language Models (LLMs) have the promise to revolutionize computing broadly, but their complexity and extensive training data also expose significant privacy vulnerabilities. One of the simplest privacy risks associated with LLMs is…

Machine Learning · Computer Science 2024-09-25 Rongting Zhang , Martin Bertran , Aaron Roth

Large language models (LLMs) are trained on massive corpora that may contain sensitive information, creating privacy risks under membership inference attacks (MIAs). Knowledge distillation is widely used to compress LLMs into smaller…

Machine Learning · Computer Science 2026-01-13 Ziyao Cui , Minxing Zhang , Jian Pei

Machine unlearning aims to enable models to forget specific data instances when receiving deletion requests. Current research centres on efficient unlearning to erase the influence of data from the model and neglects the subsequent impacts…

Machine Learning · Computer Science 2024-04-23 Huiqiang Chen , Tianqing Zhu , Xin Yu , Wanlei Zhou

Membership inference attacks (MIAs) pose a critical threat to the privacy of training data in deep learning. Despite significant progress in attack methodologies, our understanding of when and how models encode membership information during…

Machine Learning · Computer Science 2025-08-05 Yuetian Chen , Zhiqi Wang , Nathalie Baracaldo , Swanand Ravindra Kadhe , Lei Yu

Membership inference attacks (MIAs) aim to determine whether a specific example was used to train a given language model. While prior work has explored prompt-based attacks such as ReCALL, these methods rely heavily on the assumption that…

Computation and Language · Computer Science 2026-01-27 Gyuwan Kim , Yang Li , Evangelia Spiliopoulou , Jie Ma , William Yang Wang

The rapid advancements in artificial intelligence (AI) have primarily focused on the process of learning from data to acquire knowledgeable learning systems. As these systems are increasingly deployed in critical areas, ensuring their…

Machine Learning · Computer Science 2025-12-23 Wei Qian , Chenxu Zhao , Yangyi Li , Mengdi Huai

Estimating statistical uncertainties allows autonomous agents to communicate their confidence during task execution and is important for applications in safety-critical domains such as autonomous driving. In this work, we present the…

Machine Learning · Computer Science 2019-05-09 Yuchen Cui , David Isele , Scott Niekum , Kikuo Fujimura

Transfer learning, successful in knowledge translation across related tasks, faces a substantial privacy threat from membership inference attacks (MIAs). These attacks, despite posing significant risk to ML model's training data, remain…

Cryptography and Security · Computer Science 2025-01-22 Cong Wu , Jing Chen , Qianru Fang , Kun He , Ziming Zhao , Hao Ren , Guowen Xu , Yang Liu , Yang Xiang

Membership inference attacks (MIAs) pose a serious threat to the privacy of machine learning models by allowing adversaries to determine whether a specific data sample was included in the training set. Although federated learning (FL) is…

Cryptography and Security · Computer Science 2026-01-27 Mohammad Zare , Pirooz Shamsinejadbabaki

This paper presents how to leak private information from a wireless signal classifier by launching an over-the-air membership inference attack (MIA). As machine learning (ML) algorithms are used to process wireless signals to make decisions…

Signal Processing · Electrical Eng. & Systems 2020-06-26 Yi Shi , Kemal Davaslioglu , Yalin E. Sagduyu

In a membership inference attack (MIA), an attacker exploits the overconfidence exhibited by typical machine learning models to determine whether a specific data point was used to train a target model. In this paper, we analyze the…

Information Theory · Computer Science 2025-06-10 Meiyi Zhu , Caili Guo , Chunyan Feng , Osvaldo Simeone

Membership Inference Attacks (MIAs) act as a crucial auditing tool for the opaque training data of Large Language Models (LLMs). However, existing techniques predominantly rely on inaccessible model internals (e.g., logits) or suffer from…

Computation and Language · Computer Science 2026-01-19 Jiatong Yi , Yanyang Li

Membership inference attacks (MIA) try to detect if data samples were used to train a neural network model, e.g. to detect copyright abuses. We show that models with higher dimensional input and output are more vulnerable to MIA, and…

Machine Learning · Computer Science 2021-08-19 Avital Shafran , Shmuel Peleg , Yedid Hoshen

This study investigates the concept of the `right to be forgotten' within the context of large language models (LLMs). We explore machine unlearning as a pivotal solution, with a focus on pre-trained models--a notably under-researched area.…

Computation and Language · Computer Science 2024-05-31 Jin Yao , Eli Chien , Minxin Du , Xinyao Niu , Tianhao Wang , Zezhou Cheng , Xiang Yue
‹ Prev 1 3 4 5 6 7 10 Next ›