English
Related papers

Related papers: Unlearning's Blind Spots: Over-Unlearning and Prot…

200 papers

Machine unlearning (MU) seeks to remove the influence of specified data from a trained model in response to privacy requests or data poisoning. While certified unlearning has been analyzed in centralized and server-orchestrated federated…

Machine Learning · Computer Science 2025-12-10 Hithem Lamri , Michail Maniatakos

Machine unlearning for large language models often faces a privacy dilemma in which strict constraints prohibit sharing either the server's parameters or the client's forget set. To address this dual non-disclosure constraint, we propose…

Machine Learning · Computer Science 2026-05-15 Tiantong Wang , Xinyu Yan , Tiantong Wu , Yurong Hao , Pengjun Xie , Wei Yang Bryan Lim

We study the problem of unlearning datapoints from a learnt model. The learner first receives a dataset $S$ drawn i.i.d. from an unknown distribution, and outputs a model $\widehat{w}$ that performs well on unseen samples from the same…

Machine Learning · Computer Science 2021-07-23 Ayush Sekhari , Jayadev Acharya , Gautam Kamath , Ananda Theertha Suresh

Machine unlearning is the process through which a deployed machine learning model is made to forget about some of its training data points. While naively retraining the model from scratch is an option, it is almost always associated with…

Machine Learning · Computer Science 2022-03-03 Anvith Thudi , Gabriel Deza , Varun Chandrasekaran , Nicolas Papernot

Modern computer systems store vast amounts of personal data, enabling advances in AI and ML but risking user privacy and trust. For privacy reasons, it is sometimes desired for an ML model to forget part of the data it was trained on. In…

Machine Learning · Computer Science 2025-12-30 Amartya Hatua , Trung T. Nguyen , Filip Cano , Andrew H. Sung

Multimodal recommendation systems (MRS) jointly model user-item interaction graphs and rich item content, but this tight coupling makes user data difficult to remove once learned. Approximate machine unlearning offers an efficient…

Artificial Intelligence · Computer Science 2026-04-13 Zhanting Zhou , KaHou Tam , Ziqiang Zheng , Zeyu Ma , Yang Yang

Machine unlearning (MU) is gaining increasing attention due to the need to remove or modify predictions made by machine learning (ML) models. While training models have become more efficient and accurate, the importance of unlearning…

Machine Learning · Computer Science 2024-10-28 Thanveer Shaik , Xiaohui Tao , Haoran Xie , Lin Li , Xiaofeng Zhu , Qing Li

Machine unlearning refers to removing the influence of a specified subset of training data from a machine learning model, efficiently, after it has already been trained. This is important for key applications, including making the model…

Transformer has become fundamental to a vast series of pre-trained large models that have achieved remarkable success across diverse applications. Machine unlearning, which focuses on efficiently removing specific data influences to comply…

Machine Learning · Computer Science 2025-08-26 Wenjie Bao , Jian Lou , Yuke Hu , Xiaochen Li , Zhihao Liu , Jiaqi Liu , Zhan Qin , Kui Ren

Large language models (LLMs) possess strong semantic understanding, driving significant progress in data mining applications. This is further enhanced by large reasoning models (LRMs), which provide explicit multi-step reasoning traces. On…

Machine Learning · Computer Science 2026-04-07 Aobo Chen , Chenxu Zhao , Chenglin Miao , Mengdi Huai

The undesired memorization of sensitive information by Large Language Models (LLMs) has emphasized the need for safety mechanisms that can regulate model behavior. This has led to the development of machine unlearning techniques that enable…

Machine Learning · Computer Science 2025-10-10 Anu Agarwal , Mihir Pamnani , Dilek Hakkani-Tur

Currently, various uncertainty quantification methods have been proposed to provide certainty and probability estimates for deep learning models' label predictions. Meanwhile, with the growing demand for the right to be forgotten, machine…

Machine Learning · Computer Science 2025-08-12 Wei Qian , Chenxu Zhao , Yangyi Li , Wenqian Ye , Mengdi Huai

Machine unlearning has emerged as an important component in developing safe and trustworthy models. Prior work on fact unlearning in LLMs has mostly focused on removing a specified target fact robustly, but often overlooks its deductive…

Computation and Language · Computer Science 2025-11-13 Ruihan Wu , Chhavi Yadav , Russ Salakhutdinov , Kamalika Chaudhuri

We address the problem of machine unlearning, where the goal is to remove the influence of specific training data from a model upon request, motivated by privacy concerns and regulatory requirements such as the "right to be forgotten."…

Machine Learning · Computer Science 2025-06-12 Anastasia Koloskova , Youssef Allouah , Animesh Jha , Rachid Guerraoui , Sanmi Koyejo

In current AI era, users may request AI companies to delete their data from the training dataset due to the privacy concerns. As a model owner, retraining a model will consume significant computational resources. Therefore, machine…

Machine Learning · Computer Science 2024-05-27 Wenhan Chang , Tianqing Zhu , Heng Xu , Wenjian Liu , Wanlei Zhou

The right to erasure requires removal of a user's information from data held by organizations, with rigorous interpretations extending to downstream products such as learned models. Retraining from scratch with the particular user's data…

Machine Learning · Computer Science 2022-02-11 Neil G. Marchant , Benjamin I. P. Rubinstein , Scott Alfeld

Machine unlearning enables pre-trained models to remove the effect of certain portions of training data. Previous machine unlearning schemes have mainly focused on unlearning a cluster of instances or all instances belonging to a specific…

Cryptography and Security · Computer Science 2024-06-18 Heng Xu , Tianqing Zhu , Wanlei Zhou , Wei Zhao

Incremental class learning, a scenario in continual learning context where classes and their training data are sequentially and disjointedly observed, challenges a problem widely known as catastrophic forgetting. In this work, we propose a…

Machine Learning · Computer Science 2019-07-19 Euntae Choi , Kyungmi Lee , Kiyoung Choi

We introduce camouflaged data poisoning attacks, a new attack vector that arises in the context of machine unlearning and other settings when model retraining may be induced. An adversary first adds a few carefully crafted points to the…

Machine Learning · Computer Science 2024-08-02 Jimmy Z. Di , Jack Douglas , Jayadev Acharya , Gautam Kamath , Ayush Sekhari

Machine unlearning algorithms, designed for selective removal of training data from models, have emerged as a promising approach to growing privacy concerns. In this work, we expose a critical yet underexplored vulnerability in the…

Cryptography and Security · Computer Science 2024-10-15 Yangsibo Huang , Daogao Liu , Lynn Chua , Badih Ghazi , Pritish Kamath , Ravi Kumar , Pasin Manurangsi , Milad Nasr , Amer Sinha , Chiyuan Zhang