English
Related papers

Related papers: Debiasing Machine Unlearning with Counterfactual E…

200 papers

Given the prevalence of large language models (LLMs) and the prohibitive cost of training these models from scratch, dynamically forgetting specific knowledge e.g., private or proprietary, without retraining the model has become an…

Computation and Language · Computer Science 2024-08-09 Tyler Lizzo , Larry Heck

Machine unlearning is a critical area of research aimed at safeguarding data privacy by enabling the removal of sensitive information from machine learning models. One unique challenge in this field is catastrophic unlearning, where erasing…

Machine Learning · Computer Science 2025-02-17 Zhuoyi Peng , Yixuan Tang , Yi Yang

Machine unlearning, which aims to efficiently remove the influence of specific data from trained models, is crucial for upholding data privacy regulations like the ``right to be forgotten". However, existing research predominantly evaluates…

Machine Learning · Computer Science 2026-02-24 Liheng Yu , Zhe Zhao , Yuxuan Wang , Pengkun Wang , Xiaofeng Cao , Binwu Wang , Yang Wang

Machine unlearning, the study of efficiently removing the impact of specific training instances on a model, has garnered increased attention in recent years due to regulatory guidelines such as the \emph{Right to be Forgotten}. Achieving…

Machine Learning · Computer Science 2024-06-07 Martin Pawelczyk , Seth Neel , Himabindu Lakkaraju

Unlearning has emerged as a critical capability for large language models (LLMs) to support data privacy, regulatory compliance, and ethical AI deployment. Recent techniques often rely on obfuscation by injecting incorrect or irrelevant…

Machine Learning · Computer Science 2025-09-10 Guangzhi Sun , Potsawee Manakul , Xiao Zhan , Mark Gales

Prediction failures of machine learning models often arise from deficiencies in training data, such as incorrect labels, outliers, and selection biases. However, such data points that are responsible for a given failure mode are generally…

Machine Learning · Computer Science 2022-11-11 Ryutaro Tanno , Melanie F. Pradier , Aditya Nori , Yingzhen Li

With the explosive growth of deep learning applications and increasing privacy concerns, the right to be forgotten has become a critical requirement in various AI industries. For example, given a facial recognition system, some individuals…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Dasol Choi , Dongbin Na

We consider the formulation of "machine unlearning" of Sekhari, Acharya, Kamath, and Suresh (NeurIPS 2021), which formalizes the so-called "right to be forgotten" by requiring that a trained model, upon request, should be able to "unlearn"…

Machine Learning · Computer Science 2023-09-06 Yiyang Huang , Clément L. Canonne

Machine unlearning is an emerging field that selectively removes specific data samples from a trained model. This capability is crucial for addressing privacy concerns, complying with data protection regulations, and correcting errors or…

Machine Learning · Computer Science 2025-01-29 Zitong Li , Qingqing Ye , Haibo Hu

Modern privacy regulations grant citizens the right to be forgotten by products, services and companies. In case of machine learning (ML) applications, this necessitates deletion of data not only from storage archives but also from ML…

Machine Learning · Computer Science 2023-06-01 Vikram S Chundawat , Ayush K Tarun , Murari Mandal , Mohan Kankanhalli

Machine unlearning algorithms, designed for selective removal of training data from models, have emerged as a promising approach to growing privacy concerns. In this work, we expose a critical yet underexplored vulnerability in the…

Cryptography and Security · Computer Science 2024-10-15 Yangsibo Huang , Daogao Liu , Lynn Chua , Badih Ghazi , Pritish Kamath , Ravi Kumar , Pasin Manurangsi , Milad Nasr , Amer Sinha , Chiyuan Zhang

Machine unlearning strives to uphold the data owners' right to be forgotten by enabling models to selectively forget specific data. Recent advances suggest pre-computing and storing statistics extracted from second-order information and…

Machine Learning · Computer Science 2025-02-07 Xinbao Qiao , Meng Zhang , Ming Tang , Ermin Wei

We formulate machine unlearning for online L-BFGS as a counterfactual state-alignment problem. Given an actual event stream and a deletion-edited counterfactual stream, the target of unlearning is the optimizer state that would have arisen…

Machine Learning · Computer Science 2026-05-19 Kennon Stewart

Machine Unlearning has emerged as a significant area of research, focusing on `removing' specific subsets of data from a trained model. Fine-tuning (FT) methods have become one of the fundamental approaches for approximating unlearning, as…

Machine Learning · Computer Science 2025-11-25 Meng Ding , Rohan Sharma , Changyou Chen , Jinhui Xu , Kaiyi Ji

Machine unlearning has the potential to improve the safety of large language models (LLMs) by removing sensitive or harmful information post hoc. A key challenge in unlearning involves balancing between forget quality (effectively…

Machine Learning · Computer Science 2025-06-23 Shengyuan Hu , Neil Kale , Pratiksha Thaker , Yiwei Fu , Steven Wu , Virginia Smith

A key assumption of most statistical machine learning methods is that they have access to independent samples from the distribution of data they encounter at test time. As such, these methods often perform poorly in the face of biased data,…

Machine Learning · Computer Science 2022-02-02 Xiaoting Shao , Karl Stelzner , Kristian Kersting

Machine unlearning has emerged as a key component in ensuring ``Right to be Forgotten'', enabling the removal of specific data points from trained models. However, even when the unlearning is performed without poisoning the forget-set…

Cryptography and Security · Computer Science 2025-06-17 Marco Arazzi , Antonino Nocera , Vinod P

Machine unlearning aims to remove sensitive or undesired data from large language models. However, recent studies suggest that unlearning is often shallow, claiming that removed knowledge can easily be recovered. In this work, we critically…

Machine Learning · Computer Science 2025-06-03 Zhili Feng , Yixuan Even Xu , Alexander Robey , Robert Kirk , Xander Davies , Yarin Gal , Avi Schwarzschild , J. Zico Kolter

With growing demands for privacy protection, security, and legal compliance (e.g., GDPR), machine unlearning has emerged as a critical technique for ensuring the controllability and regulatory alignment of machine learning models. However,…

Machine Learning · Computer Science 2026-04-08 Lulu Xue , Shengshan Hu , Wei Lu , Yan Shen , Dongxu Li , Peijin Guo , Ziqi Zhou , Minghui Li , Yanjun Zhang , Leo Yu Zhang