English
Related papers

Related papers: Why Some Models Resist Unlearning: A Linear Stabil…

200 papers

Machine unlearning poses the challenge of ``how to eliminate the influence of specific data from a pretrained model'' in regard to privacy concerns. While prior research on approximated unlearning has demonstrated accuracy and efficiency in…

Machine Learning · Computer Science 2025-04-21 Khoa Tran , Simon S. Woo

Machine unlearning is an emerging technology that has come to attract widespread attention. A number of factors, including regulations and laws, privacy, and usability concerns, have resulted in this need to allow a trained model to forget…

Machine Learning · Computer Science 2024-06-18 Heng Xu , Tianqing Zhu , Lefeng Zhang , Wanlei Zhou , Wei Zhao

Visual modality is the most vulnerable to privacy leakage in real-world multimodal applications like autonomous driving with visual and radar data; Machine unlearning removes specific training data from pre-trained models to address privacy…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Jinghan Xu Yuyang Zhang Qixuan Cai Jiancheng Chen Keqiu Li

Methods for knowledge editing and unlearning in large language models seek to edit or remove undesirable knowledge or capabilities without compromising general language modeling performance. This work investigates how mechanistic…

Machine Learning · Computer Science 2024-12-06 Phillip Guo , Aaquib Syed , Abhay Sheshadri , Aidan Ewart , Gintare Karolina Dziugaite

Large language models (LLMs) may memorize sensitive or copyrighted content, raising privacy and legal concerns. Due to the high cost of retraining from scratch, researchers attempt to employ machine unlearning to remove specific content…

Computation and Language · Computer Science 2025-08-12 Xiaojian Yuan , Tianyu Pang , Chao Du , Kejiang Chen , Weiming Zhang , Min Lin

Machine unlearning is the process of removing the impact of a particular set of training samples from a pretrained model. It aims to fulfill the "right to be forgotten", which grants the individuals such as patients the right to reconsider…

Machine Learning · Computer Science 2024-07-11 Reza Nasirigerdeh , Nader Razmi , Julia A. Schnabel , Daniel Rueckert , Georgios Kaissis

Unlearning in large language models (LLMs) aims to remove harmful training data while preserving overall utility. However, we find that existing methods often hallucinate, generate abnormal token sequences, or behave inconsistently, raising…

Machine Learning · Computer Science 2026-05-12 Renjie Gu , Jiazhen Du , Yihua Zhang , Sijia Liu

Machine unlearning aims to remove the influence of specific training data from pre-trained models without retraining from scratch, and is increasingly important for large language models (LLMs) due to safety, privacy, and legal concerns.…

Computation and Language · Computer Science 2026-03-17 Ruihao Pan , Suhang Wang

Catastrophic forgetting is a major problem in continual learning, and lots of approaches arise to reduce it. However, most of them are evaluated through task accuracy, which ignores the internal model structure. Recent research suggests…

Machine Learning · Computer Science 2026-03-06 Yunqin Zhu , Jun Jin

Machine unlearning is a promising paradigm for removing unwanted data samples from a trained model, towards ensuring compliance with privacy regulations and limiting harmful biases. Although unlearning has been shown in, e.g.,…

Image and Video Processing · Electrical Eng. & Systems 2024-06-19 Yuyang Xue , Jingshuai Liu , Steven McDonagh , Sotirios A. Tsaftaris

Machine unlearning is the task of updating machine learning (ML) models after a subset of the training data they were trained on is deleted. Methods for the task are desired to combine effectiveness and efficiency, i.e., they should…

Machine Learning · Computer Science 2021-08-17 Ananth Mahadevan , Michael Mathioudakis

Machine unlearning is an emerging paradigm to remove the influence of specific training data (i.e., the forget set) from a model while preserving its knowledge of the rest of the data (i.e., the retain set). Previous approaches assume the…

Machine Learning · Computer Science 2025-12-17 Thomas De Min , Subhankar Roy , Stéphane Lathuilière , Elisa Ricci , Massimiliano Mancini

Machine unlearning focuses on the computationally efficient removal of specific training data from trained models, ensuring that the influence of forgotten data is effectively eliminated without the need for full retraining. Despite…

Machine Learning · Statistics 2025-05-13 Haolin Zou , Arnab Auddy , Yongchan Kwon , Kamiar Rahnama Rad , Arian Maleki

Modern computer systems store vast amounts of personal data, enabling advances in AI and ML but risking user privacy and trust. For privacy reasons, it is sometimes desired for an ML model to forget part of the data it was trained on. In…

Machine Learning · Computer Science 2025-12-30 Amartya Hatua , Trung T. Nguyen , Filip Cano , Andrew H. Sung

As generative models become increasingly powerful and pervasive, the ability to unlearn specific data, whether due to privacy concerns, legal requirements, or the correction of harmful content, has become increasingly important. Unlike in…

Machine Learning · Computer Science 2025-09-26 Pinak Mandal , Georg A. Gottwald

Once users have shared their data online, it is generally difficult for them to revoke access and ask for the data to be deleted. Machine learning (ML) exacerbates this problem because any model trained with said data may have memorized it,…

Machine Unlearning (MUL) is crucial for privacy protection and content regulation, yet recent studies reveal that traces of forgotten information persist in unlearned models, enabling adversaries to resurface removed knowledge. Existing…

Machine Learning · Computer Science 2025-04-22 Hao Xuan , Xingyu Li

Advanced model dememorization methods, including availability poisoning (unlearnability) and machine unlearning, are emerging as key safeguards against data misuse in machine learning (ML). At the training stage, unlearnability embeds…

Machine Learning · Computer Science 2026-05-13 Mengying Zhang , Derui Wang , Ruoxi Sun , Xiaoyu Xia , Shuang Hao , Minhui Xue

Unlearning algorithms aim to remove deleted data's influence from trained models at a cost lower than full retraining. However, prior guarantees of unlearning in literature are flawed and don't protect the privacy of deleted records. We…

Machine Learning · Statistics 2023-02-15 Rishav Chourasia , Neil Shah

Machine unlearning is an emerging field that selectively removes specific data samples from a trained model. This capability is crucial for addressing privacy concerns, complying with data protection regulations, and correcting errors or…

Machine Learning · Computer Science 2025-01-29 Zitong Li , Qingqing Ye , Haibo Hu