English
Related papers

Related papers: Efficient Unlearning through Maximizing Relearning…

200 papers

The practical needs of the ``right to be forgotten'' and poisoned data removal call for efficient \textit{machine unlearning} techniques, which enable machine learning models to unlearn, or to forget a fraction of training data and its…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Min Chen , Weizhuo Gao , Gaoyang Liu , Kai Peng , Chen Wang

The past a few years have witnessed the great success of large language models, demonstrating powerful capabilities in comprehending textual data and generating human-like languages. Large language models achieve success by being trained on…

Computation and Language · Computer Science 2025-03-20 Estrid He , Tabinda Sarwar , Ibrahim Khalil , Xun Yi , Ke Wang

Machine unlearning methods take a model trained on a dataset and a forget set, then attempt to produce a model as if it had only been trained on the examples not in the forget set. We empirically show that an adversary is able to…

Machine Learning · Computer Science 2025-05-14 Brennon Brimhall , Philip Mathew , Neil Fendley , Yinzhi Cao , Matthew Green

Machine unlearning as an emerging research topic for data regulations, aims to adjust a trained model to approximate a retrained one that excludes a portion of training data. Previous studies showed that class-wise unlearning is successful…

Machine Learning · Computer Science 2024-06-18 Jianing Zhu , Bo Han , Jiangchao Yao , Jianliang Xu , Gang Niu , Masashi Sugiyama

Machine unlearning aims to selectively remove specific knowledge from a trained model. Existing approaches, such as Task Arithmetic, fine-tune the model on the forget set to create a task vector (i.e., a direction in weight space) for…

Machine Learning · Computer Science 2025-07-03 Hyo Seo Kim , Dongyoon Han , Junsuk Choe

Recently, the enactment of privacy regulations has promoted the rise of the machine unlearning paradigm. Existing studies of machine unlearning mainly focus on sample-wise unlearning, such that a learnt model will not expose user's privacy…

Machine Learning · Computer Science 2022-04-19 Tao Guo , Song Guo , Jiewei Zhang , Wenchao Xu , Junxiao Wang

Machine Unlearning (MU) aims at removing the influence of specific data points from a trained model, striving to achieve this at a fraction of the cost of full model retraining. In this paper, we analyze the efficiency of unlearning methods…

Machine Learning · Statistics 2025-06-24 Martin Van Waerebeke , Marco Lorenzi , Giovanni Neglia , Kevin Scaman

Machine unlearning aims to remove the influence of specific training records from a deployed model without retraining from scratch. Current protocols verify this at the output level through membership inference, retain accuracy, and…

Artificial Intelligence · Computer Science 2026-05-28 Georgina Cosma , Axel Finke

Machine unlearning is the process of removing the imprint left by specific data samples during the training of a machine learning model. AI developers, including those building personalized technologies, employ machine unlearning for…

Machine Learning · Computer Science 2026-03-10 Hanyu Duan , Yi Yang , Ahmed Abbasi , Kar Yan Tam

In education data mining (EDM) communities, machine learning has achieved remarkable success in discovering patterns and structures to tackle educational challenges. Notably, fairness and algorithmic bias have gained attention in learning…

Machine Learning · Computer Science 2024-05-30 Wei Qian , Aobo Chen , Chenxu Zhao , Yangyi Li , Mengdi Huai

Machine unlearning has become a promising solution for fulfilling the "right to be forgotten", under which individuals can request the deletion of their data from machine learning models. However, existing studies of machine unlearning…

Cryptography and Security · Computer Science 2024-04-05 Hongsheng Hu , Shuo Wang , Tian Dong , Minhui Xue

Duplication is a prevalent issue within datasets. Existing research has demonstrated that the presence of duplicated data in training datasets can significantly influence both model performance and data privacy. However, the impact of data…

Cryptography and Security · Computer Science 2025-07-17 Dayong Ye , Tianqing Zhu , Jiayang Li , Kun Gao , Bo Liu , Leo Yu Zhang , Wanlei Zhou , Yang Zhang

Machine unlearning focuses on the computationally efficient removal of specific training data from trained models, ensuring that the influence of forgotten data is effectively eliminated without the need for full retraining. Despite…

Machine Learning · Statistics 2025-05-13 Haolin Zou , Arnab Auddy , Yongchan Kwon , Kamiar Rahnama Rad , Arian Maleki

Machine unlearning techniques aim to mitigate unintended memorization in large language models (LLMs). However, existing approaches predominantly focus on the explicit removal of isolated facts, often overlooking latent inferential…

Large Language Models (LLMs) are foundational to AI advancements, facilitating applications like predictive text generation. Nonetheless, they pose risks by potentially memorizing and disseminating sensitive, biased, or copyrighted…

Artificial Intelligence · Computer Science 2024-03-26 Youyang Qu , Ming Ding , Nan Sun , Kanchana Thilakarathna , Tianqing Zhu , Dusit Niyato

The imperative to eliminate undesirable data memorization underscores the significance of machine unlearning for large language models (LLMs). Recent research has introduced a series of promising unlearning methods, notably boosting the…

Machine Learning · Computer Science 2025-02-26 Qizhou Wang , Bo Han , Puning Yang , Jianing Zhu , Tongliang Liu , Masashi Sugiyama

Machine unlearning algorithms aim to efficiently remove data from a model without retraining it from scratch, in order to remove corrupted or outdated data or respect a user's ``right to be forgotten." Certified machine unlearning is a…

Machine Learning · Computer Science 2025-12-16 Siqiao Mu , Diego Klabjan

As machine learning becomes more pervasive and data privacy regulations evolve, the ability to remove private or copyrighted information from trained models is becoming an increasingly critical requirement. Existing unlearning methods often…

Large language model unlearning has become a critical challenge in ensuring safety and controlled model behavior by removing undesired data-model influences from the pretrained model while preserving general utility. Significant recent…

Computation and Language · Computer Science 2025-04-17 Soumyadeep Pal , Changsheng Wang , James Diffenderfer , Bhavya Kailkhura , Sijia Liu

The widespread adoption of diffusion models in image generation has increased the demand for privacy-compliant unlearning. However, due to the high-dimensional nature and complex feature representations of diffusion models, achieving…

Computer Vision and Pattern Recognition · Computer Science 2025-09-10 Zhenyu Yu , Mohd Yamani Inda Idris , Pei Wang