中文
相关论文

相关论文: Learning to Unlearn while Retaining: Combating Gra…

200 篇论文

Large language models (LLMs) have achieved remarkable success across natural language processing tasks, yet their widespread deployment raises pressing concerns around privacy, copyright, security, and bias. Machine unlearning has emerged…

计算与语言 · 计算机科学 2026-01-21 Tyler Lizzo , Larry Heck

Machine unlearning, the study of efficiently removing the impact of specific training instances on a model, has garnered increased attention in recent years due to regulatory guidelines such as the \emph{Right to be Forgotten}. Achieving…

机器学习 · 计算机科学 2024-06-07 Martin Pawelczyk , Seth Neel , Himabindu Lakkaraju

Machine unlearning aims to remove sensitive or undesired data from large language models. However, recent studies suggest that unlearning is often shallow, claiming that removed knowledge can easily be recovered. In this work, we critically…

Machine unlearning algorithms aim to remove the influence of specific training samples, ideally recovering the model that would have resulted from training on the remaining data alone. We study unlearning in the overparameterized setting,…

机器学习 · 计算机科学 2025-10-24 Jacob L. Block , Aryan Mokhtari , Sanjay Shakkottai

Machine unlearning seeks to selectively remove the "influence" of specific training data on a model's outputs. The ideal goal is Retrain Equivalence--behavior identical to a model trained from scratch on only the retained data. This goal…

机器学习 · 计算机科学 2025-10-31 Jiatong Yu , Yinghui He , Anirudh Goyal , Sanjeev Arora

Machine unlearning is the process of efficiently removing specific information from a trained machine learning model without retraining from scratch. Existing unlearning methods, which often provide provable guarantees, typically involve…

AI models need to be unlearned to fulfill the requirements of legal acts such as the AI Act or GDPR, and also because of the need to remove toxic content, debiasing, the impact of malicious instances, or changes in the data distribution…

机器学习 · 计算机科学 2025-07-16 Patryk Jasiorski , Marek Klonowski , Michał Woźniak

Deep neural networks achieve state-of-the-art and sometimes super-human performance across various domains. However, when learning tasks sequentially, the networks easily forget the knowledge of previous tasks, known as "catastrophic…

计算机视觉与模式识别 · 计算机科学 2021-05-18 Shixiang Tang , Dapeng Chen , Jinguo Zhu , Shijie Yu , Wanli Ouyang

As models are getting larger and are trained on increasing amounts of data, there has been an explosion of interest into how we can ``delete'' specific data points or behaviours from a trained model, after the fact. This goal has been…

Machine unlearning, the ability to erase the effect of specific training samples without retraining from scratch, is critical for privacy, regulation, and efficiency. However, most progress in unlearning has been empirical, with little…

机器学习 · 计算机科学 2026-02-04 Wei-Kai Chang , Rajiv Khanna

Machine unlearning refers to the process of mitigating the influence of specific training data on machine learning models based on removal requests from data owners. However, one important area that has been largely overlooked in the…

密码学与安全 · 计算机科学 2025-07-17 Dayong Ye , Tianqing Zhu , Congcong Zhu , Derui Wang , Kun Gao , Zewei Shi , Sheng Shen , Wanlei Zhou , Minhui Xue

Large Language Models (LLMs) trained on extensive datasets often learn sensitive information, which raises significant social and legal concerns under principles such as the "Right to be forgotten." Retraining entire models from scratch to…

计算与语言 · 计算机科学 2025-04-18 Kun-Woo Kim , Ji-Hoon Park , Ju-Min Han , Seong-Whan Lee

Machine unlearning aims to remove the influence of specific training data from a learned model without full retraining. While recent work has begun to explore unlearning in quantum machine learning, existing approaches largely rely on…

机器学习 · 计算机科学 2026-02-10 Nausherwan Malik , Zubair Khalid , Muhammad Faryad

A fundamental challenge for multi-task learning is that different tasks may conflict with each other when they are solved jointly, and a cause of this phenomenon is conflicting gradients during optimization. Recent works attempt to mitigate…

机器学习 · 计算机科学 2023-02-23 Guangyuan Shi , Qimai Li , Wenlong Zhang , Jiaxin Chen , Xiao-Ming Wu

Machine unlearning -- efficiently removing the effect of a small "forget set" of training data on a pre-trained machine learning model -- has recently attracted significant research interest. Despite this interest, however, recent work…

机器学习 · 计算机科学 2024-11-13 Kristian Georgiev , Roy Rinberg , Sung Min Park , Shivam Garg , Andrew Ilyas , Aleksander Madry , Seth Neel

Machine unlearning offers a practical alternative to avoid full model re-training by approximately removing the influence of specific user data. While existing methods certify unlearning via statistical indistinguishability from re-trained…

机器学习 · 计算机科学 2026-02-02 Hsiang Hsu , Pradeep Niroula , Zichang He , Ivan Brugere , Freddy Lecue , Chun-Fu Chen

The current trend in data regulation requirements and privacy-preserving machine learning has emphasized the importance of machine unlearning. The naive approach to unlearning training data by retraining over the complement of the forget…

机器学习 · 计算机科学 2024-05-14 Junaid Iqbal Khan

The imperative to eliminate undesirable data memorization underscores the significance of machine unlearning for large language models (LLMs). Recent research has introduced a series of promising unlearning methods, notably boosting the…

机器学习 · 计算机科学 2025-02-26 Qizhou Wang , Bo Han , Puning Yang , Jianing Zhu , Tongliang Liu , Masashi Sugiyama

Machine unlearning is an emerging field that selectively removes specific data samples from a trained model. This capability is crucial for addressing privacy concerns, complying with data protection regulations, and correcting errors or…

机器学习 · 计算机科学 2025-01-29 Zitong Li , Qingqing Ye , Haibo Hu

As a means to balance the growth of the AI industry with the need for privacy protection, machine unlearning plays a crucial role in realizing the ``right to be forgotten'' in artificial intelligence. This technique enables AI systems to…

机器学习 · 计算机科学 2026-04-22 Eun-Ju Park , Youjin Shin , Simon S. Woo