English
Related papers

Related papers: LEGATO: Good Identity Unlearning Is Continuous

200 papers

With the extensive use of machine learning technologies, data providers encounter increasing privacy risks. Recent legislation, such as GDPR, obligates organizations to remove requested data and its influence from a trained model. Machine…

Computers and Society · Computer Science 2024-11-07 Hengzhu Liu , Tianqing Zhu , Lefeng Zhang , Ping Xiong

Large Language Models (LLMs) trained on extensive corpora inevitably retain sensitive data, such as personal privacy information and copyrighted material. Recent advancements in knowledge unlearning involve updating LLM parameters to erase…

Computation and Language · Computer Science 2024-10-08 Bozhong Tian , Xiaozhuan Liang , Siyuan Cheng , Qingbin Liu , Mengru Wang , Dianbo Sui , Xi Chen , Huajun Chen , Ningyu Zhang

Deep machine unlearning is the problem of `removing' from a trained neural network a subset of its training set. This problem is very timely and has many applications, including the key tasks of removing biases (RB), resolving confusion…

Machine Learning · Computer Science 2023-10-31 Meghdad Kurmanji , Peter Triantafillou , Jamie Hayes , Eleni Triantafillou

We introduce a novel continual learning problem: how to sequentially update the weights of a personalized 2D and 3D generative face model as new batches of photos in different appearances, styles, poses, and lighting are captured regularly.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Annie N. Wang , Luchao Qi , Roni Sengupta

The problem of catastrophic forgetting occurs in deep learning models trained on multiple databases in a sequential manner. Recently, generative replay mechanisms (GRM), have been proposed to reproduce previously learned knowledge aiming to…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Fei Ye , Adrian G. Bors

Artificial neural networks have exceeded human-level performance in accomplishing several individual tasks (e.g. voice recognition, object recognition, and video games). However, such success remains modest compared to human intelligence…

Machine Learning · Computer Science 2019-10-21 Rahaf Aljundi

Continual learning has emerged as a pivotal area of research, primarily due to its advantageous characteristic that allows models to persistently acquire and retain information. However, catastrophic forgetting can severely impair model…

Machine Learning · Computer Science 2026-01-28 KaiHui Huang , RunQing Wu , JinHui Sheng , HanYi Zhang , Ling Ge , JinYu Guo , Fei Ye

In this paper, we show that Generative Adversarial Networks (GANs) suffer from catastrophic forgetting even when they are trained to approximate a single target distribution. We show that GAN training is a continual learning problem in…

Machine Learning · Computer Science 2020-03-24 Hoang Thanh-Tung , Truyen Tran

Intense recent discussions have focused on how to provide individuals with control over when their data can and cannot be used --- the EU's Right To Be Forgotten regulation is an example of this effort. In this paper we initiate a framework…

Machine Learning · Computer Science 2019-11-06 Antonio Ginart , Melody Y. Guan , Gregory Valiant , James Zou

Large Language Models (LLMs) are often evaluated against ideals of perfect Bayesian inference, yet growing evidence suggests that their in-context reasoning exhibits systematic forgetting of past information. Rather than viewing this…

Computation and Language · Computer Science 2026-04-08 Alexandros Christoforos

Machine unlearning seeks to remove the influence of specified data from a trained model. While the unlearning accuracy provides a widely used metric for assessing unlearning performance, it falls short in assessing the reliability of…

Machine Learning · Computer Science 2026-05-13 Yingdan Shi , Sijia Liu , Kaize Ding , Ren Wang

Zero-shot Relation Triplet Extraction (ZeroRTE) aims to extract relation triplets from texts containing unseen relation types. This capability benefits various downstream information retrieval (IR) tasks. The primary challenge lies in…

Computation and Language · Computer Science 2025-04-29 Wanli Li , Tieyun Qian , Yi Song , Zeyu Zhang , Jiawei Li , Zhuang Chen , Lixin Zou

Large language models trained on web-scale corpora can memorize undesirable data containing misinformation, copyrighted material, or private or sensitive information. Recently, several machine unlearning algorithms have been proposed to…

Computation and Language · Computer Science 2025-05-27 Keivan Rezaei , Khyathi Chandu , Soheil Feizi , Yejin Choi , Faeze Brahman , Abhilasha Ravichander

Continual learning denotes machine learning methods which can adapt to new environments while retaining and reusing knowledge gained from past experiences. Such methods address two issues encountered by models in non-stationary…

Machine Learning · Computer Science 2023-03-28 J. Armstrong , D. Clifton

Continual learning tries to learn new tasks without forgetting previously learned ones. In reality, most of the existing artificial neural network(ANN) models fail, while humans do the same by remembering previous works throughout their…

Computer Vision and Pattern Recognition · Computer Science 2021-05-18 Subhankar Ghosh

Many approximate machine unlearning methods demonstrate strong logit-level forgetting -- such as near-zero accuracy on the forget set -- yet continue to preserve substantial information within their internal feature representations. We…

Machine Learning · Computer Science 2026-03-02 Jaewon Lee , Yongwoo Kim , Donghyun Kim

The Right to be Forgotten is a core principle outlined by regulatory frameworks such as the EU's General Data Protection Regulation (GDPR). This principle allows individuals to request that their personal data be deleted from deployed…

Machine Learning · Computer Science 2024-02-19 Alex Oesterling , Jiaqi Ma , Flavio P. Calmon , Hima Lakkaraju

Recent privacy regulations (e.g., GDPR) grant data subjects the `Right to Be Forgotten' (RTBF) and mandate companies to fulfill data erasure requests from data subjects. However, companies encounter great challenges in complying with the…

Machine Learning · Computer Science 2024-12-04 Yuncong Yang , Xiao Han , Yidong Chai , Reza Ebrahimi , Rouzbeh Behnia , Balaji Padmanabhan

Federated unlearning (FU) aims to erase designated client-level, class-level, or sample-level knowledge from a global model. Existing studies commonly assume that the collaboration ends up with the unlearning operation, overlooking the…

Machine Learning · Computer Science 2026-02-02 Hanwei Tan , Wentai Hu , Ligang He , Yijun Quan

When handling streaming graphs, existing graph representation learning models encounter a catastrophic forgetting problem, where previously learned knowledge of these models is easily overwritten when learning with newly incoming graphs. In…

Machine Learning · Computer Science 2024-07-11 Yilun Liu , Ruihong Qiu , Yanran Tang , Hongzhi Yin , Zi Huang