English
Related papers

Related papers: Learning to Unlearn: Instance-wise Unlearning for …

200 papers

Machine unlearning aims to efficiently remove the influence of specific training data from a model without full retraining. While much progress has been made in unlearning for LLMs, document classification models remain relatively…

Machine Learning · Computer Science 2025-12-17 Aadya Goel , Mayuri Sridhar

Machine unlearning aims to solve the problem of removing the influence of selected training examples from a learned model. Despite the increasing attention to this problem, it remains an open research question how to evaluate unlearning in…

Machine Learning · Computer Science 2024-11-08 Teodora Baluta , Pascal Lamblin , Daniel Tarlow , Fabian Pedregosa , Gintare Karolina Dziugaite

Machine unlearning is concerned with the task of removing knowledge learned from particular data points from a trained model. In the context of large language models (LLMs), unlearning has recently received increased attention, particularly…

Computation and Language · Computer Science 2025-09-03 Aravind Krishnan , Siva Reddy , Marius Mosbach

Machine unlearning is motivated by desire for data autonomy: a person can request to have their data's influence removed from deployed models, and those models should be updated as if they were retrained without the person's data. We show…

Machine Learning · Computer Science 2024-05-31 Martin Bertran , Shuai Tang , Michael Kearns , Jamie Morgenstern , Aaron Roth , Zhiwei Steven Wu

Many active learning methods belong to the retraining-based approaches, which select one unlabeled instance, add it to the training set with its possible labels, retrain the classification model, and evaluate the criteria that we base our…

Machine Learning · Statistics 2017-03-01 Yazhou Yang , Marco Loog

Large language models (LLMs) have recently revolutionized language processing tasks but have also brought ethical and legal issues. LLMs have a tendency to memorize potentially private or copyrighted information present in the training…

Machine Learning · Computer Science 2025-07-21 Tamim Al Mahmud , Najeeb Jebreel , Josep Domingo-Ferrer , David Sanchez

In class-incremental learning, the objective is to learn a number of classes sequentially without having access to the whole training data. However, due to a problem known as catastrophic forgetting, neural networks suffer substantial…

Machine Learning · Computer Science 2021-06-01 Sobirdzhon Bobiev , Adil Khan , Syed Muhammad Ahsan Raza Kazmi

Today, computer systems hold large amounts of personal data. Yet while such an abundance of data allows breakthroughs in artificial intelligence, and especially machine learning (ML), its existence can be a threat to user privacy, and it…

In many real-world scenarios, data to train machine learning models becomes available over time. Unfortunately, these models struggle to continually learn new concepts without forgetting what has been learnt in the past. This phenomenon is…

Computation and Language · Computer Science 2023-01-16 Beyza Ermis , Giovanni Zappella , Martin Wistuba , Aditya Rawal , Cedric Archambeau

With the widespread application of artificial intelligence technologies in face recognition and other fields, data privacy security issues have received extensive attention, especially the \textit{right to be forgotten} emphasized by…

Cryptography and Security · Computer Science 2026-04-10 Weidong Zheng , Kongyang Chen , Yao Huang , Yuanwei Guo , Yatie Xiao

Lifelong learning algorithms enable models to incrementally acquire new knowledge without forgetting previously learned information. Contrarily, the field of machine unlearning focuses on explicitly forgetting certain previous knowledge…

Machine Learning · Computer Science 2025-05-19 Ozan Özdenizci , Elmar Rueckert , Robert Legenstein

As large language models (LLMs) are increasingly deployed across various applications, privacy and copyright concerns have heightened the need for more effective LLM unlearning techniques. Many existing unlearning methods aim to suppress…

Computation and Language · Computer Science 2025-09-22 Tomoya Yamashita , Akira Ito , Yuuki Yamanaka , Masanori Yamada , Takayuki Miura , Toshiki Shibahara

Recent regulations on the Right to be Forgotten have greatly influenced the way of running a recommender system, because users now have the right to withdraw their private data. Besides simply deleting the target data in the database,…

Information Retrieval · Computer Science 2023-04-21 Yuyuan Li , Chaochao Chen , Xiaolin Zheng , Yizhao Zhang , Biao Gong , Jun Wang

Recent advances in machine learning, particularly in Natural Language Processing (NLP), have produced powerful models trained on vast datasets. However, these models risk leaking sensitive information, raising privacy concerns. In response,…

Machine Learning · Computer Science 2025-09-19 Haoyu Tang , Ye Liu , Xi Zhao , Xukai Liu , Yanghai Zhang , Kai Zhang , Xiaofang Zhou , Enhong Chen

Removing the influence of a specified subset of training data from a machine learning model may be required to address issues such as privacy, fairness, and data quality. Retraining the model from scratch on the remaining data after removal…

Machine Learning · Computer Science 2022-09-05 Salvatore Mercuri , Raad Khraishi , Ramin Okhrati , Devesh Batra , Conor Hamill , Taha Ghasempour , Andrew Nowlan

Machine unlearning aims to efficiently eliminate the memory about deleted data from trained models and address the right to be forgotten. Despite the success of existing unlearning algorithms, unlearning in sparse models has not yet been…

Machine Learning · Computer Science 2025-12-04 Yang Xiao , Gen Li , Jie Ji , Ruimeng Ye , Xiaolong Ma , Bo Hui

Machine learning models trained on vast amounts of real or synthetic data often achieve outstanding predictive performance across various domains. However, this utility comes with increasing concerns about privacy, as the training data may…

Cryptography and Security · Computer Science 2024-07-09 Binhao Ma , Tianhang Zheng , Hongsheng Hu , Di Wang , Shuo Wang , Zhongjie Ba , Zhan Qin , Kui Ren

Machine unlearning aims to eliminate the influence of a subset of training samples (i.e., unlearning samples) from a trained model. Effectively and efficiently removing the unlearning samples without negatively impacting the overall model…

Machine Learning · Computer Science 2024-01-22 Hong kyu Lee , Qiuchen Zhang , Carl Yang , Jian Lou , Li Xiong

The right to be forgotten states that a data owner has the right to erase their data from an entity storing it. In the context of machine learning (ML), the right to be forgotten requires an ML model owner to remove the data owner's data…

Cryptography and Security · Computer Science 2021-09-15 Min Chen , Zhikun Zhang , Tianhao Wang , Michael Backes , Mathias Humbert , Yang Zhang

Large language model (LLM) unlearning has demonstrated effectiveness in removing the influence of undesirable data (also known as forget data). Existing approaches typically assume full access to the forget dataset, overlooking two key…

Computation and Language · Computer Science 2025-09-19 Linxi Xie , Xin Teng , Shichang Ke , Hongyi Wen , Shengjie Wang