English
Related papers

Related papers: Machine Unlearning under Retain-Forget Entanglemen…

200 papers

Machine unlearning aims to remove the influence of specific training samples from a trained model without full retraining. While prior work has largely focused on privacy-motivated settings, we recast unlearning as a general-purpose tool…

Image and Video Processing · Electrical Eng. & Systems 2026-02-11 George R. Nahass , Zhu Wang , Homa Rashidisabet , Won Hwa Kim , Sasha Hubschman , Jeffrey C. Peterson , Chad A. Purnell , Pete Setabutr , Ann Q. Tran , Darvin Yi , Sathya N. Ravi

Deep machine unlearning is the problem of `removing' from a trained neural network a subset of its training set. This problem is very timely and has many applications, including the key tasks of removing biases (RB), resolving confusion…

Machine Learning · Computer Science 2023-10-31 Meghdad Kurmanji , Peter Triantafillou , Jamie Hayes , Eleni Triantafillou

Fine-tuning a pre-trained model on a downstream task often degrades its original capabilities, a phenomenon known as "catastrophic forgetting". This is especially an issue when one does not have access to the data and recipe used to develop…

Machine Learning · Computer Science 2025-06-13 Sunny Sanyal , Hayden Prairie , Rudrajit Das , Ali Kavis , Sujay Sanghavi

Continual learning aims to provide intelligent agents capable of learning multiple tasks sequentially with neural networks. One of its main challenging, catastrophic forgetting, is caused by the neural networks non-optimal ability to learn…

Machine Learning · Computer Science 2021-01-29 Ghada Sokar , Decebal Constantin Mocanu , Mykola Pechenizkiy

We study the problem of unlearning datapoints from a learnt model. The learner first receives a dataset $S$ drawn i.i.d. from an unknown distribution, and outputs a model $\widehat{w}$ that performs well on unseen samples from the same…

Machine Learning · Computer Science 2021-07-23 Ayush Sekhari , Jayadev Acharya , Gautam Kamath , Ananda Theertha Suresh

Machine Unlearning, the process of selectively eliminating the influence of certain data examples used during a model's training, has gained significant attention as a means for practitioners to comply with recent data protection…

Machine Learning · Computer Science 2024-03-22 Daniel Trippa , Cesare Campagnano , Maria Sofia Bucarelli , Gabriele Tolomei , Fabrizio Silvestri

The growing concern over training data privacy has elevated the "Right to be Forgotten" into a critical requirement, thereby raising the demand for effective Machine Unlearning. However, existing unlearning approaches commonly suffer from a…

Machine Learning · Computer Science 2026-02-20 Haoyu Wang , Zhuo Huang , Xiaolong Wang , Bo Han , Zhiwei Lin , Tongliang Liu

Continual learning and machine unlearning are crucial challenges in machine learning, typically addressed separately. Continual learning focuses on adapting to new knowledge while preserving past information, whereas unlearning involves…

Machine Learning · Computer Science 2024-12-30 Romit Chatterjee , Vikram Chundawat , Ayush Tarun , Ankur Mali , Murari Mandal

Machine unlearning has garnered significant attention due to its ability to selectively erase knowledge obtained from specific training data samples in an already trained machine learning model. This capability enables data holders to…

Machine Learning · Computer Science 2024-03-13 Vinay Chakravarthi Gogineni , Esmaeil S. Nadimi

In the present era of deep learning, continual learning research is mainly focused on mitigating forgetting when training a neural network with stochastic gradient descent on a non-stationary stream of data. On the other hand, in the more…

Machine Learning · Computer Science 2024-05-30 Soochan Lee , Hyeonseong Jeon , Jaehyeon Son , Gunhee Kim

We propose a data-driven technique to automatically learn contextual uncertainty sets in robust optimization, resulting in excellent worst-case and average-case performance while also guaranteeing constraint satisfaction. Our method…

Optimization and Control · Mathematics 2025-06-25 Irina Wang , Bart Van Parys , Bartolomeo Stellato

Machine unlearning seeks to remove the influence of specific training data from a model, a need driven by privacy regulations and robustness concerns. Existing approaches typically modify model parameters, but such updates can be unstable,…

Machine Learning · Computer Science 2026-05-29 Antonio Almudévar , Alfonso Ortega

Machine unlearning is a prominent and challenging field, driven by regulatory demands for user data deletion and heightened privacy awareness. Existing approaches involve retraining model or multiple finetuning steps for each deletion…

Machine Learning · Computer Science 2024-08-07 Sangamesh Kodge , Gobinda Saha , Kaushik Roy

Few-shot learning is a challenging problem where the goal is to achieve generalization from only few examples. Model-agnostic meta-learning (MAML) tackles the problem by formulating prior knowledge as a common initialization across tasks,…

Machine Learning · Computer Science 2020-06-17 Sungyong Baik , Seokil Hong , Kyoung Mu Lee

Machine unlearning focuses on the computationally efficient removal of specific training data from trained models, ensuring that the influence of forgotten data is effectively eliminated without the need for full retraining. Despite…

Machine Learning · Statistics 2025-05-13 Haolin Zou , Arnab Auddy , Yongchan Kwon , Kamiar Rahnama Rad , Arian Maleki

Machine Unlearning has recently garnered significant attention, aiming to selectively remove knowledge associated with specific data while preserving the model's performance on the remaining data. A fundamental challenge in this process is…

Machine Learning · Computer Science 2025-07-29 Gaurav Patel , Qiang Qiu

Large language models (LLMs) have achieved significant progress from pre-training on and memorizing a wide range of textual data, however, this process might suffer from privacy issues and violations of data protection regulations. As a…

Computation and Language · Computer Science 2023-11-01 Jiaao Chen , Diyi Yang

Large language models (LLMs) risk retaining unauthorized or sensitive information from their training data, which raises privacy concerns. LLM unlearning seeks to mitigate these risks by selectively removing specified data while maintaining…

Computation and Language · Computer Science 2025-05-29 Hwan Chang , Hwanhee Lee

Machine unlearning aims to eliminate the influence of a subset of training samples (i.e., unlearning samples) from a trained model. Effectively and efficiently removing the unlearning samples without negatively impacting the overall model…

Machine Learning · Computer Science 2024-01-22 Hong kyu Lee , Qiuchen Zhang , Carl Yang , Jian Lou , Li Xiong

Neural networks have achieved remarkable success in many cognitive tasks. However, when they are trained sequentially on multiple tasks without access to old data, their performance on early tasks tend to drop significantly. This problem is…

Machine Learning · Computer Science 2021-02-10 Dong Yin , Mehrdad Farajtabar , Ang Li , Nir Levine , Alex Mott