English
Related papers

Related papers: Fast Machine Unlearning Without Retraining Through…

200 papers

Machine \emph{unlearning}, which involves erasing knowledge about a \emph{forget set} from a trained model, can prove to be costly and infeasible by existing techniques. We propose a nearly compute-free zero-shot unlearning technique based…

This work delves into the complexities of machine unlearning in the face of distributional shifts, particularly focusing on the challenges posed by non-uniform feature and label removal. With the advent of regulations like the GDPR…

Machine Learning · Computer Science 2024-03-14 Ling Han , Nanqing Luo , Hao Huang , Jing Chen , Mary-Anne Hartley

Continual Semantic Segmentation (CSS) seeks to incrementally learn to segment novel classes while preserving knowledge of previously encountered ones. Recent advancements in CSS have been largely driven by the adoption of Pre-trained Vision…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Duzhen Zhang , Yong Ren , Wei Cong , Junhao Zheng , Qiaoyi Su , Shuncheng Jia , Zhong-Zhi Li , Xuanle Zhao , Ye Bai , Feilong Chen , Qi Tian , Tielin Zhang

Large language models are expensive to deploy. We introduce Sparse Knowledge Distillation (SparseKD), a post-training method that compresses transformer models by combining structured SVD pruning with self-referential knowledge…

Machine Learning · Computer Science 2026-02-03 Aaron R. Flouro , Shawn P. Chadwick

Machine unlearning is an emerging technology that has come to attract widespread attention. A number of factors, including regulations and laws, privacy, and usability concerns, have resulted in this need to allow a trained model to forget…

Machine Learning · Computer Science 2024-06-18 Heng Xu , Tianqing Zhu , Lefeng Zhang , Wanlei Zhou , Wei Zhao

Training machine learning models requires the storage of large datasets, which often contain sensitive or private data. Storing data is associated with a number of potential risks which increase over time, such as database breaches and…

Machine Learning · Computer Science 2026-04-14 Aviraj Newatia , Michael Cooper , Viet Nguyen , Rahul G. Krishnan

A plain well-trained deep learning model often does not have the ability to learn new knowledge without forgetting the previously learned knowledge, which is known as catastrophic forgetting. Here we propose a novel method, SupportNet, to…

Neural and Evolutionary Computing · Computer Science 2018-12-31 Yu Li , Zhongxiao Li , Lizhong Ding , Yijie Pan , Chao Huang , Yuhui Hu , Wei Chen , Xin Gao

Growing data privacy demands, driven by regulations like GDPR and CCPA, require machine unlearning methods capable of swiftly removing the influence of specific training points. Although verified approaches like SISA, using data slicing and…

Machine Learning · Computer Science 2025-10-22 Yijun Quan , Zushu Li , Giovanni Montana

Conventional intelligent systems based on deep neural network (DNN) models encounter challenges in achieving human-like continual learning due to catastrophic forgetting. Here, we propose a metaplasticity model inspired by human working…

Neural and Evolutionary Computing · Computer Science 2024-07-11 Suhee Cho , Hyeonsu Lee , Seungdae Baek , Se-Bum Paik

Machine unlearning is the process of efficiently removing specific information from a trained machine learning model without retraining from scratch. Existing unlearning methods, which often provide provable guarantees, typically involve…

Machine Learning · Computer Science 2026-02-04 Somnath Basu Roy Chowdhury , Rahul Kidambi , Avinava Dubey , David Wang , Gokhan Mergen , Amr Ahmed , Aranyak Mehta

Machine unlearning aims to eliminate the influence of specific data from trained models to ensure privacy compliance. However, most existing methods assume full access to the original training dataset, which is often impractical. We address…

Machine Learning · Computer Science 2025-11-18 Qipeng Song , Nan Yang , Ziqi Xu , Yue Li , Wei Shao , Feng Xia

Machine unlearning addresses the problem of updating a machine learning model/system trained on a dataset $S$ so that the influence of a set of deletion requests $U \subseteq S$ on the unlearned model is minimized. The gold standard…

Machine Learning · Computer Science 2025-06-09 Linda Lu , Ayush Sekhari , Karthik Sridharan

Machine unlearning is a prominent and challenging field, driven by regulatory demands for user data deletion and heightened privacy awareness. Existing approaches involve retraining model or multiple finetuning steps for each deletion…

Machine Learning · Computer Science 2024-08-07 Sangamesh Kodge , Gobinda Saha , Kaushik Roy

Machine Unlearning (MU) enables Large Language Models (LLMs) to remove unsafe or outdated information. However, existing work assumes that all facts are equally forgettable and largely ignores whether the forgotten knowledge originates from…

Computation and Language · Computer Science 2026-05-15 Borisiuk Anna , Andrey Savchenko , Alexander Panchenko , Elena Tutubalina

Machine unlearning aims to selectively remove targeted knowledge from Large Language Models (LLMs), ensuring they forget specified content while retaining essential information. Existing unlearning metrics assess whether a model correctly…

Computation and Language · Computer Science 2025-05-28 Wonje Jeung , Sangyeon Yoon , Albert No

Machine unlearning aims to remove the influence of specific data from trained models while preserving general utility. Existing approximate unlearning methods often rely on performance-degradation heuristics, such as loss maximization or…

Machine Learning · Computer Science 2026-03-13 Jonas Mirlach , Sonia Laguna , Julia E. Vogt

With the continued advancement and widespread adoption of machine learning (ML) models across various domains, ensuring user privacy and data security has become a paramount concern. In compliance with data privacy regulations, such as…

Machine Learning · Computer Science 2024-07-09 Nexhi Sula , Abhinav Kumar , Jie Hou , Han Wang , Reza Tourani

We explore the problem of selectively forgetting a particular subset of the data used for training a deep neural network. While the effects of the data to be forgotten can be hidden from the output of the network, insights may still be…

Machine Learning · Computer Science 2020-04-02 Aditya Golatkar , Alessandro Achille , Stefano Soatto

Privacy concerns associated with machine learning models have driven research into machine unlearning, which aims to erase the memory of specific target training data from already trained models. This issue also arises in federated…

Machine Learning · Computer Science 2025-03-14 Yuyuan Li , Jiaming Zhang , Yixiu Liu , Chaochao Chen

Machine unlearning is the process of removing the impact of a particular set of training samples from a pretrained model. It aims to fulfill the "right to be forgotten", which grants the individuals such as patients the right to reconsider…

Machine Learning · Computer Science 2024-07-11 Reza Nasirigerdeh , Nader Razmi , Julia A. Schnabel , Daniel Rueckert , Georgios Kaissis
‹ Prev 1 4 5 6 7 8 10 Next ›