English
Related papers

Related papers: Class Unlearning via Depth-Aware Removal of Forget…

200 papers

Large language models (LLMs) can internalize private or harmful content, motivating unlearning that removes a forget set while preserving retaining knowledge. However, forgetting updates often cause collateral degradation on retaining…

Machine Learning · Computer Science 2026-02-03 Duo Zhou , Yuji Zhang , Tianxin Wei , Ruizhong Qiu , Ke Yang , Xiao Lin , Cheng Qian , Jingrui He , Hanghang Tong , Chengxiang Zhai , Heng Ji , Huan Zhang

We present a novel class incremental learning approach based on deep neural networks, which continually learns new tasks with limited memory for storing examples in the previous tasks. Our algorithm is based on knowledge distillation and…

Machine Learning · Computer Science 2022-04-05 Minsoo Kang , Jaeyoo Park , Bohyung Han

Machine unlearning, a process enabling pre-trained models to remove the influence of specific training samples, has attracted significant attention in recent years. Although extensive research has focused on developing efficient machine…

Machine Learning · Computer Science 2026-01-13 Heng Xu , Tianqing Zhu , Dayong Ye , Lefeng Zhang , Le Wang , Wanlei Zhou

Meta-learning aims to train models that can generalize to new tasks with limited labeled data by extracting shared features across diverse task datasets. Additionally, it accounts for prediction uncertainty during both training and…

Machine Learning · Computer Science 2025-03-03 Hyungi Lee , Chaeyun Jang , Dongbok Lee , Juho Lee

Deep learning has seen tremendous success over the past decade in computer vision, machine translation, and gameplay. This success rests in crucial ways on gradient-descent optimization and the ability to learn parameters of a neural…

Machine Learning · Computer Science 2019-08-30 Fei Wang , Daniel Zheng , James Decker , Xilun Wu , Grégory M. Essertel , Tiark Rompf

Machine unlearning (MU) aims to remove the influence of particular data points from the learnable parameters of a trained machine learning model. This is a crucial capability in light of data privacy requirements, trustworthiness, and…

Machine Learning · Computer Science 2025-07-01 Xavier F. Cadet , Anastasia Borovykh , Mohammad Malekzadeh , Sara Ahmadi-Abhari , Hamed Haddadi

LLM unlearning is a technique to remove the impacts of undesirable knowledge from the model without retraining from scratch, which is indispensable towards trustworthy AI. Existing unlearning methods face significant limitations:…

Machine Learning · Computer Science 2026-03-02 Yisheng Zhong , Zhengbang Yang , Zhuangdi Zhu

Machine unlearning poses challenges in removing mislabeled, contaminated, or problematic data from a pretrained model. Current unlearning approaches and evaluation metrics are solely focused on model predictions, which limits insight into…

Machine Learning · Computer Science 2026-04-13 Khoa Tran , Simon S. Woo

Recent advances in machine unlearning have focused on developing algorithms to remove specific training samples from a trained model. In contrast, we observe that not all models are equally easy to unlearn. Hence, we introduce a family of…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Amber Yijia Zheng , Yu-Shan Tai , Raymond A. Yeh

Diffusion models are renowned for their state-of-the-art performance in generating synthetic images. However, concerns related to safety, privacy, and copyright highlight the need for machine unlearning, which can make diffusion models…

Machine Learning · Computer Science 2025-12-04 Xun Yuan , Zilong Zhao , Jiayu Li , Aryan Pasikhani , Prosanta Gope , Biplab Sikdar

In recent years, machine learning neural network has penetrated deeply into people's life. As the price of convenience, people's private information also has the risk of disclosure. The "right to be forgotten" was introduced in a timely…

Machine Learning · Computer Science 2021-11-11 Kongyang Chen , Yiwen Wang , Yao Huang

Random backpropagation (RBP) is a variant of the backpropagation algorithm for training neural networks, where the transpose of the forward matrices are replaced by fixed random matrices in the calculation of the weight updates. It is…

Machine Learning · Computer Science 2017-12-25 Pierre Baldi , Peter Sadowski , Zhiqin Lu

Deep neural networks (DNNs) have been applied in class incremental learning, which aims to solve common real-world problems of learning new classes continually. One drawback of standard DNNs is that they are prone to catastrophic…

Computer Vision and Pattern Recognition · Computer Science 2019-11-19 Bowen Zhao , Xi Xiao , Guojun Gan , Bin Zhang , Shutao Xia

Recent regulation on right-to-be-forgotten emerges tons of interest in unlearning pre-trained machine learning models. While approximating a straightforward yet expensive approach of retrain-from-scratch, recent machine unlearning methods…

Machine Learning · Computer Science 2023-07-19 Seohui Bae , Seoyoon Kim , Hyemin Jung , Woohyung Lim

The canonical deep learning approach for learning requires computing a gradient term at each block by back-propagating the error signal from the output towards each learnable parameter. Given the stacked structure of neural networks, where…

Machine Learning · Computer Science 2025-08-19 Qinyu Li , Yee Whye Teh , Razvan Pascanu

Machine unlearning, the study of efficiently removing the impact of specific training instances on a model, has garnered increased attention in recent years due to regulatory guidelines such as the \emph{Right to be Forgotten}. Achieving…

Machine Learning · Computer Science 2024-06-07 Martin Pawelczyk , Seth Neel , Himabindu Lakkaraju

The ability of artificial agents to increment their capabilities when confronted with new data is an open challenge in artificial intelligence. The main challenge faced in such cases is catastrophic forgetting, i.e., the tendency of neural…

Machine Learning · Computer Science 2020-12-16 Eden Belouadah , Adrian Popescu , Ioannis Kanellos

Deep neural networks are a very powerful tool for many computer vision tasks, including image restoration, exhibiting state-of-the-art results. However, the performance of deep learning methods tends to drop once the observation model used…

Image and Video Processing · Electrical Eng. & Systems 2020-07-01 Jenny Zukerman , Tom Tirer , Raja Giryes

With the widespread application of artificial intelligence technologies in face recognition and other fields, data privacy security issues have received extensive attention, especially the \textit{right to be forgotten} emphasized by…

Cryptography and Security · Computer Science 2026-04-10 Weidong Zheng , Kongyang Chen , Yao Huang , Yuanwei Guo , Yatie Xiao

Continual Semantic Segmentation (CSS) seeks to incrementally learn to segment novel classes while preserving knowledge of previously encountered ones. Recent advancements in CSS have been largely driven by the adoption of Pre-trained Vision…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Duzhen Zhang , Yong Ren , Wei Cong , Junhao Zheng , Qiaoyi Su , Shuncheng Jia , Zhong-Zhi Li , Xuanle Zhao , Ye Bai , Feilong Chen , Qi Tian , Tielin Zhang