中文
相关论文

相关论文: Class Unlearning via Depth-Aware Removal of Forget…

200 篇论文

Large language models (LLMs) can internalize private or harmful content, motivating unlearning that removes a forget set while preserving retaining knowledge. However, forgetting updates often cause collateral degradation on retaining…

We present a novel class incremental learning approach based on deep neural networks, which continually learns new tasks with limited memory for storing examples in the previous tasks. Our algorithm is based on knowledge distillation and…

机器学习 · 计算机科学 2022-04-05 Minsoo Kang , Jaeyoo Park , Bohyung Han

Machine unlearning, a process enabling pre-trained models to remove the influence of specific training samples, has attracted significant attention in recent years. Although extensive research has focused on developing efficient machine…

机器学习 · 计算机科学 2026-01-13 Heng Xu , Tianqing Zhu , Dayong Ye , Lefeng Zhang , Le Wang , Wanlei Zhou

Meta-learning aims to train models that can generalize to new tasks with limited labeled data by extracting shared features across diverse task datasets. Additionally, it accounts for prediction uncertainty during both training and…

机器学习 · 计算机科学 2025-03-03 Hyungi Lee , Chaeyun Jang , Dongbok Lee , Juho Lee

Deep learning has seen tremendous success over the past decade in computer vision, machine translation, and gameplay. This success rests in crucial ways on gradient-descent optimization and the ability to learn parameters of a neural…

机器学习 · 计算机科学 2019-08-30 Fei Wang , Daniel Zheng , James Decker , Xilun Wu , Grégory M. Essertel , Tiark Rompf

Machine unlearning (MU) aims to remove the influence of particular data points from the learnable parameters of a trained machine learning model. This is a crucial capability in light of data privacy requirements, trustworthiness, and…

机器学习 · 计算机科学 2025-07-01 Xavier F. Cadet , Anastasia Borovykh , Mohammad Malekzadeh , Sara Ahmadi-Abhari , Hamed Haddadi

LLM unlearning is a technique to remove the impacts of undesirable knowledge from the model without retraining from scratch, which is indispensable towards trustworthy AI. Existing unlearning methods face significant limitations:…

机器学习 · 计算机科学 2026-03-02 Yisheng Zhong , Zhengbang Yang , Zhuangdi Zhu

Machine unlearning poses challenges in removing mislabeled, contaminated, or problematic data from a pretrained model. Current unlearning approaches and evaluation metrics are solely focused on model predictions, which limits insight into…

机器学习 · 计算机科学 2026-04-13 Khoa Tran , Simon S. Woo

Recent advances in machine unlearning have focused on developing algorithms to remove specific training samples from a trained model. In contrast, we observe that not all models are equally easy to unlearn. Hence, we introduce a family of…

计算机视觉与模式识别 · 计算机科学 2026-03-25 Amber Yijia Zheng , Yu-Shan Tai , Raymond A. Yeh

Diffusion models are renowned for their state-of-the-art performance in generating synthetic images. However, concerns related to safety, privacy, and copyright highlight the need for machine unlearning, which can make diffusion models…

机器学习 · 计算机科学 2025-12-04 Xun Yuan , Zilong Zhao , Jiayu Li , Aryan Pasikhani , Prosanta Gope , Biplab Sikdar

In recent years, machine learning neural network has penetrated deeply into people's life. As the price of convenience, people's private information also has the risk of disclosure. The "right to be forgotten" was introduced in a timely…

机器学习 · 计算机科学 2021-11-11 Kongyang Chen , Yiwen Wang , Yao Huang

Random backpropagation (RBP) is a variant of the backpropagation algorithm for training neural networks, where the transpose of the forward matrices are replaced by fixed random matrices in the calculation of the weight updates. It is…

机器学习 · 计算机科学 2017-12-25 Pierre Baldi , Peter Sadowski , Zhiqin Lu

Deep neural networks (DNNs) have been applied in class incremental learning, which aims to solve common real-world problems of learning new classes continually. One drawback of standard DNNs is that they are prone to catastrophic…

计算机视觉与模式识别 · 计算机科学 2019-11-19 Bowen Zhao , Xi Xiao , Guojun Gan , Bin Zhang , Shutao Xia

Recent regulation on right-to-be-forgotten emerges tons of interest in unlearning pre-trained machine learning models. While approximating a straightforward yet expensive approach of retrain-from-scratch, recent machine unlearning methods…

机器学习 · 计算机科学 2023-07-19 Seohui Bae , Seoyoon Kim , Hyemin Jung , Woohyung Lim

The canonical deep learning approach for learning requires computing a gradient term at each block by back-propagating the error signal from the output towards each learnable parameter. Given the stacked structure of neural networks, where…

机器学习 · 计算机科学 2025-08-19 Qinyu Li , Yee Whye Teh , Razvan Pascanu

Machine unlearning, the study of efficiently removing the impact of specific training instances on a model, has garnered increased attention in recent years due to regulatory guidelines such as the \emph{Right to be Forgotten}. Achieving…

机器学习 · 计算机科学 2024-06-07 Martin Pawelczyk , Seth Neel , Himabindu Lakkaraju

The ability of artificial agents to increment their capabilities when confronted with new data is an open challenge in artificial intelligence. The main challenge faced in such cases is catastrophic forgetting, i.e., the tendency of neural…

机器学习 · 计算机科学 2020-12-16 Eden Belouadah , Adrian Popescu , Ioannis Kanellos

Deep neural networks are a very powerful tool for many computer vision tasks, including image restoration, exhibiting state-of-the-art results. However, the performance of deep learning methods tends to drop once the observation model used…

图像与视频处理 · 电气工程与系统科学 2020-07-01 Jenny Zukerman , Tom Tirer , Raja Giryes

With the widespread application of artificial intelligence technologies in face recognition and other fields, data privacy security issues have received extensive attention, especially the \textit{right to be forgotten} emphasized by…

密码学与安全 · 计算机科学 2026-04-10 Weidong Zheng , Kongyang Chen , Yao Huang , Yuanwei Guo , Yatie Xiao

Continual Semantic Segmentation (CSS) seeks to incrementally learn to segment novel classes while preserving knowledge of previously encountered ones. Recent advancements in CSS have been largely driven by the adoption of Pre-trained Vision…

计算机视觉与模式识别 · 计算机科学 2025-08-07 Duzhen Zhang , Yong Ren , Wei Cong , Junhao Zheng , Qiaoyi Su , Shuncheng Jia , Zhong-Zhi Li , Xuanle Zhao , Ye Bai , Feilong Chen , Qi Tian , Tielin Zhang