中文
相关论文

相关论文: Forget by Uncertainty: Orthogonal Entropy Unlearni…

200 篇论文

Recent legislation of the "right to be forgotten" has led to the interest in machine unlearning, where the learned models are endowed with the function to forget information about specific training instances as if they have never existed in…

计算与语言 · 计算机科学 2023-05-12 Lingzhi Wang , Tong Chen , Wei Yuan , Xingshan Zeng , Kam-Fai Wong , Hongzhi Yin

Catastrophic forgetting describes the fact that machine learning models will likely forget the knowledge of previously learned tasks after the learning process of a new one. It is a vital problem in the continual learning scenario and…

机器学习 · 计算机科学 2022-05-25 Wenjie Jiang , Zhide Lu , Dong-Ling Deng

Machine Unlearning aims to remove specific data from trained models, addressing growing privacy and ethical concerns. We provide a theoretical analysis of a simple and widely used method - gradient ascent - used to reverse the influence of…

机器学习 · 计算机科学 2025-10-17 Odelia Melamed , Gilad Yehudai , Gal Vardi

Incremental learning suffers from two challenging problems; forgetting of old knowledge and intransigence on learning new knowledge. Prediction by the model incrementally learned with a subset of the dataset are thus uncertain and the…

机器学习 · 计算机科学 2019-02-05 Dahyun Kim , Jihwan Bae , Yeonsik Jo , Jonghyun Choi

Privacy protection has always been an ongoing topic, especially for AI. Currently, a low-cost scheme called Machine Unlearning forgets the private data remembered in the model. Specifically, given a private dataset and a trained neural…

计算机视觉与模式识别 · 计算机科学 2024-09-04 Xin Su , Zhuoran Zheng

Large language models (LLMs) require iterative updates to address the outdated information problem, where LLM unlearning offers an approach for selective removal. However, mainstream unlearning methods primarily rely on fine-tuning…

计算与语言 · 计算机科学 2025-09-29 Miao Yu , Liang Lin , Guibin Zhang , Xinfeng Li , Junfeng Fang , Xingrui Yu , Ivor Tsang , Ningyu Zhang , Kun Wang , Yang Wang

Neural networks predictions are unreliable when the input sample is out of the training distribution or corrupted by noise. Being able to detect such failures automatically is fundamental to integrate deep learning algorithms into robotics.…

计算机视觉与模式识别 · 计算机科学 2020-02-18 Antonio Loquercio , Mattia Segù , Davide Scaramuzza

LLM have achieved success in many fields but still troubled by problematic content in the training corpora. LLM unlearning aims at reducing their influence and avoid undesirable behaviours. However, existing unlearning methods remain…

计算与语言 · 计算机科学 2024-08-21 Hongbang Yuan , Zhuoran Jin , Pengfei Cao , Yubo Chen , Kang Liu , Jun Zhao

Machine unlearning is a critical area of research aimed at safeguarding data privacy by enabling the removal of sensitive information from machine learning models. One unique challenge in this field is catastrophic unlearning, where erasing…

机器学习 · 计算机科学 2025-02-17 Zhuoyi Peng , Yixuan Tang , Yi Yang

Large Language Models memorize vast amounts of training data, raising concerns regarding privacy, copyright infringement, and safety. Machine unlearning seeks to remove the influence of a targeted forget set while preserving model…

Machine unlearning aims to remove the influence of a designated forget set from a trained model while preserving utility on the retained data. In modern deep networks, approximate unlearning frequently fails under large or adversarial…

机器学习 · 计算机科学 2026-02-11 Mohammad Partohaghighi , Roummel Marcia , Bruce J. West , YangQuan Chen

Neural networks (NN) are extensively studied in cutting-edge soft sensor models due to their feature extraction and function approximation capabilities. Current research into network-based methods primarily focuses on models' offline…

机器学习 · 计算机科学 2024-09-25 Shaoqi Wang , Chunjie Yang , Siwei Lou

The growing enforcement of the right to be forgotten regulations has propelled recent advances in certified (graph) unlearning strategies to comply with data removal requests from deployed machine learning (ML) models. Motivated by the…

机器学习 · 计算机科学 2025-05-22 O. Deniz Kose , Gonzalo Mateos , Yanning Shen

OOD detection has become more pertinent with advances in network design and increased task complexity. Identifying which parts of the data a given network is misclassifying has become as valuable as the network's overall performance. We can…

计算机视觉与模式识别 · 计算机科学 2024-03-05 Rishi Singhal , Srinath Srinivasan

Deep neural networks are susceptible to catastrophic forgetting when trained on sequential tasks. Various continual learning (CL) methods often rely on exemplar buffers or/and network expansion for balancing model stability and plasticity,…

机器学习 · 计算机科学 2024-01-18 Depeng Li , Tianqi Wang , Junwei Chen , Qining Ren , Kenji Kawaguchi , Zhigang Zeng

The LLM unlearning aims to eliminate the influence of undesirable data without affecting causally unrelated information. This process typically involves using a forget set to remove target information, alongside a retain set to maintain…

机器学习 · 计算机科学 2025-09-26 Hang Chen , Jiaying Zhu , Xinyu Yang , Wenya Wang

Machine Unlearning (MU) aims to selectively erase the influence of specific data points from pretrained models. However, most existing MU methods rely on the retain set to preserve model utility, which is often impractical due to privacy…

机器学习 · 计算机科学 2026-04-15 Xindi Fan , Jing Wu , Mingyi Zhou , Pengwei Liang , Mehrtash Harandi , Dinh Phung

Machine unlearning (MU), which seeks to erase the influence of specific unwanted data from already-trained models, is becoming increasingly vital in model editing, particularly to comply with evolving data regulations like the ``right to be…

机器学习 · 计算机科学 2025-03-18 Changchang Sun , Ren Wang , Yihua Zhang , Jinghan Jia , Jiancheng Liu , Gaowen Liu , Yan Yan , Sijia Liu

Pretrained Language Models (LMs) memorize a vast amount of knowledge during initial pretraining, including information that may violate the privacy of personal lives and identities. Previous work addressing privacy issues for language…

计算与语言 · 计算机科学 2022-12-20 Joel Jang , Dongkeun Yoon , Sohee Yang , Sungmin Cha , Moontae Lee , Lajanugen Logeswaran , Minjoon Seo

Machine unlearning has emerged as a new paradigm to deliberately forget data samples from a given model in order to adhere to stringent regulations. However, existing machine unlearning methods have been primarily focused on classification…

机器学习 · 计算机科学 2024-02-05 Guihong Li , Hsiang Hsu , Chun-Fu Chen , Radu Marculescu