English
Related papers

Related papers: Forget by Uncertainty: Orthogonal Entropy Unlearni…

200 papers

Recent legislation of the "right to be forgotten" has led to the interest in machine unlearning, where the learned models are endowed with the function to forget information about specific training instances as if they have never existed in…

Computation and Language · Computer Science 2023-05-12 Lingzhi Wang , Tong Chen , Wei Yuan , Xingshan Zeng , Kam-Fai Wong , Hongzhi Yin

Catastrophic forgetting describes the fact that machine learning models will likely forget the knowledge of previously learned tasks after the learning process of a new one. It is a vital problem in the continual learning scenario and…

Machine Learning · Computer Science 2022-05-25 Wenjie Jiang , Zhide Lu , Dong-Ling Deng

Machine Unlearning aims to remove specific data from trained models, addressing growing privacy and ethical concerns. We provide a theoretical analysis of a simple and widely used method - gradient ascent - used to reverse the influence of…

Machine Learning · Computer Science 2025-10-17 Odelia Melamed , Gilad Yehudai , Gal Vardi

Incremental learning suffers from two challenging problems; forgetting of old knowledge and intransigence on learning new knowledge. Prediction by the model incrementally learned with a subset of the dataset are thus uncertain and the…

Machine Learning · Computer Science 2019-02-05 Dahyun Kim , Jihwan Bae , Yeonsik Jo , Jonghyun Choi

Privacy protection has always been an ongoing topic, especially for AI. Currently, a low-cost scheme called Machine Unlearning forgets the private data remembered in the model. Specifically, given a private dataset and a trained neural…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Xin Su , Zhuoran Zheng

Large language models (LLMs) require iterative updates to address the outdated information problem, where LLM unlearning offers an approach for selective removal. However, mainstream unlearning methods primarily rely on fine-tuning…

Computation and Language · Computer Science 2025-09-29 Miao Yu , Liang Lin , Guibin Zhang , Xinfeng Li , Junfeng Fang , Xingrui Yu , Ivor Tsang , Ningyu Zhang , Kun Wang , Yang Wang

Neural networks predictions are unreliable when the input sample is out of the training distribution or corrupted by noise. Being able to detect such failures automatically is fundamental to integrate deep learning algorithms into robotics.…

Computer Vision and Pattern Recognition · Computer Science 2020-02-18 Antonio Loquercio , Mattia Segù , Davide Scaramuzza

LLM have achieved success in many fields but still troubled by problematic content in the training corpora. LLM unlearning aims at reducing their influence and avoid undesirable behaviours. However, existing unlearning methods remain…

Computation and Language · Computer Science 2024-08-21 Hongbang Yuan , Zhuoran Jin , Pengfei Cao , Yubo Chen , Kang Liu , Jun Zhao

Machine unlearning is a critical area of research aimed at safeguarding data privacy by enabling the removal of sensitive information from machine learning models. One unique challenge in this field is catastrophic unlearning, where erasing…

Machine Learning · Computer Science 2025-02-17 Zhuoyi Peng , Yixuan Tang , Yi Yang

Large Language Models memorize vast amounts of training data, raising concerns regarding privacy, copyright infringement, and safety. Machine unlearning seeks to remove the influence of a targeted forget set while preserving model…

Machine unlearning aims to remove the influence of a designated forget set from a trained model while preserving utility on the retained data. In modern deep networks, approximate unlearning frequently fails under large or adversarial…

Machine Learning · Computer Science 2026-02-11 Mohammad Partohaghighi , Roummel Marcia , Bruce J. West , YangQuan Chen

Neural networks (NN) are extensively studied in cutting-edge soft sensor models due to their feature extraction and function approximation capabilities. Current research into network-based methods primarily focuses on models' offline…

Machine Learning · Computer Science 2024-09-25 Shaoqi Wang , Chunjie Yang , Siwei Lou

The growing enforcement of the right to be forgotten regulations has propelled recent advances in certified (graph) unlearning strategies to comply with data removal requests from deployed machine learning (ML) models. Motivated by the…

Machine Learning · Computer Science 2025-05-22 O. Deniz Kose , Gonzalo Mateos , Yanning Shen

OOD detection has become more pertinent with advances in network design and increased task complexity. Identifying which parts of the data a given network is misclassifying has become as valuable as the network's overall performance. We can…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Rishi Singhal , Srinath Srinivasan

Deep neural networks are susceptible to catastrophic forgetting when trained on sequential tasks. Various continual learning (CL) methods often rely on exemplar buffers or/and network expansion for balancing model stability and plasticity,…

Machine Learning · Computer Science 2024-01-18 Depeng Li , Tianqi Wang , Junwei Chen , Qining Ren , Kenji Kawaguchi , Zhigang Zeng

The LLM unlearning aims to eliminate the influence of undesirable data without affecting causally unrelated information. This process typically involves using a forget set to remove target information, alongside a retain set to maintain…

Machine Learning · Computer Science 2025-09-26 Hang Chen , Jiaying Zhu , Xinyu Yang , Wenya Wang

Machine Unlearning (MU) aims to selectively erase the influence of specific data points from pretrained models. However, most existing MU methods rely on the retain set to preserve model utility, which is often impractical due to privacy…

Machine Learning · Computer Science 2026-04-15 Xindi Fan , Jing Wu , Mingyi Zhou , Pengwei Liang , Mehrtash Harandi , Dinh Phung

Machine unlearning (MU), which seeks to erase the influence of specific unwanted data from already-trained models, is becoming increasingly vital in model editing, particularly to comply with evolving data regulations like the ``right to be…

Machine Learning · Computer Science 2025-03-18 Changchang Sun , Ren Wang , Yihua Zhang , Jinghan Jia , Jiancheng Liu , Gaowen Liu , Yan Yan , Sijia Liu

Pretrained Language Models (LMs) memorize a vast amount of knowledge during initial pretraining, including information that may violate the privacy of personal lives and identities. Previous work addressing privacy issues for language…

Computation and Language · Computer Science 2022-12-20 Joel Jang , Dongkeun Yoon , Sohee Yang , Sungmin Cha , Moontae Lee , Lajanugen Logeswaran , Minjoon Seo

Machine unlearning has emerged as a new paradigm to deliberately forget data samples from a given model in order to adhere to stringent regulations. However, existing machine unlearning methods have been primarily focused on classification…

Machine Learning · Computer Science 2024-02-05 Guihong Li , Hsiang Hsu , Chun-Fu Chen , Radu Marculescu
‹ Prev 1 4 5 6 7 8 10 Next ›