English
Related papers

Related papers: POUR: A Provably Optimal Method for Unlearning Rep…

200 papers

Federated Unlearning (FU) enables clients to selectively remove the influence of specific data from a trained federated learning model, addressing privacy concerns and regulatory requirements. However, existing FU methods often struggle to…

Machine Learning · Computer Science 2024-10-10 Qi Guo , Zhen Tian , Minghao Yao , Yong Qi , Saiyu Qi , Yun Li , Jin Song Dong

Continual Learning (CL) seeks to build an agent that can continuously learn a sequence of tasks, where a key challenge, namely Catastrophic Forgetting, persists due to the potential knowledge interference among different tasks. On the other…

Machine Learning · Computer Science 2026-03-10 Zheng Wang , Wanhao Yu , Li Yang , Sen Lin

The deployment of quantized neural networks on edge devices, combined with privacy regulations like GDPR, creates an urgent need for machine unlearning in quantized models. However, existing methods face critical challenges: they induce…

Machine Learning · Computer Science 2026-05-25 Tian Zhang , Yujia Tong , Junhao Dong , Ke Xu , Yuze Wang , Jingling Yuan

Resistive memory (RM) based neuromorphic systems can emulate synaptic plasticity and thus support continual learning, but they generally lack biologically inspired mechanisms for active forgetting, which are critical for meeting modern data…

As a new and promising approach, existing machine unlearning (MU) works typically emphasize theoretical formulations or optimization objectives to achieve knowledge removal. However, when deployed in real-world scenarios, such solutions…

Machine Learning · Computer Science 2025-10-31 Minyi Peng , Darian Gunamardi , Ivan Tjuawinata , Kwok-Yan Lam

Many approximate machine unlearning methods demonstrate strong logit-level forgetting -- such as near-zero accuracy on the forget set -- yet continue to preserve substantial information within their internal feature representations. We…

Machine Learning · Computer Science 2026-03-02 Jaewon Lee , Yongwoo Kim , Donghyun Kim

Large Language Models (LLMs) often memorize sensitive, private, or copyrighted data during pre-training. LLM unlearning aims to eliminate the influence of undesirable data from the pre-trained model while preserving the model's utilities on…

Machine Learning · Computer Science 2024-10-14 Ruiqi Zhang , Licong Lin , Yu Bai , Song Mei

We introduce a novel, closed-form approach for selective unlearning in multimodal models, specifically targeting pretrained models such as CLIP. Our method leverages nullspace projection to erase the target class information embedded in the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Ashish Mishra , Tarun Kumar , Gyanaranjan Nayak , Arpit Shah , Suparna Bhattacharya , Martin Foltin

Machine unlearning aims to remove the influence of specific training records from a deployed model without retraining from scratch. Current protocols verify this at the output level through membership inference, retain accuracy, and…

Artificial Intelligence · Computer Science 2026-05-28 Georgina Cosma , Axel Finke

As Text-to-Image models continue to evolve, so does the risk of generating unsafe, copyrighted, or privacy-violating content. Existing safety interventions - ranging from training data curation and model fine-tuning to inference-time…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Shristi Das Biswas , Arani Roy , Kaushik Roy

Unlearning in large language models (LLMs) aims to remove specified data, but its efficacy is typically assessed with task-level metrics like accuracy and perplexity. We show that these metrics can be misleading, as models can appear to…

Computation and Language · Computer Science 2026-05-19 Xiaoyu Xu , Xiang Yue , Yang Liu , Qingqing Ye , Huadi Zheng , Peizhao Hu , Minxin Du , Haibo Hu

Machine unlearning (MU) seeks to remove knowledge of specific data samples from trained models without the necessity for complete retraining, a task made challenging by the dual objectives of effective erasure of data and maintaining the…

Machine Learning · Computer Science 2024-07-16 Mark He Huang , Lin Geng Foo , Jun Liu

Machine unlearning (MU), which seeks to erase the influence of specific unwanted data from already-trained models, is becoming increasingly vital in model editing, particularly to comply with evolving data regulations like the ``right to be…

Machine Learning · Computer Science 2025-03-18 Changchang Sun , Ren Wang , Yihua Zhang , Jinghan Jia , Jiancheng Liu , Gaowen Liu , Yan Yan , Sijia Liu

Current unlearning and safety training methods consistently fail to remove dangerous knowledge from language models. We identify the root cause - unlearning targets representations which are too general - and develop a highly selective…

Machine Learning · Computer Science 2025-11-14 Filip Sondej , Yushi Yang

During pretraining, LLMs inadvertently memorize sensitive or copyrighted data, posing significant compliance challenges under legal frameworks like the GDPR and the EU AI Act. Fulfilling these mandates demands techniques that can remove…

Machine Learning · Computer Science 2026-03-23 Efstratios Zaradoukas , Bardh Prenkaj , Gjergji Kasneci

Enabling large language models (LLMs) to unlearn knowledge and capabilities acquired during training has proven vital for ensuring compliance with data regulations and promoting ethical practices in generative AI. Although there are growing…

Machine unlearning has the potential to improve the safety of large language models (LLMs) by removing sensitive or harmful information post hoc. A key challenge in unlearning involves balancing between forget quality (effectively…

Machine Learning · Computer Science 2025-06-23 Shengyuan Hu , Neil Kale , Pratiksha Thaker , Yiwei Fu , Steven Wu , Virginia Smith

Continuous unsupervised representation learning (CURL) research has greatly benefited from improvements in self-supervised learning (SSL) techniques. As a result, existing CURL methods using SSL can learn high-quality representations…

Machine Learning · Computer Science 2023-09-13 Alex Gomez-Villa , Bartlomiej Twardowski , Kai Wang , Joost van de Weijer

Machine unlearning (MU) aims to remove the influence of specific data from a trained model. However, approximate unlearning methods, often formulated as a single-objective optimization (SOO) problem, face a critical trade-off between…

Machine Learning · Computer Science 2025-10-23 Youngsik Hwang , Dong-Young Lim

The need to selectively and efficiently erase learned information from deep neural networks is becoming increasingly important for privacy, regulatory compliance, and adaptive system design. We introduce Graph-Propagated Projection…

Computer Vision and Pattern Recognition · Computer Science 2026-04-30 Shreyansh Pathak , Jyotishman Das