English
Related papers

Related papers: MUSE: Machine Unlearning Six-Way Evaluation for La…

200 papers

While Large Language Models (LLMs) excel at code generation, their inherent tendency toward verbatim memorization of training data introduces critical risks like copyright infringement, insecure emission, and deprecated API utilization,…

Software Engineering · Computer Science 2025-11-25 Xue Jiang , Yihong Dong , Huangzhao Zhang , Tangxinyu Wang , Zheng Fang , Yingwei Ma , Rongyu Cao , Binhua Li , Zhi Jin , Wenpin Jiao , Yongbin Li , Ge Li

Machine unlearning, a process enabling pre-trained models to remove the influence of specific training samples, has attracted significant attention in recent years. While extensive research has focused on developing efficient unlearning…

Cryptography and Security · Computer Science 2024-10-15 Heng Xu , Tianqing Zhu , Wanlei Zhou

Machine unlearning aims to remove specific data influences from trained models, a capability essential for adhering to copyright laws and ensuring AI safety. Current unlearning metrics typically measure success by monitoring the model's…

Cryptography and Security · Computer Science 2025-12-24 Hengrui Jia , Taoran Li , Jonas Guan , Varun Chandrasekaran

Machine unlearning, an emerging research topic focusing on compliance with data privacy regulations, enables trained models to remove the information learned from specific data. While many existing methods indirectly address this issue by…

Machine Learning · Computer Science 2024-12-24 Seonguk Seo , Dongwan Kim , Bohyung Han

Machine Unlearning (MU) aims at removing the influence of specific data from a pretrained model while preserving performance on the remaining data. In this work, a novel perspective for MU is presented upon low-dimensional feature…

Machine Learning · Computer Science 2026-02-02 Kun Fang , Qinghua Tao , Junxu Liu , Yaxin Xiao , Qingqing Ye , Jian Sun , Haibo Hu

Large language models may encode sensitive information or outdated knowledge that needs to be removed, to ensure responsible and compliant model responses. Unlearning has emerged as an efficient alternative to full retraining, aiming to…

Computation and Language · Computer Science 2026-05-28 Yuefeng Peng , Parnian Afshar , Megan Ganji , Thomas Butler , Amir Houmansadr , Mingxian Wang , Dezhi Hong

As AI models are trained on ever-expanding datasets, the ability to remove the influence of specific data from trained models has become essential for privacy protection and regulatory compliance. Unlearning addresses this challenge by…

Artificial Intelligence · Computer Science 2026-01-21 Shizhou Xu , Yuan Ni , Stefan Broecker , Thomas Strohmer

Unlearning the data observed during the training of a machine learning (ML) model is an important task that can play a pivotal role in fortifying the privacy and security of ML-based applications. This paper raises the following questions:…

Machine Learning · Computer Science 2023-06-01 Ayush K Tarun , Vikram S Chundawat , Murari Mandal , Mohan Kankanhalli

Language models (LMs) risk inadvertently memorizing and divulging sensitive or personally identifiable information (PII) seen in training data, causing privacy concerns. Current approaches to address this issue involve costly dataset…

Computation and Language · Computer Science 2025-09-09 Tomer Ashuach , Martin Tutek , Yonatan Belinkov

Despite legal mandates for the right to be forgotten, AI operators routinely fail to comply with data deletion requests. While machine unlearning (MU) provides a technical solution to remove personal data's influence from trained models,…

Machine Learning · Computer Science 2026-02-17 Qinqi Lin , Ningning Ding , Lingjie Duan , Jianwei Huang

Modern large language models often encode sensitive, harmful, or copyrighted knowledge, raising the need for post-hoc unlearning-the ability to remove specific domains of knowledge from a model without full retraining. A major bottleneck in…

Computation and Language · Computer Science 2025-10-08 Xiaoyuan Zhu , Muru Zhang , Ollie Liu , Robin Jia , Willie Neiswanger

Machine unlearning, the study of efficiently removing the impact of specific training instances on a model, has garnered increased attention in recent years due to regulatory guidelines such as the \emph{Right to be Forgotten}. Achieving…

Machine Learning · Computer Science 2024-06-07 Martin Pawelczyk , Seth Neel , Himabindu Lakkaraju

Machine unlearning offers a practical alternative to avoid full model re-training by approximately removing the influence of specific user data. While existing methods certify unlearning via statistical indistinguishability from re-trained…

Machine Learning · Computer Science 2026-02-02 Hsiang Hsu , Pradeep Niroula , Zichang He , Ivan Brugere , Freddy Lecue , Chun-Fu Chen

The widespread popularity of Large Language Models (LLMs), partly due to their unique ability to perform in-context learning, has also brought to light the importance of ethical and safety considerations when deploying these pre-trained…

Computation and Language · Computer Science 2024-08-07 Karuna Bhaila , Minh-Hao Van , Xintao Wu

With the continued advancement and widespread adoption of machine learning (ML) models across various domains, ensuring user privacy and data security has become a paramount concern. In compliance with data privacy regulations, such as…

Machine Learning · Computer Science 2024-07-09 Nexhi Sula , Abhinav Kumar , Jie Hou , Han Wang , Reza Tourani

Large language models (LLMs) store vast amounts of information, making them powerful yet raising privacy and safety concerns when selective knowledge removal is required. Existing unlearning strategies, ranging from gradient-based…

Computation and Language · Computer Science 2025-06-02 Xu Wang , Zihao Li , Benyou Wang , Yan Hu , Difan Zou

Large Language Models (LLMs) inevitably memorize sensitive information during training, posing significant privacy risks. Machine unlearning has emerged as a promising solution to selectively remove such information without full retraining.…

Machine Learning · Computer Science 2026-04-02 Yuze Wang , Yujia Tong , Xuan Liu , Junhao Dong

While large language models (LLMs) exhibit remarkable capabilities, they increasingly face demands to unlearn memorized privacy-sensitive, copyrighted, or harmful content. Existing unlearning methods primarily focus on \emph{single-shot}…

Computation and Language · Computer Science 2026-05-08 Xiaoyu Xu , Minxin Du , Kun Fang , Yaxin Xiao , Zhicong Huang , Cheng Hong , Qingqing Ye , Haibo Hu

The task of "unlearning" certain concepts in large language models (LLMs) has attracted immense attention recently, due to its importance in mitigating undesirable model behaviours, such as the generation of harmful, private, or incorrect…

Computation and Language · Computer Science 2025-09-03 Yihuai Hong , Lei Yu , Haiqin Yang , Shauli Ravfogel , Mor Geva

Enabling large language models (LLMs) to unlearn knowledge and capabilities acquired during training has proven vital for ensuring compliance with data regulations and promoting ethical practices in generative AI. Although there are growing…