English
Related papers

Related papers: SoK: Unlearnability and Unlearning for Model Demem…

200 papers

Machine unlearning has great significance in guaranteeing model security and protecting user privacy. Additionally, many legal provisions clearly stipulate that users have the right to demand model providers to delete their own data from…

Machine Learning · Computer Science 2021-05-14 Yingzhe He , Guozhu Meng , Kai Chen , Jinwen He , Xingbo Hu

Machine unlearning is a promising approach to mitigate undesirable memorization of training data in ML models. However, in this work we show that existing approaches for unlearning in LLMs are surprisingly susceptible to a simple set of…

Machine Learning · Computer Science 2025-03-18 Shengyuan Hu , Yiwei Fu , Zhiwei Steven Wu , Virginia Smith

Vision-language models (VLMs) may memorize undesirable information from training data, motivating growing interest in machine unlearning. In this work, we present the first systematic survey and robustness analysis of VLM unlearning. We…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Yujie Lin , Kaidi Jia , Jiayao Ma , Chengyi Yang , Jinsong Su

With the introduction of data protection and privacy regulations, it has become crucial to remove the lineage of data on demand from a machine learning (ML) model. In the last few years, there have been notable developments in machine…

Machine Learning · Computer Science 2023-06-01 Ayush K Tarun , Vikram S Chundawat , Murari Mandal , Mohan Kankanhalli

Mitigating sensitive and harmful outputs is fundamental to ensuring safe deployment of LLMs. Existing approaches typically follow two paradigms: Knowledge Deletion (KD), which erases undesirable information during training, and…

Machine Learning · Computer Science 2026-05-19 Puning Yang , Junchi Yu , Qizhou Wang , Philip Torr , Bo Han , Xiuying Chen

The use of machine learning (ML) has become increasingly prevalent in various domains, highlighting the importance of understanding and ensuring its safety. One pressing concern is the vulnerability of ML applications to model stealing…

Machine Learning · Computer Science 2026-04-07 Ganghua Wang , Yuhong Yang , Jie Ding

Machine unlearning (MU) seeks to remove knowledge of specific data samples from trained models without the necessity for complete retraining, a task made challenging by the dual objectives of effective erasure of data and maintaining the…

Machine Learning · Computer Science 2024-07-16 Mark He Huang , Lin Geng Foo , Jun Liu

Machine unlearning, i.e. having a model forget about some of its training data, has become increasingly more important as privacy legislation promotes variants of the right-to-be-forgotten. In the context of deep learning, approaches for…

Machine Learning · Computer Science 2022-02-22 Anvith Thudi , Hengrui Jia , Ilia Shumailov , Nicolas Papernot

LLM have achieved success in many fields but still troubled by problematic content in the training corpora. LLM unlearning aims at reducing their influence and avoid undesirable behaviours. However, existing unlearning methods remain…

Computation and Language · Computer Science 2024-08-21 Hongbang Yuan , Zhuoran Jin , Pengfei Cao , Yubo Chen , Kang Liu , Jun Zhao

Duplication is a prevalent issue within datasets. Existing research has demonstrated that the presence of duplicated data in training datasets can significantly influence both model performance and data privacy. However, the impact of data…

Cryptography and Security · Computer Science 2025-07-17 Dayong Ye , Tianqing Zhu , Jiayang Li , Kun Gao , Bo Liu , Leo Yu Zhang , Wanlei Zhou , Yang Zhang

Training machine learning models requires the storage of large datasets, which often contain sensitive or private data. Storing data is associated with a number of potential risks which increase over time, such as database breaches and…

Machine Learning · Computer Science 2026-04-14 Aviraj Newatia , Michael Cooper , Viet Nguyen , Rahul G. Krishnan

Exact unlearning was first introduced as a privacy mechanism that allowed a user to retract their data from machine learning models on request. Shortly after, inexact schemes were proposed to mitigate the impractical costs associated with…

In recent years, large language models (LLMs) have spurred a new research paradigm in natural language processing. Despite their excellent capability in knowledge-based question answering and reasoning, their potential to retain faulty or…

Computation and Language · Computer Science 2023-12-11 Nianwen Si , Hao Zhang , Heyu Chang , Wenlin Zhang , Dan Qu , Weiqiang Zhang

Machine unlearning, the ability to erase the effect of specific training samples without retraining from scratch, is critical for privacy, regulation, and efficiency. However, most progress in unlearning has been empirical, with little…

Machine Learning · Computer Science 2026-02-04 Wei-Kai Chang , Rajiv Khanna

Machine unlearning, an emerging research topic focusing on compliance with data privacy regulations, enables trained models to remove the information learned from specific data. While many existing methods indirectly address this issue by…

Machine Learning · Computer Science 2024-12-24 Seonguk Seo , Dongwan Kim , Bohyung Han

As large language models (LLMs) are trained on massive datasets, they have raised significant privacy and ethical concerns due to their potential to inadvertently retain sensitive information. Unlearning seeks to selectively remove specific…

Computation and Language · Computer Science 2025-06-17 Philipp Spohn , Leander Girrbach , Jessica Bader , Zeynep Akata

The recent success of machine learning (ML) has been fueled by the increasing availability of computing power and large amounts of data in many different applications. However, the trustworthiness of the resulting models can be compromised…

Cryptography and Security · Computer Science 2024-03-11 Antonio Emanuele Cinà , Kathrin Grosse , Ambra Demontis , Battista Biggio , Fabio Roli , Marcello Pelillo

Machine learning and data systems increasingly function as infrastructures of memory: they ingest, store, and operationalize traces of personal, political, and cultural life. Yet contemporary governance demands credible forms of forgetting,…

Computers and Society · Computer Science 2026-02-25 Viktoriia Makovska , George Fletcher , Julia Stoyanovich , Tetiana Zakharchenko

Unlearnable examples are proposed to prevent third parties from exploiting unauthorized data, which generates unlearnable examples by adding imperceptible perturbations to public publishing data. These unlearnable examples proficiently…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Pucheng Dang , Xing Hu , Kaidi Xu , Jinhao Duan , Di Huang , Husheng Han , Rui Zhang , Zidong Du

Recent advances in generative models have demonstrated an exceptional ability to produce highly realistic images. However, previous studies show that generated images often resemble the training data, and this problem becomes more severe as…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Er Jin , Yang Zhang , Yongli Mou , Yanfei Dong , Stefan Decker , Kenji Kawaguchi , Johannes Stegmaier