English
Related papers

Related papers: Erase or Hide? Suppressing Spurious Unlearning Neu…

200 papers

Training machine learning models requires the storage of large datasets, which often contain sensitive or private data. Storing data is associated with a number of potential risks which increase over time, such as database breaches and…

Machine Learning · Computer Science 2026-04-14 Aviraj Newatia , Michael Cooper , Viet Nguyen , Rahul G. Krishnan

Large language models trained on massive corpora of data from the web can memorize and reproduce sensitive or private data raising both legal and ethical concerns. Unlearning, or tuning models to forget information present in their training…

Machine Learning · Computer Science 2024-01-12 Pratyush Maini , Zhili Feng , Avi Schwarzschild , Zachary C. Lipton , J. Zico Kolter

Machine Learning models thrive on vast datasets, continuously adapting to provide accurate predictions and recommendations. However, in an era dominated by privacy concerns, Machine Unlearning emerges as a transformative approach, enabling…

Machine Learning · Computer Science 2025-12-10 Robert Dilworth

Language Models (LMs) are prone to ''memorizing'' training data, including substantial sensitive user information. To mitigate privacy risks and safeguard the right to be forgotten, machine unlearning has emerged as a promising approach for…

Cryptography and Security · Computer Science 2025-06-11 Jiacheng Du , Zhibo Wang , Jie Zhang , Xiaoyi Pang , Jiahui Hu , Kui Ren

Large language models (LLMs) exhibit remarkable generative capabilities but raise ethical and security concerns by memorizing sensitive data, reinforcing biases, and producing harmful content. These risks have spurred interest in LLM…

Machine Learning · Computer Science 2025-10-13 Changsheng Wang , Yihua Zhang , Dennis Wei , Jinghan Jia , Pin-Yu Chen , Sijia Liu

Generative models such as Large Language Models (LLMs) and Multimodal Large Language Models (MLLMs) trained on massive datasets can lead them to memorize and inadvertently reveal sensitive information, raising ethical and privacy concerns.…

Computation and Language · Computer Science 2025-07-24 Zheyuan Liu , Guangyao Dou , Xiangchi Yuan , Chunhui Zhang , Zhaoxuan Tan , Meng Jiang

Large Language Models are prone to memorizing sensitive, copyrighted, or hazardous content, posing significant privacy and legal concerns. Retraining from scratch is computationally infeasible, whereas current unlearning methods exhibit…

Machine Learning · Computer Science 2026-03-03 Saleh Zare Zade , Xiangyu Zhou , Sijia Liu , Dongxiao Zhu

Machine unlearning focuses on efficiently removing specific data from trained models, addressing privacy and compliance concerns with reasonable costs. Although exact unlearning ensures complete data removal equivalent to retraining, it is…

Cryptography and Security · Computer Science 2025-06-17 Nima Naderloui , Shenao Yan , Binghui Wang , Jie Fu , Wendy Hui Wang , Weiran Liu , Yuan Hong

Pretrained language models memorize vast amounts of information, including private and copyrighted data, raising significant safety concerns. Retraining these models after excluding sensitive data is prohibitively expensive, making machine…

Computation and Language · Computer Science 2024-10-04 Minseok Choi , Kyunghyun Min , Jaegul Choo

Pretrained Language Models (LMs) memorize a vast amount of knowledge during initial pretraining, including information that may violate the privacy of personal lives and identities. Previous work addressing privacy issues for language…

Computation and Language · Computer Science 2022-12-20 Joel Jang , Dongkeun Yoon , Sohee Yang , Sungmin Cha , Moontae Lee , Lajanugen Logeswaran , Minjoon Seo

Large Language Models (LLMs) trained on extensive corpora inevitably retain sensitive data, such as personal privacy information and copyrighted material. Recent advancements in knowledge unlearning involve updating LLM parameters to erase…

Computation and Language · Computer Science 2024-10-08 Bozhong Tian , Xiaozhuan Liang , Siyuan Cheng , Qingbin Liu , Mengru Wang , Dianbo Sui , Xi Chen , Huajun Chen , Ningyu Zhang

Large language models trained on web-scale corpora can memorize undesirable data containing misinformation, copyrighted material, or private or sensitive information. Recently, several machine unlearning algorithms have been proposed to…

Computation and Language · Computer Science 2025-05-27 Keivan Rezaei , Khyathi Chandu , Soheil Feizi , Yejin Choi , Faeze Brahman , Abhilasha Ravichander

Advanced model dememorization methods, including availability poisoning (unlearnability) and machine unlearning, are emerging as key safeguards against data misuse in machine learning (ML). At the training stage, unlearnability embeds…

Machine Learning · Computer Science 2026-05-13 Mengying Zhang , Derui Wang , Ruoxi Sun , Xiaoyu Xia , Shuang Hao , Minhui Xue

Machine unlearning allows data owners to erase the impact of their specified data from trained models. Unfortunately, recent studies have shown that adversaries can recover the erased data, posing serious threats to user privacy. An…

Cryptography and Security · Computer Science 2025-03-04 Weiqi Wang , Chenhan Zhang , Zhiyi Tian , Shushu Liu , Shui Yu

As pretrained models are increasingly shared on the web, ensuring that models can forget or delete sensitive, copyrighted, or private information upon request has become crucial. Machine unlearning has been proposed to address this…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Yurim Jang , Jaeung Lee , Dohyun Kim , Jaemin Jo , Simon S. Woo

Machine unlearning aims to selectively remove the influence of specific training samples to satisfy privacy regulations such as the GDPR's 'Right to be Forgotten'. However, many existing methods require access to the data being removed,…

Cryptography and Security · Computer Science 2026-05-27 Dinesh Srivasthav P , Ashok Urlana , Rahul Mishra , Bala Mallikarjunarao Garlapati , Ponnurangam Kumaraguru

Large Language Models (LLMs) can memorize sensitive information, raising concerns about potential misuse. LLM Unlearning, a post-hoc approach to remove this information from trained LLMs, offers a promising solution to mitigate these risks.…

Computation and Language · Computer Science 2024-09-19 Tianle Gu , Kexin Huang , Ruilin Luo , Yuanqi Yao , Yujiu Yang , Yan Teng , Yingchun Wang

Text guided diffusion models are used by millions of users, but can be easily exploited to produce harmful content. Concept unlearning methods aim at reducing the models' likelihood of generating harmful content. Traditionally, this has…

Artificial Intelligence · Computer Science 2026-02-10 Mansi , Avinash Kori , Francesca Toni , Soteris Demetriou

Machine unlearning (MU) aims to eliminate information that has been learned from specific training data, namely forgetting data, from a pre-trained model. Currently, the mainstream of existing MU methods involves modifying the forgetting…

Machine Learning · Computer Science 2025-10-13 Zhengbao He , Tao Li , Xinwen Cheng , Zhehao Huang , Xiaolin Huang

With the growing adoption of data privacy regulations, the ability to erase private or copyrighted information from trained models has become a crucial requirement. Traditional unlearning methods often assume access to the complete training…

Machine Learning · Computer Science 2025-12-22 Umit Yigit Basaran , Sk Miraj Ahmed , Amit Roy-Chowdhury , Basak Guler