English
Related papers

Related papers: Measuring the Depth of LLM Unlearning via Activati…

200 papers

Large Language Models (LLMs) inevitably acquire harmful information during training on massive datasets. LLM unlearning aims to eliminate the influence of such harmful information while maintaining the model's overall performance. Existing…

Computation and Language · Computer Science 2025-03-07 Wenyu Wang , Mengqi Zhang , Xiaotian Ye , Zhaochun Ren , Zhumin Chen , Pengjie Ren

Given the prevalence of large language models (LLMs) and the prohibitive cost of training these models from scratch, dynamically forgetting specific knowledge e.g., private or proprietary, without retraining the model has become an…

Computation and Language · Computer Science 2024-08-09 Tyler Lizzo , Larry Heck

Large Language Models (LLMs) embed sensitive, human-generated data, prompting the need for unlearning methods. Although certified unlearning offers strong privacy guarantees, its restrictive assumptions make it unsuitable for LLMs, giving…

Machine Learning · Computer Science 2025-06-03 Rongzhe Wei , Mufei Li , Mohsen Ghassemi , Eleonora Kreačić , Yifan Li , Xiang Yue , Bo Li , Vamsi K. Potluru , Pan Li , Eli Chien

The growing use of large language models in sensitive domains has exposed a critical weakness: the inability to ensure that private information can be permanently forgotten. Yet these systems still lack reliable mechanisms to guarantee that…

Machine Learning · Computer Science 2025-11-14 James Jin Kang , Dang Bui , Thanh Pham , Huo-Chong Ling

LLMs trained on massive datasets may inadvertently acquire sensitive information such as personal details and potentially harmful content. This risk is further heightened in multimodal LLMs as they integrate information from multiple…

Computation and Language · Computer Science 2025-05-06 Vaidehi Patil , Yi-Lin Sung , Peter Hase , Jie Peng , Tianlong Chen , Mohit Bansal

Machine unlearning techniques aim to mitigate unintended memorization in large language models (LLMs). However, existing approaches predominantly focus on the explicit removal of isolated facts, often overlooking latent inferential…

Unlearning in large language models (LLMs) involves precisely removing specific information from a pre-trained model. This is crucial to ensure safety of LLMs by deleting private data or harmful knowledge acquired during pre-training.…

Machine Learning · Computer Science 2025-09-04 Naman Deep Singh , Maximilian Müller , Francesco Croce , Matthias Hein

Although Large Language Models (LLMs) have demonstrated impressive capabilities across a wide range of tasks, growing concerns have emerged over the misuse of sensitive, copyrighted, or harmful data during training. To address these…

Cryptography and Security · Computer Science 2025-06-03 Jie Ren , Zhenwei Dai , Xianfeng Tang , Yue Xing , Shenglai Zeng , Hui Liu , Jingying Zeng , Qiankun Peng , Samarth Varshney , Suhang Wang , Qi He , Charu C. Aggarwal , Hui Liu

Language models (LMs) are trained on vast amounts of text data, which may include private and copyrighted content. Data owners may request the removal of their data from a trained model due to privacy or copyright concerns. However, exactly…

Computation and Language · Computer Science 2024-07-16 Weijia Shi , Jaechan Lee , Yangsibo Huang , Sadhika Malladi , Jieyu Zhao , Ari Holtzman , Daogao Liu , Luke Zettlemoyer , Noah A. Smith , Chiyuan Zhang

Machine unlearning has emerged as a critical capability for addressing privacy, safety, and regulatory concerns in large language models (LLMs). Existing methods operate at the sequence level, applying uniform updates across all tokens…

Computation and Language · Computer Science 2026-05-07 Jiawei Wu , Doudou Zhou

Large language model (LLM) unlearning is critical in real-world applications where it is necessary to efficiently remove the influence of private, copyrighted, or harmful data from some users. Existing utility-centric unlearning metrics…

Large Language Models (LLMs) are foundational to AI advancements, facilitating applications like predictive text generation. Nonetheless, they pose risks by potentially memorizing and disseminating sensitive, biased, or copyrighted…

Artificial Intelligence · Computer Science 2024-03-26 Youyang Qu , Ming Ding , Nan Sun , Kanchana Thilakarathna , Tianqing Zhu , Dusit Niyato

Machine unlearning has the potential to improve the safety of large language models (LLMs) by removing sensitive or harmful information post hoc. A key challenge in unlearning involves balancing between forget quality (effectively…

Machine Learning · Computer Science 2025-06-23 Shengyuan Hu , Neil Kale , Pratiksha Thaker , Yiwei Fu , Steven Wu , Virginia Smith

Large Language Models for Code (LLMs4Code) have achieved strong performance in code generation, but recent studies reveal that they may memorize and leak sensitive information contained in training data, posing serious privacy risks. To…

Cryptography and Security · Computer Science 2026-01-29 Shanzhi Gu , Zhaoyang Qu , Ruotong Geng , Mingyang Geng , Shangwen Wang , Chuanfu Xu , Haotian Wang , Zhipeng Lin , Dezun Dong

While LLMs are increasingly used in commercial services, they pose privacy risks such as leakage of sensitive personally identifiable information (PII). For LLMs trained on multilingual corpora, Multilingual Machine Unlearning (MMU) aims to…

Computation and Language · Computer Science 2026-05-15 Kyomin Hwang , Hyeonjin Kim , Sangyeon Cho , Nojun Kwak

Large language models (LLMs) exhibit remarkable generative capabilities but raise ethical and security concerns by memorizing sensitive data, reinforcing biases, and producing harmful content. These risks have spurred interest in LLM…

Machine Learning · Computer Science 2025-10-13 Changsheng Wang , Yihua Zhang , Dennis Wei , Jinghan Jia , Pin-Yu Chen , Sijia Liu

Exact unlearning was first introduced as a privacy mechanism that allowed a user to retract their data from machine learning models on request. Shortly after, inexact schemes were proposed to mitigate the impractical costs associated with…

We expose a critical limitation in current approaches to machine unlearning in language models: despite the apparent success of unlearning algorithms, information about the forgotten data remains linearly decodable from internal…

Machine Learning · Computer Science 2026-01-22 Anmol Goel , Alan Ritter , Iryna Gurevych

With the implementation of personal data privacy regulations, the field of machine learning (ML) faces the challenge of the "right to be forgotten". Machine unlearning has emerged to address this issue, aiming to delete data and reduce its…

Machine Learning · Computer Science 2024-04-02 Yi Xu

We explore machine unlearning (MU) in the domain of large language models (LLMs), referred to as LLM unlearning. This initiative aims to eliminate undesirable data influence (e.g., sensitive or illegal information) and the associated model…