English
Related papers

Related papers: Unlearned but Not Forgotten: Data Extraction after…

200 papers

With the advance of language models, privacy protection is receiving more attention. Training data extraction is therefore of great importance, as it can serve as a potential tool to assess privacy leakage. However, due to the difficulty of…

Computation and Language · Computer Science 2023-06-02 Weichen Yu , Tianyu Pang , Qian Liu , Chao Du , Bingyi Kang , Yan Huang , Min Lin , Shuicheng Yan

Driven by privacy protection laws and regulations, unlearning in Large Language Models (LLMs) is gaining increasing attention. However, current research often neglects the interpretability of the unlearning process, particularly concerning…

Machine Learning · Computer Science 2025-04-10 Xiaohua Feng , Yuyuan Li , Chengye Wang , Junlin Liu , Li Zhang , Chaochao Chen

Machine learning models may inadvertently memorize sensitive, unauthorized, or malicious data, posing risks of privacy breaches, security vulnerabilities, and performance degradation. To address these issues, machine unlearning has emerged…

Machine Learning · Computer Science 2024-04-08 Jie Xu , Zihan Wu , Cong Wang , Xiaohua Jia

Neural language models (LMs) are vulnerable to training data extraction attacks due to data memorization. This paper introduces a novel attack scenario wherein an attacker adversarially fine-tunes pre-trained LMs to amplify the exposure of…

Computation and Language · Computer Science 2024-09-04 Myung Gyo Oh , Hong Eun Ahn , Leo Hyun Park , Taekyoung Kwon

Machine unlearning -- efficiently removing the effect of a small "forget set" of training data on a pre-trained machine learning model -- has recently attracted significant research interest. Despite this interest, however, recent work…

Machine Learning · Computer Science 2024-11-13 Kristian Georgiev , Roy Rinberg , Sung Min Park , Shivam Garg , Andrew Ilyas , Aleksander Madry , Seth Neel

Unlearning in large language models (LLMs) aims to remove harmful training data while preserving overall utility. However, we find that existing methods often hallucinate, generate abnormal token sequences, or behave inconsistently, raising…

Machine Learning · Computer Science 2026-05-12 Renjie Gu , Jiazhen Du , Yihua Zhang , Sijia Liu

The imperative to eliminate undesirable data memorization underscores the significance of machine unlearning for large language models (LLMs). Recent research has introduced a series of promising unlearning methods, notably boosting the…

Machine Learning · Computer Science 2025-02-26 Qizhou Wang , Bo Han , Puning Yang , Jianing Zhu , Tongliang Liu , Masashi Sugiyama

Machine unlearning for large language models (LLMs) aims to remove undesired data, knowledge, and behaviors (e.g., for safety, privacy, or copyright) while preserving useful model capabilities. Despite rapid progress over the past two…

Machine Learning · Computer Science 2025-10-10 Chongyu Fan , Changsheng Wang , Yancheng Huang , Soumyadeep Pal , Sijia Liu

With the continued advancement and widespread adoption of machine learning (ML) models across various domains, ensuring user privacy and data security has become a paramount concern. In compliance with data privacy regulations, such as…

Machine Learning · Computer Science 2024-07-09 Nexhi Sula , Abhinav Kumar , Jie Hou , Han Wang , Reza Tourani

Large language models (LLMs) are trained on massive datasets that may include private or copyrighted content. Due to growing privacy and ownership concerns, data owners may request the removal of their data from trained models. Machine…

Machine Learning · Computer Science 2026-01-13 Zhihao Liu , Jian Lou , Yuke Hu , Xiaochen Li , Yitian Chen , Tailun Chen , Zhizhen Qin , Kui Ren , Zhan Qin

Machine unlearning aims to remove sensitive or undesired data from large language models. However, recent studies suggest that unlearning is often shallow, claiming that removed knowledge can easily be recovered. In this work, we critically…

Machine Learning · Computer Science 2025-06-03 Zhili Feng , Yixuan Even Xu , Alexander Robey , Robert Kirk , Xander Davies , Yarin Gal , Avi Schwarzschild , J. Zico Kolter

Machine unlearning is the process of removing the imprint left by specific data samples during the training of a machine learning model. AI developers, including those building personalized technologies, employ machine unlearning for…

Machine Learning · Computer Science 2026-03-10 Hanyu Duan , Yi Yang , Ahmed Abbasi , Kar Yan Tam

Unlearning in large language models (LLMs) is critical for regulatory compliance and for building ethical generative AI systems that avoid producing private, toxic, illegal, or copyrighted content. Despite rapid progress, in this work, we…

Machine Learning · Computer Science 2026-05-29 Hadi Reisizadeh , Jiajun Ruan , Yiwei Chen , Soumyadeep Pal , Sijia Liu , Mingyi Hong

Large Language Models (LLMs) have achieved remarkable progress in natural language understanding, reasoning, and autonomous decision-making. However, these advancements have also come with significant privacy concerns. While significant…

Cryptography and Security · Computer Science 2026-01-27 Yuntao Du , Zitao Li , Ninghui Li , Bolin Ding

Fine-tuning-based unlearning methods prevail for preventing targeted harmful, sensitive, or copyrighted information within large language models while preserving overall capabilities. However, the true effectiveness of these methods is…

Computation and Language · Computer Science 2024-10-16 Yihuai Hong , Yuelin Zou , Lijie Hu , Ziqian Zeng , Di Wang , Haiqin Yang

Large Vision-Language Models (LVLMs) can recognize individuals in images and disclose sensitive personal information about them, raising critical privacy concerns. Machine unlearning aims to remove such knowledge from the model. However,…

Machine Learning · Computer Science 2026-04-21 Minsung Kim , Nakyeong Yang , Kyomin Jung

Unlearning in large language models (LLMs) involves precisely removing specific information from a pre-trained model. This is crucial to ensure safety of LLMs by deleting private data or harmful knowledge acquired during pre-training.…

Machine Learning · Computer Science 2025-09-04 Naman Deep Singh , Maximilian Müller , Francesco Croce , Matthias Hein

Machine learning models trained on vast amounts of real or synthetic data often achieve outstanding predictive performance across various domains. However, this utility comes with increasing concerns about privacy, as the training data may…

Cryptography and Security · Computer Science 2024-07-09 Binhao Ma , Tianhang Zheng , Hongsheng Hu , Di Wang , Shuo Wang , Zhongjie Ba , Zhan Qin , Kui Ren

Machine unlearning aims to remove the influence of specific training samples from a trained model without full retraining. While prior work has largely focused on privacy-motivated settings, we recast unlearning as a general-purpose tool…

Image and Video Processing · Electrical Eng. & Systems 2026-02-11 George R. Nahass , Zhu Wang , Homa Rashidisabet , Won Hwa Kim , Sasha Hubschman , Jeffrey C. Peterson , Chad A. Purnell , Pete Setabutr , Ann Q. Tran , Darvin Yi , Sathya N. Ravi

The significant advancements in large language models (LLMs) give rise to a promising research direction, i.e., leveraging LLMs as recommenders (LLMRec). The efficacy of LLMRec arises from the open-world knowledge and reasoning capabilities…

Information Retrieval · Computer Science 2024-07-02 Hangyu Wang , Jianghao Lin , Bo Chen , Yang Yang , Ruiming Tang , Weinan Zhang , Yong Yu