中文
相关论文

相关论文: Towards Benign Memory Forgetting for Selective Mul…

200 篇论文

The growing use of large language models in sensitive domains has exposed a critical weakness: the inability to ensure that private information can be permanently forgotten. Yet these systems still lack reliable mechanisms to guarantee that…

机器学习 · 计算机科学 2025-11-14 James Jin Kang , Dang Bui , Thanh Pham , Huo-Chong Ling

Large language model (LLM) agents increasingly rely on accumulated memory to solve long-horizon decision-making tasks. However, most existing approaches store memory in fixed representations and reuse it at a single or implicit level of…

人工智能 · 计算机科学 2026-01-13 Sirui Liang , Pengfei Cao , Jian Zhao , Wenhao Teng , Xiangwen Liao , Jun Zhao , Kang Liu

Large Language Models (LLMs) deployed in real-world settings increasingly face the need to unlearn sensitive, outdated, or proprietary information. Existing unlearning methods typically formulate forgetting and retention as a regularized…

计算与语言 · 计算机科学 2025-10-28 Taha Entesari , Arman Hatami , Rinat Khaziev , Anil Ramakrishna , Mahyar Fazlyab

While numerous machine unlearning (MU) methods have recently been developed with promising results in erasing the influence of forgotten data, classes, or concepts, they are also highly vulnerable-for example, simple fine-tuning can…

机器学习 · 计算机科学 2026-04-10 Yichen Gao , Altay Unal , Akshay Rangamani , Zhihui Zhu

Large language model (LLM) unlearning has become a critical mechanism for removing undesired data, knowledge, or behaviors from pre-trained models while retaining their general utility. Yet, with the rise of open-weight LLMs, we ask: can…

机器学习 · 计算机科学 2025-10-21 Bingqi Shang , Yiwei Chen , Yihua Zhang , Bingquan Shen , Sijia Liu

Large Language Models (LLMs) are foundational to AI advancements, facilitating applications like predictive text generation. Nonetheless, they pose risks by potentially memorizing and disseminating sensitive, biased, or copyrighted…

人工智能 · 计算机科学 2024-03-26 Youyang Qu , Ming Ding , Nan Sun , Kanchana Thilakarathna , Tianqing Zhu , Dusit Niyato

Multimodal large language models (MLLMs) have achieved remarkable success in vision-language tasks, but their reliance on vast, internet-sourced data raises significant privacy and security concerns. Machine unlearning (MU) has emerged as a…

计算机视觉与模式识别 · 计算机科学 2025-07-23 Zhaopan Xu , Pengfei Zhou , Weidong Tang , Jiaxin Ai , Wangbo Zhao , Kai Wang , Xiaojiang Peng , Wenqi Shao , Hongxun Yao , Kaipeng Zhang

Large Language Models (LLMs) have demonstrated strong reasoning and memorization capabilities via pretraining on massive textual corpora. However, this poses risk of privacy and copyright violations, highlighting the need for efficient…

机器学习 · 计算机科学 2025-04-28 Sungmin Cha , Sungjun Cho , Dasol Hwang , Moontae Lee

Large Language Models (LLMs) can memorize sensitive information, raising concerns about potential misuse. LLM Unlearning, a post-hoc approach to remove this information from trained LLMs, offers a promising solution to mitigate these risks.…

计算与语言 · 计算机科学 2024-09-19 Tianle Gu , Kexin Huang , Ruilin Luo , Yuanqi Yao , Yujiu Yang , Yan Teng , Yingchun Wang

Large language model (LLM) unlearning aims to remove specific data influences from pre-trained model without costly retraining, addressing privacy, copyright, and safety concerns. However, recent studies reveal a critical vulnerability:…

计算与语言 · 计算机科学 2026-05-13 Zeguan Xiao , Xuanzhe Xu , Yun Chen , Yong Wang , Jian Yang , Yanqing Hu , Guanhua Chen

Large Language Models (LLMs) internalize vast world knowledge as parametric memory, yet inevitably inherit the staleness and errors of their source corpora. Consequently, ensuring the reliability and malleability of these internal…

计算与语言 · 计算机科学 2026-04-08 Xiaojie Gu , Ziying Huang , Weicong Hong , Jian Xie , Renze Lou , Kai Zhang

VLMs trained on web-scale data retain sensitive and copyrighted visual concepts that deployment may require removing. Training-based unlearning methods share a structural flaw: fine-tuning on a narrow forget set degrades general…

计算机视觉与模式识别 · 计算机科学 2026-04-06 Zhangyun Tan , Zeliang Zhang , Susan Liang , Yolo Yunlong Tang , Lisha Chen , Chenliang Xu

The objective of digital forgetting is, given a model with undesirable knowledge or behavior, obtain a new model where the detected issues are no longer present. The motivations for forgetting include privacy protection, copyright…

Current LLM unlearning methods face a critical security vulnerability that undermines their fundamental purpose: while they appear to successfully remove sensitive or harmful knowledge, this ``forgotten" information remains precariously…

机器学习 · 计算机科学 2025-10-01 Wenhan Wu , Zheyuan Liu , Chongyang Gao , Ren Wang , Kaize Ding

Pretrained language models memorize vast amounts of information, including private and copyrighted data, raising significant safety concerns. Retraining these models after excluding sensitive data is prohibitively expensive, making machine…

计算与语言 · 计算机科学 2024-10-04 Minseok Choi , Kyunghyun Min , Jaegul Choo

Machine unlearning aims to selectively remove the influence of specific training samples to satisfy privacy regulations such as the GDPR's 'Right to be Forgotten'. However, many existing methods require access to the data being removed,…

Large language models (LLMs) exhibit remarkable generative capabilities but raise ethical and security concerns by memorizing sensitive data, reinforcing biases, and producing harmful content. These risks have spurred interest in LLM…

机器学习 · 计算机科学 2025-10-13 Changsheng Wang , Yihua Zhang , Dennis Wei , Jinghan Jia , Pin-Yu Chen , Sijia Liu

The deployment of large language models (LLMs) like ChatGPT and Gemini has shown their powerful natural language generation capabilities. However, these models can inadvertently learn and retain sensitive information and harmful content…

密码学与安全 · 计算机科学 2025-10-14 Shang Wang , Tianqing Zhu , Dayong Ye , Wanlei Zhou

The paper demonstrate that simple adjustments of the fine-tuning recipes of multimodal large language models (MLLM) are sufficient to mitigate catastrophic forgetting. On visual question answering, we design a 2x2 experimental framework to…

计算机视觉与模式识别 · 计算机科学 2026-03-17 He Li , Yuhui Zhang , Xiaohan Wang , Kaifeng Lyu , Serena Yeung-Levy

Unlearning in Large Language Models (LLMs) aims to enhance safety, mitigate biases, and comply with legal mandates, such as the right to be forgotten. However, existing unlearning methods are brittle: minor query modifications, such as…

人工智能 · 计算机科学 2026-03-13 Raj Sanjay Shah , Jing Huang , Keerthiram Murugesan , Nathalie Baracaldo , Diyi Yang