中文
相关论文

相关论文: UniErase: Towards Balanced and Precise Unlearning …

200 篇论文

Large Language Models are typically trained on datasets collected from the web, which may inadvertently contain harmful or sensitive personal information. To address growing privacy concerns, unlearning methods have been proposed to remove…

机器学习 · 计算机科学 2025-10-23 Xiaoyu Wu , Yifei Pang , Terrance Liu , Zhiwei Steven Wu

Machine unlearning, the study of efficiently removing the impact of specific training instances on a model, has garnered increased attention in recent years due to regulatory guidelines such as the \emph{Right to be Forgotten}. Achieving…

机器学习 · 计算机科学 2024-06-07 Martin Pawelczyk , Seth Neel , Himabindu Lakkaraju

Large language model unlearning aims to remove harmful information that LLMs have learnt to prevent their use for malicious purposes. LLMU and RMU have been proposed as two methods for LLM unlearning, achieving impressive results on…

计算与语言 · 计算机科学 2025-02-25 Jai Doshi , Asa Cooper Stickland

Large Language Models (LLMs) have demonstrated strong capabilities in memorizing vast amounts of knowledge across diverse domains. However, the ability to selectively forget specific knowledge is critical for ensuring the safety and…

计算与语言 · 计算机科学 2025-05-20 Zhijie Deng , Chris Yuhao Liu , Zirui Pang , Xinlei He , Lei Feng , Qi Xuan , Zhaowei Zhu , Jiaheng Wei

Driven by privacy protection laws and regulations, unlearning in Large Language Models (LLMs) is gaining increasing attention. However, current research often neglects the interpretability of the unlearning process, particularly concerning…

机器学习 · 计算机科学 2025-04-10 Xiaohua Feng , Yuyuan Li , Chengye Wang , Junlin Liu , Li Zhang , Chaochao Chen

Machine unlearning aims to remove specific information, e.g. sensitive or undesirable content, from large language models (LLMs) while preserving overall performance. We propose an inference-time unlearning algorithm that uses contrastive…

计算与语言 · 计算机科学 2025-06-17 Vinith M. Suriyakumar , Ayush Sekhari , Ashia Wilson

Unlearning in large language models is becoming increasingly important due to regulatory compliance, copyright protection, and privacy concerns. However, a key challenge in LLM unlearning is unintended forgetting, where the removal of…

机器学习 · 计算机科学 2025-10-23 Peizhi Niu , Evelyn Ma , Huiting Zhou , Duo Zhou , Huan Zhang , S. Rasoul Etesami , Olgica Milenkovic

Machine unlearning has the potential to improve the safety of large language models (LLMs) by removing sensitive or harmful information post hoc. A key challenge in unlearning involves balancing between forget quality (effectively…

机器学习 · 计算机科学 2025-06-23 Shengyuan Hu , Neil Kale , Pratiksha Thaker , Yiwei Fu , Steven Wu , Virginia Smith

Machine unlearning, the process of efficiently removing specific information from machine learning models, is a growing area of interest for responsible AI. However, few studies have explored the effectiveness of unlearning methods on…

计算与语言 · 计算机科学 2025-12-19 Alkis Koudounas , Claudio Savelli , Flavio Giobergia , Elena Baralis

Unlearning the data observed during the training of a machine learning (ML) model is an important task that can play a pivotal role in fortifying the privacy and security of ML-based applications. This paper raises the following questions:…

机器学习 · 计算机科学 2023-06-01 Ayush K Tarun , Vikram S Chundawat , Murari Mandal , Mohan Kankanhalli

Machine unlearning has emerged as an important component in developing safe and trustworthy models. Prior work on fact unlearning in LLMs has mostly focused on removing a specified target fact robustly, but often overlooks its deductive…

计算与语言 · 计算机科学 2025-11-13 Ruihan Wu , Chhavi Yadav , Russ Salakhutdinov , Kamalika Chaudhuri

Large language model unlearning has become a critical challenge in ensuring safety and controlled model behavior by removing undesired data-model influences from the pretrained model while preserving general utility. Significant recent…

计算与语言 · 计算机科学 2025-04-17 Soumyadeep Pal , Changsheng Wang , James Diffenderfer , Bhavya Kailkhura , Sijia Liu

The widespread deployment of Large Language Models (LLMs) trained on massive, uncurated corpora has raised growing concerns about the inclusion of sensitive, copyrighted, or illegal content. This has led to increasing interest in LLM…

计算与语言 · 计算机科学 2025-06-10 Chenlong Zhang , Zhuoran Jin , Hongbang Yuan , Jiaheng Wei , Tong Zhou , Kang Liu , Jun Zhao , Yubo Chen

Large language models trained on massive corpora of data from the web can memorize and reproduce sensitive or private data raising both legal and ethical concerns. Unlearning, or tuning models to forget information present in their training…

机器学习 · 计算机科学 2024-01-12 Pratyush Maini , Zhili Feng , Avi Schwarzschild , Zachary C. Lipton , J. Zico Kolter

During pretraining, LLMs inadvertently memorize sensitive or copyrighted data, posing significant compliance challenges under legal frameworks like the GDPR and the EU AI Act. Fulfilling these mandates demands techniques that can remove…

机器学习 · 计算机科学 2026-03-23 Efstratios Zaradoukas , Bardh Prenkaj , Gjergji Kasneci

Language models trained on web-scale corpora risk memorizing and exposing sensitive information, prompting the need for effective machine unlearning. Prior methods mainly focus on input queries to suppress sensitive outputs, yet this often…

人工智能 · 计算机科学 2025-10-01 Junbeom Kim , Kyuyoung Kim , Jihoon Tack , Dongha Lim , Jinwoo Shin

Large Language Models (LLMs) can memorize sensitive information, raising concerns about potential misuse. LLM Unlearning, a post-hoc approach to remove this information from trained LLMs, offers a promising solution to mitigate these risks.…

计算与语言 · 计算机科学 2024-09-19 Tianle Gu , Kexin Huang , Ruilin Luo , Yuanqi Yao , Yujiu Yang , Yan Teng , Yingchun Wang

Recent advances in large language models (LLMs) have opened new opportunities for recommender systems by enabling rich semantic understanding and reasoning about user interests and item attributes. However, as privacy regulations tighten,…

信息检索 · 计算机科学 2026-04-08 Ziheng Chen , Jiali Cheng , Zezhong Fan , Hadi Amiri , Yunzhi Yao , Xiangguo Sun , Yang Zhang

Unlearning aims to remove copyrighted, sensitive, or private content from large language models (LLMs) without a full retraining. In this work, we develop a multi-task unlearning benchmark (LUME) which features three tasks: (1) unlearn…

Machine unlearning aims to selectively remove targeted knowledge from Large Language Models (LLMs), ensuring they forget specified content while retaining essential information. Existing unlearning metrics assess whether a model correctly…

计算与语言 · 计算机科学 2025-05-28 Wonje Jeung , Sangyeon Yoon , Albert No