中文
相关论文

相关论文: iShumei-Chinchunmei at SemEval-2025 Task 4: A bala…

200 篇论文

The imperative to eliminate undesirable data memorization underscores the significance of machine unlearning for large language models (LLMs). Recent research has introduced a series of promising unlearning methods, notably boosting the…

机器学习 · 计算机科学 2025-02-26 Qizhou Wang , Bo Han , Puning Yang , Jianing Zhu , Tongliang Liu , Masashi Sugiyama

The growing concern over training data privacy has elevated the "Right to be Forgotten" into a critical requirement, thereby raising the demand for effective Machine Unlearning. However, existing unlearning approaches commonly suffer from a…

机器学习 · 计算机科学 2026-02-20 Haoyu Wang , Zhuo Huang , Xiaolong Wang , Bo Han , Zhiwei Lin , Tongliang Liu

This paper explores Machine Unlearning (MU), an emerging field that is gaining increased attention due to concerns about neural models unintentionally remembering personal or sensitive information. We present SeUL, a novel method that…

计算与语言 · 计算机科学 2024-12-17 Lingzhi Wang , Xingshan Zeng , Jinsong Guo , Kam-Fai Wong , Georg Gottlob

Large language models may encode sensitive information or outdated knowledge that needs to be removed, to ensure responsible and compliant model responses. Unlearning has emerged as an efficient alternative to full retraining, aiming to…

计算与语言 · 计算机科学 2026-05-28 Yuefeng Peng , Parnian Afshar , Megan Ganji , Thomas Butler , Amir Houmansadr , Mingxian Wang , Dezhi Hong

The undesired memorization of sensitive information by Large Language Models (LLMs) has emphasized the need for safety mechanisms that can regulate model behavior. This has led to the development of machine unlearning techniques that enable…

机器学习 · 计算机科学 2025-10-10 Anu Agarwal , Mihir Pamnani , Dilek Hakkani-Tur

Machine unlearning poses challenges in removing mislabeled, contaminated, or problematic data from a pretrained model. Current unlearning approaches and evaluation metrics are solely focused on model predictions, which limits insight into…

机器学习 · 计算机科学 2026-04-13 Khoa Tran , Simon S. Woo

Unlearning seeks to remove specific knowledge from large language models (LLMs), but its effectiveness remains contested. On one side, "forgotten" knowledge can often be recovered through interventions such as light fine-tuning; on the…

计算与语言 · 计算机科学 2025-09-30 Qingjie Zhang , Haoting Qian , Zhicong Huang , Cheng Hong , Minlie Huang , Ke Xu , Chao Zhang , Han Qiu

Enabling large language models (LLMs) to unlearn knowledge and capabilities acquired during training has proven vital for ensuring compliance with data regulations and promoting ethical practices in generative AI. Although there are growing…

When introducing Large Language Models (LLMs) into industrial applications, such as healthcare and education, the risk of generating harmful content becomes a significant challenge. While existing machine unlearning methods can erase…

计算与语言 · 计算机科学 2026-04-08 Mutsumi Sasaki , Kouta Nakayama , Yusuke Miyao , Yohei Oseki , Masaru Isonuma

Machine unlearning for large language models (LLMs) aims to remove undesired data, knowledge, and behaviors (e.g., for safety, privacy, or copyright) while preserving useful model capabilities. Despite rapid progress over the past two…

机器学习 · 计算机科学 2025-10-10 Chongyu Fan , Changsheng Wang , Yancheng Huang , Soumyadeep Pal , Sijia Liu

Large language models (LLMs) have revolutionized various domains, yet their utility comes with significant challenges related to outdated or problematic knowledge embedded during pretraining. This paper addresses the challenge of modifying…

Large language model (LLM) unlearning has become a critical topic in machine learning, aiming to eliminate the influence of specific training data or knowledge without retraining the model from scratch. A variety of techniques have been…

机器学习 · 计算机科学 2025-06-12 Jie Ren , Yue Xing , Yingqian Cui , Charu C. Aggarwal , Hui Liu

Machine unlearning in Vision-Language Models (VLMs) is typically performed at the image or instance level, making it difficult to precisely remove target knowledge without affecting unrelated semantics. This issue is especially pronounced…

计算机视觉与模式识别 · 计算机科学 2026-05-18 Shen Lin , Jing Lin , Junhao Dong , Piotr Koniusz , Li Xu

Large language models (LLMs) inevitably memorize sensitive, copyrighted, and harmful knowledge from the training corpus; therefore, it is crucial to erase this knowledge from the models. Machine unlearning is a promising solution for…

计算与语言 · 计算机科学 2024-06-18 Zhuoran Jin , Pengfei Cao , Chenhao Wang , Zhitao He , Hongbang Yuan , Jiachun Li , Yubo Chen , Kang Liu , Jun Zhao

In this work, we introduce Erasure of Language Memory (ELM), a principled approach to concept-level unlearning that operates by matching distributions defined by the model's own introspective classification capabilities. Our key insight is…

计算与语言 · 计算机科学 2025-07-23 Rohit Gandikota , Sheridan Feucht , Samuel Marks , David Bau

The significant advancements in large language models (LLMs) give rise to a promising research direction, i.e., leveraging LLMs as recommenders (LLMRec). The efficacy of LLMRec arises from the open-world knowledge and reasoning capabilities…

信息检索 · 计算机科学 2024-07-02 Hangyu Wang , Jianghao Lin , Bo Chen , Yang Yang , Ruiming Tang , Weinan Zhang , Yong Yu

While large language models (LLMs) exhibit remarkable capabilities, they increasingly face demands to unlearn memorized privacy-sensitive, copyrighted, or harmful content. Existing unlearning methods primarily focus on \emph{single-shot}…

计算与语言 · 计算机科学 2026-05-08 Xiaoyu Xu , Minxin Du , Kun Fang , Yaxin Xiao , Zhicong Huang , Cheng Hong , Qingqing Ye , Haibo Hu

Although Large Language Models (LLMs) have demonstrated impressive capabilities across a wide range of tasks, growing concerns have emerged over the misuse of sensitive, copyrighted, or harmful data during training. To address these…

Catastrophic forgetting remains a formidable obstacle to building an omniscient model in large language models (LLMs). Despite the pioneering research on task-level forgetting in LLM fine-tuning, there is scant focus on forgetting during…

计算与语言 · 计算机科学 2024-10-23 Chonghua Liao , Ruobing Xie , Xingwu Sun , Haowen Sun , Zhanhui Kang

LLMs trained on massive datasets may inadvertently acquire sensitive information such as personal details and potentially harmful content. This risk is further heightened in multimodal LLMs as they integrate information from multiple…

计算与语言 · 计算机科学 2025-05-06 Vaidehi Patil , Yi-Lin Sung , Peter Hase , Jie Peng , Tianlong Chen , Mohit Bansal