中文
相关论文

相关论文: OFFSIDE: Benchmarking Unlearning Misinformation in…

200 篇论文

The rapid advancement of multimodal large language models (MLLMs) has significantly enhanced performance across benchmarks. However, data contamination-unintentional memorization of benchmark data during model training-poses critical…

计算机视觉与模式识别 · 计算机科学 2025-09-23 Dingjie Song , Sicheng Lai , Mingxuan Wang , Shunian Chen , Lichao Sun , Benyou Wang

Large Language Models (LLMs) are foundational to AI advancements, facilitating applications like predictive text generation. Nonetheless, they pose risks by potentially memorizing and disseminating sensitive, biased, or copyrighted…

人工智能 · 计算机科学 2024-03-26 Youyang Qu , Ming Ding , Nan Sun , Kanchana Thilakarathna , Tianqing Zhu , Dusit Niyato

Despite the strong capabilities of Large Language Models (LLMs) to acquire knowledge from their training corpora, the memorization of sensitive information in the corpora such as copyrighted, biased, and private content has led to ethical…

计算与语言 · 计算机科学 2025-05-29 James Y. Huang , Wenxuan Zhou , Fei Wang , Fred Morstatter , Sheng Zhang , Hoifung Poon , Muhao Chen

Misinformation is a prevalent societal issue due to its potential high risks. Out-of-context (OOC) misinformation, where authentic images are repurposed with false text, is one of the easiest and most effective ways to mislead audiences.…

多媒体 · 计算机科学 2024-03-12 Peng Qi , Zehong Yan , Wynne Hsu , Mong Li Lee

Machine unlearning aims to erase requested data from trained models without full retraining. For Reasoning Multimodal Large Language Models (RMLLMs), this is uniquely challenging: intermediate chain-of-thought steps can still leak sensitive…

计算与语言 · 计算机科学 2025-12-23 Hongji Li , Junchi yao , Manjiang Yu , Priyanka Singh , Xue Li , Di Wang , Lijie Hu

Machine unlearning aims to remove sensitive or undesired data from large language models. However, recent studies suggest that unlearning is often shallow, claiming that removed knowledge can easily be recovered. In this work, we critically…

Large language models (LLMs) inevitably memorize sensitive, copyrighted, and harmful knowledge from the training corpus; therefore, it is crucial to erase this knowledge from the models. Machine unlearning is a promising solution for…

计算与语言 · 计算机科学 2024-06-18 Zhuoran Jin , Pengfei Cao , Chenhao Wang , Zhitao He , Hongbang Yuan , Jiachun Li , Yubo Chen , Kang Liu , Jun Zhao

Given the prevalence of large language models (LLMs) and the prohibitive cost of training these models from scratch, dynamically forgetting specific knowledge e.g., private or proprietary, without retraining the model has become an…

计算与语言 · 计算机科学 2024-08-09 Tyler Lizzo , Larry Heck

This paper investigates the propagation of harmful information in multilingual large language models (LLMs) and evaluates the efficacy of various unlearning methods. We demonstrate that fake information, regardless of the language it is in,…

计算与语言 · 计算机科学 2025-09-04 Taiming Lu , Philipp Koehn

Large language model unlearning has become a critical challenge in ensuring safety and controlled model behavior by removing undesired data-model influences from the pretrained model while preserving general utility. Significant recent…

计算与语言 · 计算机科学 2025-04-17 Soumyadeep Pal , Changsheng Wang , James Diffenderfer , Bhavya Kailkhura , Sijia Liu

Unlearning in large language models (LLMs) is critical for regulatory compliance and for building ethical generative AI systems that avoid producing private, toxic, illegal, or copyrighted content. Despite rapid progress, in this work, we…

机器学习 · 计算机科学 2026-05-29 Hadi Reisizadeh , Jiajun Ruan , Yiwei Chen , Soumyadeep Pal , Sijia Liu , Mingyi Hong

Recent progress in Machine Unlearning (MU) has introduced solutions for the selective removal of private or sensitive information encoded within deep neural networks. Nonetheless, MU for Multimodal Large Language Models (MLLMs) remains in…

计算与语言 · 计算机科学 2025-05-28 Jiahao Huo , Yibo Yan , Xu Zheng , Yuanhuiyi Lyu , Xin Zou , Zhihua Wei , Xuming Hu

Driven by privacy protection laws and regulations, unlearning in Large Language Models (LLMs) is gaining increasing attention. However, current research often neglects the interpretability of the unlearning process, particularly concerning…

机器学习 · 计算机科学 2025-04-10 Xiaohua Feng , Yuyuan Li , Chengye Wang , Junlin Liu , Li Zhang , Chaochao Chen

The trustworthy machine learning (ML) community is increasingly recognizing the crucial need for models capable of selectively 'unlearning' data points after training. This leads to the problem of machine unlearning (MU), aiming to…

机器学习 · 计算机科学 2024-07-10 Chongyu Fan , Jiancheng Liu , Alfred Hero , Sijia Liu

Unlearning in Large Language Models (LLMs) aims to enhance safety, mitigate biases, and comply with legal mandates, such as the right to be forgotten. However, existing unlearning methods are brittle: minor query modifications, such as…

人工智能 · 计算机科学 2026-03-13 Raj Sanjay Shah , Jing Huang , Keerthiram Murugesan , Nathalie Baracaldo , Diyi Yang

Multimodal Large Language Models (MLLMs) trained on massive data may memorize sensitive personal information and photos, posing serious privacy risks. To mitigate this, MLLM unlearning methods are proposed, which fine-tune MLLMs to reduce…

机器学习 · 计算机科学 2025-09-23 Xianren Zhang , Hui Liu , Delvin Ce Zhang , Xianfeng Tang , Qi He , Dongwon Lee , Suhang Wang

We explore machine unlearning (MU) in the domain of large language models (LLMs), referred to as LLM unlearning. This initiative aims to eliminate undesirable data influence (e.g., sensitive or illegal information) and the associated model…

Training machine learning models requires the storage of large datasets, which often contain sensitive or private data. Storing data is associated with a number of potential risks which increase over time, such as database breaches and…

机器学习 · 计算机科学 2026-04-14 Aviraj Newatia , Michael Cooper , Viet Nguyen , Rahul G. Krishnan

While Large Vision-Language Models (LVLMs) offer powerful capabilities, they pose privacy risks by unintentionally memorizing sensitive personal information. Current unlearning benchmarks attempt to mitigate this using fictitious identities…

计算机视觉与模式识别 · 计算机科学 2026-05-06 JuneHyoung Kwon , MiHyeon Kim , Eunju Lee , JungMin Yun , Byeonggeuk Lim , YoungBin Kim

Since Multimodal Large Language Models (MLLMs) are increasingly being integrated into everyday tools and intelligent agents, growing concerns have arisen regarding their possible output of unsafe contents, ranging from toxic language and…

机器学习 · 计算机科学 2026-04-08 Yuping Yan , Yuhan Xie , Yuanshuai Li , Yingchao Yu , Lingjuan Lyu , Yaochu Jin