中文
相关论文

相关论文: Towards Reasoning-Preserving Unlearning in Multimo…

200 篇论文

Large language model unlearning has become a critical challenge in ensuring safety and controlled model behavior by removing undesired data-model influences from the pretrained model while preserving general utility. Significant recent…

计算与语言 · 计算机科学 2025-04-17 Soumyadeep Pal , Changsheng Wang , James Diffenderfer , Bhavya Kailkhura , Sijia Liu

Large language models (LLMs) have achieved remarkable success across natural language processing tasks, yet their widespread deployment raises pressing concerns around privacy, copyright, security, and bias. Machine unlearning has emerged…

计算与语言 · 计算机科学 2026-01-21 Tyler Lizzo , Larry Heck

Generative models such as Large Language Models (LLM) and Multimodal Large Language models (MLLMs) trained on massive web corpora can memorize and disclose individuals' confidential and private data, raising legal and ethical concerns.…

计算与语言 · 计算机科学 2025-02-18 Zheyuan Liu , Guangyao Dou , Mengzhao Jia , Zhaoxuan Tan , Qingkai Zeng , Yongle Yuan , Meng Jiang

This study investigates the machine unlearning techniques within the context of large language models (LLMs), referred to as \textit{LLM unlearning}. LLM unlearning offers a principled approach to removing the influence of undesirable data…

In recent years, Large Language Models (LLMs) have achieved remarkable advancements, drawing significant attention from the research community. Their capabilities are largely attributed to large-scale architectures, which require extensive…

As large language models (LLMs) are increasingly adopted in safety-critical and regulated sectors, the retention of sensitive or prohibited knowledge introduces escalating risks, ranging from privacy leakage to regulatory non-compliance to…

机器学习 · 计算机科学 2025-12-19 Taozhao Chen , Linghan Huang , Kim-Kwang Raymond Choo , Huaming Chen

Unlearning in large language models (LLMs) involves precisely removing specific information from a pre-trained model. This is crucial to ensure safety of LLMs by deleting private data or harmful knowledge acquired during pre-training.…

机器学习 · 计算机科学 2025-09-04 Naman Deep Singh , Maximilian Müller , Francesco Croce , Matthias Hein

Multimodal large language models (MLLMs) have demonstrated remarkable capabilities across vision-language tasks, yet their large-scale deployment raises pressing concerns about memorized private data, outdated knowledge, and harmful…

机器学习 · 计算机科学 2026-02-03 Chenlu Ding , Jiancan Wu , Leheng Sheng , Fan Zhang , Yancheng Yuan , Xiang Wang , Xiangnan He

Knowledge erasure in large language models (LLMs) is important for ensuring compliance with data and AI regulations, safeguarding user privacy, mitigating bias, and misinformation. Existing unlearning methods aim to make the process of…

密码学与安全 · 计算机科学 2025-06-24 Yash Sinha , Manit Baser , Murari Mandal , Dinil Mon Divakaran , Mohan Kankanhalli

The deployment of large language models (LLMs) like ChatGPT and Gemini has shown their powerful natural language generation capabilities. However, these models can inadvertently learn and retain sensitive information and harmful content…

密码学与安全 · 计算机科学 2025-10-14 Shang Wang , Tianqing Zhu , Dayong Ye , Wanlei Zhou

Language models (LMs) are trained on vast amounts of text data, which may include private and copyrighted content. Data owners may request the removal of their data from a trained model due to privacy or copyright concerns. However, exactly…

Robust unlearning is crucial for safely deploying large language models (LLMs) in environments where data privacy, model safety, and regulatory compliance must be ensured. Yet the task is inherently challenging, partly due to difficulties…

计算与语言 · 计算机科学 2025-11-11 Vineeth Dorna , Anmol Mekala , Wenlong Zhao , Andrew McCallum , Zachary C. Lipton , J. Zico Kolter , Pratyush Maini

Generative models such as Large Language Models (LLMs) and Multimodal Large Language Models (MLLMs) trained on massive datasets can lead them to memorize and inadvertently reveal sensitive information, raising ethical and privacy concerns.…

计算与语言 · 计算机科学 2025-07-24 Zheyuan Liu , Guangyao Dou , Xiangchi Yuan , Chunhui Zhang , Zhaoxuan Tan , Meng Jiang

Unlearning seeks to remove specific knowledge from large language models (LLMs), but its effectiveness remains contested. On one side, "forgotten" knowledge can often be recovered through interventions such as light fine-tuning; on the…

计算与语言 · 计算机科学 2025-09-30 Qingjie Zhang , Haoting Qian , Zhicong Huang , Cheng Hong , Minlie Huang , Ke Xu , Chao Zhang , Han Qiu

Machine unlearning offers a promising solution to privacy and safety concerns in large language models (LLMs) by selectively removing targeted knowledge while preserving utility. However, current methods are highly sensitive to downstream…

Given the prevalence of large language models (LLMs) and the prohibitive cost of training these models from scratch, dynamically forgetting specific knowledge e.g., private or proprietary, without retraining the model has become an…

计算与语言 · 计算机科学 2024-08-09 Tyler Lizzo , Larry Heck

Multimodal Large Language Models (MLLMs) may memorize sensitive cross-modal information during pretraining. However, existing MLLM unlearning benchmarks rely on synthetic knowledge injection or complete subject-level deletion, which fail to…

计算机视觉与模式识别 · 计算机科学 2026-05-12 Jiahui Guang , Zexun Zhan , Zhenlin Xu , Cuiyun Gao , Haiyan Wang , Jing Li , Zhaoquan Gu , Yanchun Zhang

Large Language Models (LLMs) often memorize sensitive or harmful information, necessitating effective machine unlearning techniques. While existing parameter-efficient unlearning methods have shown promise, they still struggle with the…

计算与语言 · 计算机科学 2026-04-21 Zeguan Xiao , Lang Mo , Yun Chen , Lei Yang , Jiehui Zhao , Lili Yang , Guanhua Chen

With the implementation of personal data privacy regulations, the field of machine learning (ML) faces the challenge of the "right to be forgotten". Machine unlearning has emerged to address this issue, aiming to delete data and reduce its…

机器学习 · 计算机科学 2024-04-02 Yi Xu

Machine unlearning, the process of efficiently removing specific information from machine learning models, is a growing area of interest for responsible AI. However, few studies have explored the effectiveness of unlearning methods on…

计算与语言 · 计算机科学 2025-12-19 Alkis Koudounas , Claudio Savelli , Flavio Giobergia , Elena Baralis