中文
相关论文

相关论文: Intrinsic Test of Unlearning Using Parametric Know…

200 篇论文

Due to the widespread use of LLMs and the rising critical ethical and safety concerns, LLM unlearning methods have been developed to remove harmful knowledge and undesirable capabilities. In this context, evaluations are mostly based on…

机器学习 · 计算机科学 2025-02-21 Yicheng Lang , Kehan Guo , Yue Huang , Yujun Zhou , Haomin Zhuang , Tianyu Yang , Yao Su , Xiangliang Zhang

Identifying the training datasets that influence a language model's outputs is essential for minimizing the generation of harmful content and enhancing its performance. Ideally, we can measure the influence of each dataset by removing it…

计算与语言 · 计算机科学 2024-06-14 Masaru Isonuma , Ivan Titov

Large language model (LLM)-based agents have recently gained considerable attention due to the powerful reasoning capabilities of LLMs. Existing research predominantly focuses on enhancing the task performance of these agents in diverse…

多智能体系统 · 计算机科学 2026-04-02 Dayong Ye , Tainqing Zhu , Congcong Zhu , Feng He , Qi He , Shang Wang , Bo Liu , Wanlei Zhou

Large language models often retain unintended content, prompting growing interest in knowledge unlearning. Recent approaches emphasize localized unlearning, restricting parameter updates to specific regions in an effort to remove target…

计算与语言 · 计算机科学 2026-02-12 Hwiyeong Lee , Uiji Hwang , Hyelim Lim , Taeuk Kim

The impressive capability of modern text-to-image models to generate realistic visuals has come with a serious drawback: they can be misused to create harmful, deceptive or unlawful content. This has accelerated the push for machine…

机器学习 · 计算机科学 2025-11-26 Agnieszka Polowczyk , Alicja Polowczyk , Joanna Waczyńska , Piotr Borycki , Przemysław Spurek

Large Language Models (LLMs) have shown strong potential in accelerating digital hardware design through automated code generation. Yet, ensuring their reliability remains a critical challenge, as existing LLMs trained on massive…

机器学习 · 计算机科学 2025-12-08 Yiwen Liang , Qiufeng Li , Shikai Wang , Weidong Cao

Large Language Models (LLMs) are foundational to AI advancements, facilitating applications like predictive text generation. Nonetheless, they pose risks by potentially memorizing and disseminating sensitive, biased, or copyrighted…

人工智能 · 计算机科学 2024-03-26 Youyang Qu , Ming Ding , Nan Sun , Kanchana Thilakarathna , Tianqing Zhu , Dusit Niyato

As large language models (LLMs) are applied across diverse domains, the ability to selectively unlearn specific information is becoming increasingly essential. For instance, LLMs are expected to selectively provide confidential information…

计算与语言 · 计算机科学 2025-06-04 Shota Takashiro , Takeshi Kojima , Andrew Gambardella , Qi Cao , Yusuke Iwasawa , Yutaka Matsuo

Machine unlearning is the process of efficiently removing specific information from a trained machine learning model without retraining from scratch. Existing unlearning methods, which often provide provable guarantees, typically involve…

Large language models may encode sensitive information or outdated knowledge that needs to be removed, to ensure responsible and compliant model responses. Unlearning has emerged as an efficient alternative to full retraining, aiming to…

计算与语言 · 计算机科学 2026-05-28 Yuefeng Peng , Parnian Afshar , Megan Ganji , Thomas Butler , Amir Houmansadr , Mingxian Wang , Dezhi Hong

Large Reasoning Models (LRMs) generate structured chains of thought (CoTs) before producing final answers, making them especially vulnerable to knowledge leakage through intermediate reasoning steps. Yet, the memorization of sensitive…

人工智能 · 计算机科学 2026-04-07 Tuan Le , Wei Qian , Mengdi Huai

Large Language Models (LLMs) are known to be vulnerable to jailbreak attacks. An important observation is that, while different types of jailbreak attacks can generate significantly different queries, they mostly result in similar responses…

密码学与安全 · 计算机科学 2025-05-21 Zhexin Zhang , Junxiao Yang , Yida Lu , Pei Ke , Shiyao Cui , Chujie Zheng , Hongning Wang , Minlie Huang

Large language model (LLM) unlearning aims to remove specific data influences from pre-trained model without costly retraining, addressing privacy, copyright, and safety concerns. However, recent studies reveal a critical vulnerability:…

计算与语言 · 计算机科学 2026-05-13 Zeguan Xiao , Xuanzhe Xu , Yun Chen , Yong Wang , Jian Yang , Yanqing Hu , Guanhua Chen

Large Language Model (LLM) unlearning aims to erase or suppress undesirable knowledge within the model, offering promise for controlling harmful or private information to prevent misuse. However, recent studies highlight its limited…

计算与语言 · 计算机科学 2025-06-10 Xiaotian Ye , Mengqi Zhang , Shu Wu

LLM have achieved success in many fields but still troubled by problematic content in the training corpora. LLM unlearning aims at reducing their influence and avoid undesirable behaviours. However, existing unlearning methods remain…

计算与语言 · 计算机科学 2024-08-21 Hongbang Yuan , Zhuoran Jin , Pengfei Cao , Yubo Chen , Kang Liu , Jun Zhao

Machine unlearning for LLMs aims to remove sensitive or copyrighted data from trained models. However, the true efficacy of current unlearning methods remains uncertain. Standard evaluation metrics rely on benign queries that often mistake…

机器学习 · 计算机科学 2026-02-09 Patryk Rybak , Paweł Batorski , Paul Swoboda , Przemysław Spurek

Foundation models have transformed multimedia analysis by enabling robust and transferable representations across diverse modalities and tasks. However, their static deployment conflicts with growing societal and regulatory demands --…

Removing information from a machine learning model is a non-trivial task that requires to partially revert the training process. This task is unavoidable when sensitive data, such as credit card numbers or passwords, accidentally enter the…

机器学习 · 计算机科学 2023-08-08 Alexander Warnecke , Lukas Pirch , Christian Wressnegger , Konrad Rieck

Machine unlearning removes certain training data points and their influence from AI models (e.g., when a data owner revokes their consent to allow models to learn from the data). In this position paper, we propose to lift data-tracing…

计算机视觉与模式识别 · 计算机科学 2026-05-27 Yuwen Tan , Boqing Gong

Large language model unlearning has become a critical challenge in ensuring safety and controlled model behavior by removing undesired data-model influences from the pretrained model while preserving general utility. Significant recent…

计算与语言 · 计算机科学 2025-04-17 Soumyadeep Pal , Changsheng Wang , James Diffenderfer , Bhavya Kailkhura , Sijia Liu