中文
相关论文

相关论文: FROC: A Unified Framework with Risk-Optimized Cont…

200 篇论文

Unlearning in large language models is becoming increasingly important due to regulatory compliance, copyright protection, and privacy concerns. However, a key challenge in LLM unlearning is unintended forgetting, where the removal of…

机器学习 · 计算机科学 2025-10-23 Peizhi Niu , Evelyn Ma , Huiting Zhou , Duo Zhou , Huan Zhang , S. Rasoul Etesami , Olgica Milenkovic

Machine unlearning (MU) aims to eliminate information that has been learned from specific training data, namely forgetting data, from a pre-trained model. Currently, the mainstream of existing MU methods involves modifying the forgetting…

机器学习 · 计算机科学 2025-10-13 Zhengbao He , Tao Li , Xinwen Cheng , Zhehao Huang , Xiaolin Huang

Machine unlearning has emerged as a critical capability for addressing privacy, safety, and regulatory concerns in large language models (LLMs). Existing methods operate at the sequence level, applying uniform updates across all tokens…

计算与语言 · 计算机科学 2026-05-07 Jiawei Wu , Doudou Zhou

Multimodal large language models (MLLMs) may memorize sensitive cross-modal information during pretraining, making machine unlearning (MU) crucial. Existing methods typically evaluate unlearning effectiveness based on output deviations,…

计算与语言 · 计算机科学 2026-05-18 Jiahui Guang , Yingjie Zhu , Cuiyun Gao , Haiyan Wang , Jing Li , Di Shao , Zhaoquan Gu

Accurate and unambiguous guidelines are critical for large language model (LLM) based graders, yet manually crafting these prompts is often sub-optimal as LLMs can misinterpret expert guidelines or lack necessary domain specificity.…

人工智能 · 计算机科学 2026-03-03 Yucheng Chu , Hang Li , Kaiqi Yang , Yasemin Copur-Gencturk , Joseph Krajcik , Namsoo Shin , Jiliang Tang

Large Reasoning Models (LRMs) embed private or copyrighted information not only in their final answers but also throughout multi-step chain-of-thought (CoT) traces, making reliable unlearning far more demanding than in standard LLMs. We…

计算与语言 · 计算机科学 2025-05-28 Sangyeon Yoon , Wonje Jeung , Albert No

Here, we show that current LLM unlearning methods inherently reduce models' robustness, causing them to misbehave even when a single non-adversarial forget-token is present in the retain-query. Toward understanding underlying causes, we…

计算与语言 · 计算机科学 2026-04-21 Dang Huu-Tien , Hoang Thanh-Tung , Anh Bui , Minh-Phuong Nguyen , Le-Minh Nguyen , Naoya Inoue

Large Language and Vision-Language Models (LLMs/VLMs) are increasingly used in safety-critical applications, yet their opaque decision-making complicates risk assessment and reliability. Uncertainty quantification (UQ) helps assess…

Recent advances in large reasoning models (LRMs) have enabled strong chain-of-thought (CoT) generation through test-time computation. While these multi-step reasoning capabilities represent a major milestone in language model performance,…

人工智能 · 计算机科学 2025-10-14 Changsheng Wang , Chongyu Fan , Yihua Zhang , Jinghan Jia , Dennis Wei , Parikshit Ram , Nathalie Baracaldo , Sijia Liu

With recent legislation on the right to be forgotten, machine unlearning has emerged as a crucial research area. It facilitates the removal of a user's data from federated trained machine learning models without the necessity for retraining…

机器学习 · 计算机科学 2024-04-24 Houzhe Wang , Xiaojie Zhu , Chi Chen , Paulo Esteves-Veríssimo

As large language models (LLMs) are increasingly deployed across various applications, privacy and copyright concerns have heightened the need for more effective LLM unlearning techniques. Many existing unlearning methods aim to suppress…

计算与语言 · 计算机科学 2025-09-22 Tomoya Yamashita , Akira Ito , Yuuki Yamanaka , Masanori Yamada , Takayuki Miura , Toshiki Shibahara

The security of biomedical Multimodal Large Language Models (MLLMs) has attracted increasing attention. However, training samples easily contain private information and incorrect knowledge that are difficult to detect, potentially leading…

计算机视觉与模式识别 · 计算机科学 2025-08-07 Dunyuan Xu , Xikai Yang , Yaoqian Li , Jinpeng Li , Pheng-Ann Heng

The undesired memorization of sensitive information by Large Language Models (LLMs) has emphasized the need for safety mechanisms that can regulate model behavior. This has led to the development of machine unlearning techniques that enable…

机器学习 · 计算机科学 2025-10-10 Anu Agarwal , Mihir Pamnani , Dilek Hakkani-Tur

Machine Unlearning (MU) aims to selectively erase the influence of specific data points from pretrained models. However, most existing MU methods rely on the retain set to preserve model utility, which is often impractical due to privacy…

机器学习 · 计算机科学 2026-04-15 Xindi Fan , Jing Wu , Mingyi Zhou , Pengwei Liang , Mehrtash Harandi , Dinh Phung

Due to increasing privacy regulations and regulatory compliance, Machine Unlearning (MU) has become essential. The goal of unlearning is to remove information related to a specific class from a model. Traditional approaches achieve exact…

机器学习 · 计算机科学 2024-11-20 Atharv Mittal

Federated Unlearning (FUL) aims to remove specific participants' data contributions from a trained Federated Learning model, thereby ensuring data privacy and compliance with regulatory requirements. Despite its potential, progress in FUL…

Recent advancements in LLMs unlearning have shown remarkable success in removing unwanted data-model influences while preserving the model's utility for legitimate knowledge. Despite these strides, sparse Mixture-of-Experts (MoE) LLMs--a…

机器学习 · 计算机科学 2025-07-01 Haomin Zhuang , Yihua Zhang , Kehan Guo , Jinghan Jia , Gaowen Liu , Sijia Liu , Xiangliang Zhang

Catastrophic forgetting remains a central challenge in continual learning (CL) with pre-trained models. While existing approaches typically freeze the backbone and fine-tune a small number of parameters to mitigate forgetting, they still…

机器学习 · 计算机科学 2025-09-03 Jiao Chen , Jiayi He , Fangfang Chen , Zuohong Lv , Jianhua Tang

While numerous machine unlearning (MU) methods have recently been developed with promising results in erasing the influence of forgotten data, classes, or concepts, they are also highly vulnerable-for example, simple fine-tuning can…

机器学习 · 计算机科学 2026-04-10 Yichen Gao , Altay Unal , Akshay Rangamani , Zhihui Zhu

Federated Unlearning (FU) aims to efficiently remove the influence of specific client data from a federated model while preserving utility for the remaining clients. However, three key challenges remain: (1) existing unlearning objectives…

机器学习 · 计算机科学 2026-02-03 Zeyan Wang , Zhengmao Liu , Yongxin Cai , Chi Li , Xiaoying Tang , Jingchao Chen , Zibin Pan , Jing Qiu