中文
相关论文

相关论文: OBLIVIATE: Robust and Practical Machine Unlearning…

200 篇论文

Large Language Models (LLMs) inevitably memorize sensitive information during training, posing significant privacy risks. Machine unlearning has emerged as a promising solution to selectively remove such information without full retraining.…

机器学习 · 计算机科学 2026-04-02 Yuze Wang , Yujia Tong , Xuan Liu , Junhao Dong

Large language models (LLMs) may memorize sensitive or copyrighted content, raising significant privacy and legal concerns. While machine unlearning has emerged as a potential remedy, prevailing paradigms rely on user-provided forget sets,…

计算与语言 · 计算机科学 2026-04-16 Wenxuan Li , Zhenfei Zhang , Mi Zhang , Geng Hong , Mi Wen , Xiaoyu You , Min Yang

Large Language Models (LLMs) face significant challenges in maintaining privacy, ethics, and compliance, when sensitive or obsolete data must be selectively removed. Retraining these models from scratch is computationally infeasible,…

计算与语言 · 计算机科学 2025-03-10 Dinesh Srivasthav P , Bala Mallikarjunarao Garlapati

Large language model unlearning has become a critical challenge in ensuring safety and controlled model behavior by removing undesired data-model influences from the pretrained model while preserving general utility. Significant recent…

计算与语言 · 计算机科学 2025-04-17 Soumyadeep Pal , Changsheng Wang , James Diffenderfer , Bhavya Kailkhura , Sijia Liu

Pre-trained Large Language Models (LLMs) have demonstrated remarkable capabilities but also pose risks by learning and generating copyrighted material, leading to significant legal and ethical concerns. In a potential real-world scenario,…

计算与语言 · 计算机科学 2025-02-12 Guangyao Dou

Resistive memory (RM) based neuromorphic systems can emulate synaptic plasticity and thus support continual learning, but they generally lack biologically inspired mechanisms for active forgetting, which are critical for meeting modern data…

Machine unlearning is a process to remove specific data points from a trained model while maintaining the performance on the retain data, addressing privacy or legal requirements. Despite its importance, existing unlearning evaluations tend…

机器学习 · 计算机科学 2026-01-30 Yongwoo Kim , Sungmin Cha , Donghyun Kim

Vision-language models (VLMs) raise growing concerns about privacy, copyright, and bias, motivating machine unlearning to remove sensitive knowledge. However, existing methods primarily fine-tune the language decoder, leading to superficial…

计算机视觉与模式识别 · 计算机科学 2026-05-11 Kaidi Jia , Yujie Lin , Chengyi Yang , Jiayao Ma , Jinsong Su

As Large Language Models (LLMs) increasingly shape online content, removing targeted information from well-trained LLMs (also known as LLM unlearning) has become critical for web governance. A key challenge lies in sample-wise imbalance…

机器学习 · 计算机科学 2026-02-10 Pengyang Shao , Naixin Zhai , Lei Chen , Yonghui Yang , Fengbin Zhu , Xun Yang , Meng Wang

Machine unlearning, the study of efficiently removing the impact of specific training instances on a model, has garnered increased attention in recent years due to regulatory guidelines such as the \emph{Right to be Forgotten}. Achieving…

机器学习 · 计算机科学 2024-06-07 Martin Pawelczyk , Seth Neel , Himabindu Lakkaraju

Machine unlearning offers a promising solution to privacy and safety concerns in large language models (LLMs) by selectively removing targeted knowledge while preserving utility. However, current methods are highly sensitive to downstream…

We study the right to be forgotten (GDPR Art. 17) for large language models and frame unlearning as a reproducible systems problem. Our approach treats training as a deterministic program and logs a minimal per-microbatch record (ordered ID…

机器学习 · 计算机科学 2025-08-19 Abdullah X

Pre-trained Large Language Models (LLMs) have demonstrated remarkable capabilities but also pose risks by learning and generating copyrighted material, leading to significant legal and ethical concerns. In real-world scenarios, model owners…

计算与语言 · 计算机科学 2025-02-12 Guangyao Dou , Zheyuan Liu , Qing Lyu , Kaize Ding , Eric Wong

Language Models (LMs) are prone to ''memorizing'' training data, including substantial sensitive user information. To mitigate privacy risks and safeguard the right to be forgotten, machine unlearning has emerged as a promising approach for…

密码学与安全 · 计算机科学 2025-06-11 Jiacheng Du , Zhibo Wang , Jie Zhang , Xiaoyi Pang , Jiahui Hu , Kui Ren

Robust unlearning is crucial for safely deploying large language models (LLMs) in environments where data privacy, model safety, and regulatory compliance must be ensured. Yet the task is inherently challenging, partly due to difficulties…

计算与语言 · 计算机科学 2025-11-11 Vineeth Dorna , Anmol Mekala , Wenlong Zhao , Andrew McCallum , Zachary C. Lipton , J. Zico Kolter , Pratyush Maini

Large language models (LLMs) have advanced to encompass extensive knowledge across diverse domains. Yet controlling what a large language model should not know is important for ensuring alignment and thus safe use. However, accurately and…

计算与语言 · 计算机科学 2024-11-01 Chris Yuhao Liu , Yaxuan Wang , Jeffrey Flanigan , Yang Liu

This study investigates the machine unlearning techniques within the context of large language models (LLMs), referred to as \textit{LLM unlearning}. LLM unlearning offers a principled approach to removing the influence of undesirable data…

Large Language Models (LLMs) have demonstrated remarkable capabilities in natural language understanding and generation. However, their tendency to memorize training data raises concerns regarding privacy, copyright compliance, and…

机器学习 · 计算机科学 2025-06-23 Arjun Dosajh , Mihika Sanghi

Unlearning seeks to remove specific knowledge from large language models (LLMs), but its effectiveness remains contested. On one side, "forgotten" knowledge can often be recovered through interventions such as light fine-tuning; on the…

计算与语言 · 计算机科学 2025-09-30 Qingjie Zhang , Haoting Qian , Zhicong Huang , Cheng Hong , Minlie Huang , Ke Xu , Chao Zhang , Han Qiu

Large language models (LLMs) risk retaining unauthorized or sensitive information from their training data, which raises privacy concerns. LLM unlearning seeks to mitigate these risks by selectively removing specified data while maintaining…

计算与语言 · 计算机科学 2025-05-29 Hwan Chang , Hwanhee Lee