中文
相关论文

相关论文: Improving LLM Unlearning Robustness via Random Per…

200 篇论文

LLMs are trained to refuse harmful instructions, but do they truly understand harmfulness beyond just refusing? Prior work has shown that LLMs' refusal behaviors can be mediated by a one-dimensional subspace, i.e., a refusal direction. In…

计算与语言 · 计算机科学 2025-12-16 Jiachen Zhao , Jing Huang , Zhengxuan Wu , David Bau , Weiyan Shi

With the increasing adoption of large language models (LLMs), ensuring the safety of LLM systems has become a pressing concern. External LLM-based guardrail models have emerged as a popular solution to screen unsafe inputs and outputs, but…

Although large language models (LLMs) have achieved significant success, their vulnerability to adversarial perturbations, including recent jailbreak attacks, has raised considerable concerns. However, the increasing size of these models…

计算与语言 · 计算机科学 2024-04-19 Jiabao Ji , Bairu Hou , Zhen Zhang , Guanhua Zhang , Wenqi Fan , Qing Li , Yang Zhang , Gaowen Liu , Sijia Liu , Shiyu Chang

Large language models (LLMs) have achieved remarkable success across natural language processing tasks, yet their widespread deployment raises pressing concerns around privacy, copyright, security, and bias. Machine unlearning has emerged…

计算与语言 · 计算机科学 2026-01-21 Tyler Lizzo , Larry Heck

Existing invasive (backdoor) fingerprints suffer from high-perplexity triggers that are easily filtered, fixed response patterns exposed by heuristic detectors, and spurious activations on benign inputs. We introduce \textsc{ForgetMark}, a…

密码学与安全 · 计算机科学 2026-01-21 Zhenhua Xu , Haobo Zhang , Zhebo Wang , Qichen Liu , Haitao Xu , Wenpeng Xing , Meng Han

Large Language Models (LLMs) have demonstrated strong capabilities in memorizing vast amounts of knowledge across diverse domains. However, the ability to selectively forget specific knowledge is critical for ensuring the safety and…

计算与语言 · 计算机科学 2025-05-20 Zhijie Deng , Chris Yuhao Liu , Zirui Pang , Xinlei He , Lei Feng , Qi Xuan , Zhaowei Zhu , Jiaheng Wei

With the rise of advanced reasoning capabilities, large language models (LLMs) are receiving increasing attention. However, although reasoning improves LLMs' performance on downstream tasks, it also introduces new security risks, as…

密码学与安全 · 计算机科学 2025-10-10 Man Hu , Xinyi Wu , Zuofeng Suo , Jinbo Feng , Linghui Meng , Yanhao Jia , Anh Tuan Luu , Shuai Zhao

Neural Networks (NNs) are vulnerable to adversarial examples. Such inputs differ only slightly from their benign counterparts yet provoke misclassifications of the attacked NNs. The required perturbations to craft the examples are often…

密码学与安全 · 计算机科学 2020-09-30 Philip Sperl , Konstantin Böttinger

Machine unlearning (MU) is becoming a promising paradigm to achieve the "right to be forgotten", where the training trace of any chosen data points could be eliminated, while maintaining the model utility on general testing samples after…

机器学习 · 计算机科学 2024-10-22 Junjie Chen , Qian Chen , Jian Lou , Xiaoyu Zhang , Kai Wu , Zilong Wang

While deep neural networks have been achieving state-of-the-art performance across a wide variety of applications, their vulnerability to adversarial attacks limits their widespread deployment for safety-critical applications. Alongside…

计算机视觉与模式识别 · 计算机科学 2020-03-04 Ahmadreza Jeddi , Mohammad Javad Shafiee , Michelle Karg , Christian Scharfenberger , Alexander Wong

Deep neural networks have achieved remarkable success across various applications; however, their vulnerability to backdoor attacks poses severe security risks -- especially in situations where only a limited set of clean samples is…

密码学与安全 · 计算机科学 2025-06-25 Nay Myat Min , Long H. Pham , Jun Sun

Machine Learning (ML) models have been shown to potentially leak sensitive information, thus raising privacy concerns in ML-driven applications. This inspired recent research on removing the influence of specific data samples from a trained…

机器学习 · 计算机科学 2023-10-30 Youyang Qu , Xin Yuan , Ming Ding , Wei Ni , Thierry Rakotoarivelo , David Smith

Unlearning in large language models (LLMs) involves precisely removing specific information from a pre-trained model. This is crucial to ensure safety of LLMs by deleting private data or harmful knowledge acquired during pre-training.…

机器学习 · 计算机科学 2025-09-04 Naman Deep Singh , Maximilian Müller , Francesco Croce , Matthias Hein

Adversarial learning has emerged as one of the successful techniques to circumvent the susceptibility of existing methods against adversarial perturbations. However, the majority of existing defense methods are tailored to defend against a…

机器学习 · 计算机科学 2021-06-28 Divyam Madaan , Jinwoo Shin , Sung Ju Hwang

Machine unlearning (MU) seeks to remove knowledge of specific data samples from trained models without the necessity for complete retraining, a task made challenging by the dual objectives of effective erasure of data and maintaining the…

机器学习 · 计算机科学 2024-07-16 Mark He Huang , Lin Geng Foo , Jun Liu

Backdoor attacks pose a serious threat to the security of large language models (LLMs), causing them to exhibit anomalous behavior under specific trigger conditions. The design of backdoor triggers has evolved from fixed triggers to dynamic…

密码学与安全 · 计算机科学 2026-04-15 Haotian Jin , Yang Li , Haihui Fan , Lin Shen , Xiangfang Li , Bo Li

Recent studies have widely investigated backdoor attacks on Large Language Models (LLMs) by inserting harmful question-answer (QA) pairs into their training data. However, we revisit existing attacks and identify two critical limitations:…

计算与语言 · 计算机科学 2025-10-07 Jiawei Kong , Hao Fang , Xiaochen Yang , Kuofeng Gao , Bin Chen , Shu-Tao Xia , Ke Xu , Han Qiu

We address the problem of machine unlearning, where the goal is to remove the influence of specific training data from a model upon request, motivated by privacy concerns and regulatory requirements such as the "right to be forgotten."…

机器学习 · 计算机科学 2025-06-12 Anastasia Koloskova , Youssef Allouah , Animesh Jha , Rachid Guerraoui , Sanmi Koyejo

Machine unlearning for LLMs aims to remove sensitive or copyrighted data from trained models. However, the true efficacy of current unlearning methods remains uncertain. Standard evaluation metrics rely on benign queries that often mistake…

机器学习 · 计算机科学 2026-02-09 Patryk Rybak , Paweł Batorski , Paul Swoboda , Przemysław Spurek

Robustness to noise is of utmost importance in reinforcement learning systems, particularly in military contexts where high stakes and uncertain environments prevail. Noise and uncertainty are inherent features of military operations,…

机器学习 · 计算机科学 2023-11-16 Lorenzo Nodari , Federico Cerutti