English
Related papers

Related papers: Towards Robust Knowledge Unlearning: An Adversaria…

200 papers

In this work, we demonstrate that certain machine unlearning methods may fail under straightforward prompt attacks. We systematically evaluate eight unlearning techniques across three model families using output-based, logit-based, and…

Cryptography and Security · Computer Science 2025-08-15 Yeonwoo Jang , Shariqah Hossain , Ashwin Sreevatsa , Diogo Cruz

The widespread deployment of Large Language Models (LLMs) trained on massive, uncurated corpora has raised growing concerns about the inclusion of sensitive, copyrighted, or illegal content. This has led to increasing interest in LLM…

Computation and Language · Computer Science 2025-06-10 Chenlong Zhang , Zhuoran Jin , Hongbang Yuan , Jiaheng Wei , Tong Zhou , Kang Liu , Jun Zhao , Yubo Chen

Unlearning in large language models (LLMs) aims to remove harmful training data while preserving overall utility. However, we find that existing methods often hallucinate, generate abnormal token sequences, or behave inconsistently, raising…

Machine Learning · Computer Science 2026-05-12 Renjie Gu , Jiazhen Du , Yihua Zhang , Sijia Liu

Large Language Models (LLMs) are known to be vulnerable to jailbreak attacks. An important observation is that, while different types of jailbreak attacks can generate significantly different queries, they mostly result in similar responses…

Cryptography and Security · Computer Science 2025-05-21 Zhexin Zhang , Junxiao Yang , Yida Lu , Pei Ke , Shiyao Cui , Chujie Zheng , Hongning Wang , Minlie Huang

The ability to selectively remove knowledge from LLMs is highly desirable. However, existing methods often struggle with balancing unlearning efficacy and retain model utility, and lack controllability at inference time to emulate base…

Machine Learning · Computer Science 2025-10-09 William F. Shen , Xinchi Qiu , Meghdad Kurmanji , Alex Iacob , Lorenzo Sani , Yihong Chen , Nicola Cancedda , Nicholas D. Lane

Large language models (LLMs) have achieved remarkable success across natural language processing tasks, yet their widespread deployment raises pressing concerns around privacy, copyright, security, and bias. Machine unlearning has emerged…

Computation and Language · Computer Science 2026-01-21 Tyler Lizzo , Larry Heck

Generative models such as Large Language Models (LLMs) and Multimodal Large Language Models (MLLMs) trained on massive datasets can lead them to memorize and inadvertently reveal sensitive information, raising ethical and privacy concerns.…

Computation and Language · Computer Science 2025-07-24 Zheyuan Liu , Guangyao Dou , Xiangchi Yuan , Chunhui Zhang , Zhaoxuan Tan , Meng Jiang

Large Language Models (LLMs) deployed in real-world settings increasingly face the need to unlearn sensitive, outdated, or proprietary information. Existing unlearning methods typically formulate forgetting and retention as a regularized…

Computation and Language · Computer Science 2025-10-28 Taha Entesari , Arman Hatami , Rinat Khaziev , Anil Ramakrishna , Mahyar Fazlyab

Deep neural network models are used today in various applications of artificial intelligence, the strengthening of which, in the face of adversarial attacks is of particular importance. An appropriate solution to adversarial attacks is…

Computer Vision and Pattern Recognition · Computer Science 2022-02-16 Mohammad Khalooei , Mohammad Mehdi Homayounpour , Maryam Amirmazlaghani

Large Language Models (LLMs) demonstrate remarkable capabilities, but their training on massive corpora poses significant risks from memorized sensitive information. To mitigate these issues and align with legal standards, unlearning has…

Computation and Language · Computer Science 2025-11-18 Ruichen Qiu , Jiajun Tan , Jiayue Pu , Honglin Wang , Xiao-Shan Gao , Fei Sun

Large language models (LLMs) possess strong semantic understanding, driving significant progress in data mining applications. This is further enhanced by large reasoning models (LRMs), which provide explicit multi-step reasoning traces. On…

Machine Learning · Computer Science 2026-04-07 Aobo Chen , Chenxu Zhao , Chenglin Miao , Mengdi Huai

The pervasive deployment of large language models (LLMs) in conversational AI systems has revolutionized information access, yet their propensity for generating factually unsupported or hallucinated responses remains a critical impediment…

Computation and Language · Computer Science 2025-06-03 Steven Robinson , Antonio Carlos Rivera

Large Language Models (LLMs) have demonstrated strong capabilities in memorizing vast amounts of knowledge across diverse domains. However, the ability to selectively forget specific knowledge is critical for ensuring the safety and…

Computation and Language · Computer Science 2025-05-20 Zhijie Deng , Chris Yuhao Liu , Zirui Pang , Xinlei He , Lei Feng , Qi Xuan , Zhaowei Zhu , Jiaheng Wei

Large language models (LLMs) have recently revolutionized language processing tasks but have also brought ethical and legal issues. LLMs have a tendency to memorize potentially private or copyrighted information present in the training…

Machine Learning · Computer Science 2025-07-21 Tamim Al Mahmud , Najeeb Jebreel , Josep Domingo-Ferrer , David Sanchez

Large Language Models (LLMs) inevitably memorize sensitive information during training, posing significant privacy risks. Machine unlearning has emerged as a promising solution to selectively remove such information without full retraining.…

Machine Learning · Computer Science 2026-04-02 Yuze Wang , Yujia Tong , Xuan Liu , Junhao Dong

The impressive capability of modern text-to-image models to generate realistic visuals has come with a serious drawback: they can be misused to create harmful, deceptive or unlawful content. This has accelerated the push for machine…

Machine Learning · Computer Science 2025-11-26 Agnieszka Polowczyk , Alicja Polowczyk , Joanna Waczyńska , Piotr Borycki , Przemysław Spurek

The imperative to eliminate undesirable data memorization underscores the significance of machine unlearning for large language models (LLMs). Recent research has introduced a series of promising unlearning methods, notably boosting the…

Machine Learning · Computer Science 2025-02-26 Qizhou Wang , Bo Han , Puning Yang , Jianing Zhu , Tongliang Liu , Masashi Sugiyama

Machine unlearning is a key defense mechanism for removing unauthorized concepts from text-to-image diffusion models, yet recent evidence shows that latent visual information often persists after unlearning. Existing adversarial approaches…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Ignacy Kolton , Kacper Marzol , Paweł Batorski , Marcin Mazur , Paul Swoboda , Przemysław Spurek

Model-based reinforcement learning has attracted much attention due to its high sample efficiency and is expected to be applied to real-world robotic applications. In the real world, as unobservable disturbances can lead to unexpected…

Robotics · Computer Science 2025-05-26 Taisuke Kobayashi

Machine unlearning, a process enabling pre-trained models to remove the influence of specific training samples, has attracted significant attention in recent years. While extensive research has focused on developing efficient unlearning…

Cryptography and Security · Computer Science 2024-10-15 Heng Xu , Tianqing Zhu , Wanlei Zhou