English
Related papers

Related papers: An Adversarial Perspective on Machine Unlearning f…

200 papers

Machine Learning models face increased concerns regarding the storage of personal user data and adverse impacts of corrupted data like backdoors or systematic bias. Machine Unlearning can address these by allowing post-hoc deletion of…

Machine Learning · Computer Science 2023-02-23 Shashwat Goel , Ameya Prabhu , Amartya Sanyal , Ser-Nam Lim , Philip Torr , Ponnurangam Kumaraguru

Unlearning methods have the potential to improve the privacy and safety of large language models (LLMs) by removing sensitive or harmful information post hoc. The LLM unlearning research community has increasingly turned toward empirical…

Computation and Language · Computer Science 2025-04-09 Pratiksha Thaker , Shengyuan Hu , Neil Kale , Yash Maurya , Zhiwei Steven Wu , Virginia Smith

Supervised fine-tuning has become the predominant method for adapting large pretrained models to downstream tasks. However, recent studies have revealed that these models are vulnerable to backdoor attacks, where even a small number of…

Cryptography and Security · Computer Science 2025-01-08 Peihai Jiang , Xixiang Lyu , Yige Li , Jing Ma

Large Language Models (LLMs) have demonstrated remarkable capabilities in natural language understanding and generation. However, their tendency to memorize training data raises concerns regarding privacy, copyright compliance, and…

Machine Learning · Computer Science 2025-06-23 Arjun Dosajh , Mihika Sanghi

As large language models (LLMs) are becoming more capable and widespread, the study of their failure cases is becoming increasingly important. Recent advances in standardizing, measuring, and scaling test-time compute suggest new…

Machine Learning · Computer Science 2025-06-26 Mahdi Sabbaghi , Paul Kassianik , George Pappas , Yaron Singer , Amin Karbasi , Hamed Hassani

AI systems are rapidly advancing in capability, and frontier model developers broadly acknowledge the need for safeguards against serious misuse. However, this paper demonstrates that fine-tuning, whether via open weights or closed…

Cryptography and Security · Computer Science 2025-09-23 Brendan Murphy , Dillon Bowen , Shahrad Mohammadzadeh , Tom Tseng , Julius Broomfield , Adam Gleave , Kellin Pelrine

Language models can retain dangerous knowledge and skills even after extensive safety fine-tuning, posing both misuse and misalignment risks. Recent studies show that even specialized unlearning methods can be easily reversed. To address…

Machine Learning · Computer Science 2025-12-01 Filip Sondej , Yushi Yang , Mikołaj Kniejski , Marcel Windys

Machine unlearning is the process of removing the imprint left by specific data samples during the training of a machine learning model. AI developers, including those building personalized technologies, employ machine unlearning for…

Machine Learning · Computer Science 2026-03-10 Hanyu Duan , Yi Yang , Ahmed Abbasi , Kar Yan Tam

Evaluations of large language model (LLM) risks and capabilities are increasingly being incorporated into AI risk management and governance frameworks. Currently, most risk evaluations are conducted by designing inputs that elicit harmful…

LLMs are trained to refuse harmful instructions, but do they truly understand harmfulness beyond just refusing? Prior work has shown that LLMs' refusal behaviors can be mediated by a one-dimensional subspace, i.e., a refusal direction. In…

Computation and Language · Computer Science 2025-12-16 Jiachen Zhao , Jing Huang , Zhengxuan Wu , David Bau , Weiyan Shi

In the future, powerful AI systems may be deployed in high-stakes settings, where a single failure could be catastrophic. One technique for improving AI safety in high-stakes settings is adversarial training, which uses an adversary to…

Machine unlearning has emerged as a prevalent technical solution for selectively removing unwanted knowledge absorbed during pre-training, without requiring full retraining. While recent unlearning techniques can effectively remove…

Machine Learning · Computer Science 2025-11-04 Myeongseob Ko , Hoang Anh Just , Charles Fleming , Ming Jin , Ruoxi Jia

Although Large Language Models (LLMs) have demonstrated impressive capabilities across a wide range of tasks, growing concerns have emerged over the misuse of sensitive, copyrighted, or harmful data during training. To address these…

Cryptography and Security · Computer Science 2025-06-03 Jie Ren , Zhenwei Dai , Xianfeng Tang , Yue Xing , Shenglai Zeng , Hui Liu , Jingying Zeng , Qiankun Peng , Samarth Varshney , Suhang Wang , Qi He , Charu C. Aggarwal , Hui Liu

Machine unlearning, a process enabling pre-trained models to remove the influence of specific training samples, has attracted significant attention in recent years. While extensive research has focused on developing efficient unlearning…

Cryptography and Security · Computer Science 2024-10-15 Heng Xu , Tianqing Zhu , Wanlei Zhou

Machine unlearning focuses on efficiently removing specific data from trained models, addressing privacy and compliance concerns with reasonable costs. Although exact unlearning ensures complete data removal equivalent to retraining, it is…

Cryptography and Security · Computer Science 2025-06-17 Nima Naderloui , Shenao Yan , Binghui Wang , Jie Fu , Wendy Hui Wang , Weiran Liu , Yuan Hong

Traditional classification algorithms assume that training and test data come from similar distributions. This assumption is violated in adversarial settings, where malicious actors modify instances to evade detection. A number of custom…

Computer Science and Game Theory · Computer Science 2016-11-29 Bo Li , Yevgeniy Vorobeychik , Xinyun Chen

Large Language Models (LLMs) suffer from a range of vulnerabilities that allow malicious users to solicit undesirable responses through manipulation of the input text. These so-called jailbreak prompts are designed to trick the LLM into…

Computation and Language · Computer Science 2025-10-13 John Hawkins , Aditya Pramar , Rodney Beard , Rohitash Chandra

Given the widespread use of deep learning models in safety-critical applications, ensuring that the decisions of such models are robust against adversarial exploitation is of fundamental importance. In this thesis, we discuss recent…

Machine Learning · Computer Science 2025-09-24 Alexander Robey

Deep learning has transformed AI applications but faces critical security challenges, including adversarial attacks, data poisoning, model theft, and privacy leakage. This survey examines these vulnerabilities, detailing their mechanisms…

Machine unlearning aims to remove points from the training dataset of a machine learning model after training: e.g., when a user requests their data to be deleted. While many unlearning methods have been proposed, none of them enable users…

Machine Learning · Computer Science 2025-03-06 Thorsten Eisenhofer , Doreen Riepel , Varun Chandrasekaran , Esha Ghosh , Olga Ohrimenko , Nicolas Papernot