English
Related papers

Related papers: UnStar: Unlearning with Self-Taught Anti-Sample Re…

200 papers

The reasoning ability of large language models (LLMs) can be unleashed with reinforcement learning (RL) (OpenAI, 2024; DeepSeek-AI et al., 2025a; Zeng et al., 2025). The success of existing RL attempts in LLMs usually rely on high-quality…

Machine Learning · Computer Science 2026-04-03 Yiyuan Li , Zhen Huang , Yanan Wu , Weixun Wang , Xuefeng Li , Yijia Luo , Wenbo Su , Bo Zheng , Pengfei Liu

Machine learning has attracted widespread attention and evolved into an enabling technology for a wide range of highly successful applications, such as intelligent computer vision, speech recognition, medical diagnosis, and more. Yet a…

Cryptography and Security · Computer Science 2023-06-07 Heng Xu , Tianqing Zhu , Lefeng Zhang , Wanlei Zhou , Philip S. Yu

Machine unlearning for security is studied in this context. Several spam email detection methods exist, each of which employs a different algorithm to detect undesired spam emails. But these models are vulnerable to attacks. Many attackers…

Machine Learning · Computer Science 2021-12-28 Nishchal Parne , Kyathi Puppaala , Nithish Bhupathi , Ripon Patgiri

Recent work has shown that diffusion models memorize and reproduce training data examples. At the same time, large copyright lawsuits and legislation such as GDPR have highlighted the need for erasing datapoints from diffusion models.…

Machine Learning · Computer Science 2025-03-04 Silas Alberti , Kenan Hasanaliyev , Manav Shah , Stefano Ermon

A conventional LLM Unlearning setting consists of two subsets -"forget" and "retain", with the objectives of removing the undesired knowledge from the forget set while preserving the remaining knowledge from the retain. In privacy-focused…

Machine Learning · Computer Science 2025-09-09 Praveen Bushipaka , Lucia Passaro , Tommaso Cucinotta

Understanding and shaping the behaviour of Large Language Models (LLMs) is increasingly important as applications become more powerful and more frequently adopted. This paper introduces a machine unlearning method specifically designed for…

Machine Learning · Computer Science 2024-07-25 Nicholas Pochinkov , Nandi Schoots

With the continued advancement and widespread adoption of machine learning (ML) models across various domains, ensuring user privacy and data security has become a paramount concern. In compliance with data privacy regulations, such as…

Machine Learning · Computer Science 2024-07-09 Nexhi Sula , Abhinav Kumar , Jie Hou , Han Wang , Reza Tourani

The growing use of large language models in sensitive domains has exposed a critical weakness: the inability to ensure that private information can be permanently forgotten. Yet these systems still lack reliable mechanisms to guarantee that…

Machine Learning · Computer Science 2025-11-14 James Jin Kang , Dang Bui , Thanh Pham , Huo-Chong Ling

Large language model (LLM) unlearning is critical in real-world applications where it is necessary to efficiently remove the influence of private, copyrighted, or harmful data from some users. Existing utility-centric unlearning metrics…

Conformal unlearning aims to ensure that a trained conformal predictor miscovers data points with specific shared characteristics, such as those from a particular label class, associated with a specific user, or belonging to a defined…

Machine Learning · Computer Science 2026-02-13 Yahya Alkhatib , Muhammad Ahmar Jamal , Wee Peng Tay

Machine unlearning is concerned with the task of removing knowledge learned from particular data points from a trained model. In the context of large language models (LLMs), unlearning has recently received increased attention, particularly…

Computation and Language · Computer Science 2025-09-03 Aravind Krishnan , Siva Reddy , Marius Mosbach

Machine Unlearning (MU) has recently attracted considerable attention as a solution to privacy and copyright issues in large language models (LLMs). Existing MU methods aim to remove specific target sentences from an LLM while minimizing…

Computation and Language · Computer Science 2025-09-22 Tomoya Yamashita , Yuuki Yamanaka , Masanori Yamada , Takayuki Miura , Toshiki Shibahara , Tomoharu Iwata

Recently, the enactment of privacy regulations has promoted the rise of the machine unlearning paradigm. Existing studies of machine unlearning mainly focus on sample-wise unlearning, such that a learnt model will not expose user's privacy…

Machine Learning · Computer Science 2022-04-19 Tao Guo , Song Guo , Jiewei Zhang , Wenchao Xu , Junxiao Wang

To comply with AI and data regulations, the need to forget private or copyrighted information from trained machine learning models is increasingly important. The key challenge in unlearning is forgetting the necessary data in a timely…

Machine Learning · Computer Science 2024-12-03 Jack Foster , Kyle Fogarty , Stefan Schoepf , Zack Dugue , Cengiz Öztireli , Alexandra Brintrup

By adopting a more flexible definition of unlearning and adjusting the model distribution to simulate training without the targeted data, approximate machine unlearning provides a less resource-demanding alternative to the more laborious…

Machine Learning · Computer Science 2024-05-02 Cheng-Long Wang , Qi Li , Zihang Xiang , Yinzhi Cao , Di Wang

The growing concern over training data privacy has elevated the "Right to be Forgotten" into a critical requirement, thereby raising the demand for effective Machine Unlearning. However, existing unlearning approaches commonly suffer from a…

Machine Learning · Computer Science 2026-02-20 Haoyu Wang , Zhuo Huang , Xiaolong Wang , Bo Han , Zhiwei Lin , Tongliang Liu

The need for effective unlearning mechanisms in large language models (LLMs) is increasingly urgent, driven by the necessity to adhere to data regulations and foster ethical generative AI practices. Despite growing interest of LLM…

Machine Learning · Computer Science 2025-04-15 Jinghan Jia , Jiancheng Liu , Yihua Zhang , Parikshit Ram , Nathalie Baracaldo , Sijia Liu

Machine unlearning (MU) aims to eliminate information that has been learned from specific training data, namely forgetting data, from a pre-trained model. Currently, the mainstream of existing MU methods involves modifying the forgetting…

Machine Learning · Computer Science 2025-10-13 Zhengbao He , Tao Li , Xinwen Cheng , Zhehao Huang , Xiaolin Huang

As the right to be forgotten has been legislated worldwide, many studies attempt to design unlearning mechanisms to protect users' privacy when they want to leave machine learning service platforms. Specifically, machine unlearning is to…

Cryptography and Security · Computer Science 2026-04-21 Weiqi Wang , Zhiyi Tian , Chenhan Zhang , Shui Yu

The rise of the phenomenon of the "right to be forgotten" has prompted research on machine unlearning, which grants data owners the right to actively withdraw data that has been used for model training, and requires the elimination of the…

Machine Learning · Computer Science 2023-08-29 Xulong Zhang , Jianzong Wang , Ning Cheng , Yifu Sun , Chuanyao Zhang , Jing Xiao