English
Related papers

Related papers: Targeted Unlearning with Single Layer Unlearning G…

200 papers

Enabling large language models (LLMs) to unlearn knowledge and capabilities acquired during training has proven vital for ensuring compliance with data regulations and promoting ethical practices in generative AI. Although there are growing…

Machine Unlearning (MU) is critical for removing private or hazardous information from deep learning models. While MU has advanced significantly in unimodal (text or vision) settings, multimodal unlearning (MMU) remains underexplored due to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-18 Alexey Dontsov , Dmitrii Korzh , Alexey Zhavoronkin , Boris Mikheev , Denis Bobkov , Aibek Alanov , Oleg Y. Rogov , Ivan Oseledets , Elena Tutubalina

Generative models such as Large Language Models (LLMs) and Multimodal Large Language Models (MLLMs) trained on massive datasets can lead them to memorize and inadvertently reveal sensitive information, raising ethical and privacy concerns.…

Computation and Language · Computer Science 2025-07-24 Zheyuan Liu , Guangyao Dou , Xiangchi Yuan , Chunhui Zhang , Zhaoxuan Tan , Meng Jiang

Machine unlearning is the process through which a deployed machine learning model is made to forget about some of its training data points. While naively retraining the model from scratch is an option, it is almost always associated with…

Machine Learning · Computer Science 2022-03-03 Anvith Thudi , Gabriel Deza , Varun Chandrasekaran , Nicolas Papernot

Machine unlearning is a process to remove specific data points from a trained model while maintaining the performance on the retain data, addressing privacy or legal requirements. Despite its importance, existing unlearning evaluations tend…

Machine Learning · Computer Science 2026-01-30 Yongwoo Kim , Sungmin Cha , Donghyun Kim

Machine unlearning aims to remove sensitive or undesired data from large language models. However, recent studies suggest that unlearning is often shallow, claiming that removed knowledge can easily be recovered. In this work, we critically…

Machine Learning · Computer Science 2025-06-03 Zhili Feng , Yixuan Even Xu , Alexander Robey , Robert Kirk , Xander Davies , Yarin Gal , Avi Schwarzschild , J. Zico Kolter

Self-supervised learning has shown its great potential to extract powerful visual representations without human annotations. Various works are proposed to deal with self-supervised learning from different perspectives: (1) contrastive…

Computer Vision and Pattern Recognition · Computer Science 2022-07-06 Chenxin Tao , Honghui Wang , Xizhou Zhu , Jiahua Dong , Shiji Song , Gao Huang , Jifeng Dai

The LLM unlearning technique has recently been introduced to comply with data regulations and address the safety and ethical concerns of LLMs by removing the undesired data-model influence. However, state-of-the-art unlearning methods face…

Machine Learning · Computer Science 2025-05-28 Chongyu Fan , Jinghan Jia , Yihua Zhang , Anil Ramakrishna , Mingyi Hong , Sijia Liu

Federated learning is a promising privacy-preserving paradigm for distributed machine learning. In this context, there is sometimes a need for a specialized process called machine unlearning, which is required when the effect of some…

Cryptography and Security · Computer Science 2024-06-19 Heng Xu , Tianqing Zhu , Lefeng Zhang , Wanlei Zhou , Philip S. Yu

Multi-task learning (MTL) is a subfield of machine learning with important applications, but the multi-objective nature of optimization in MTL leads to difficulties in balancing training between tasks. The best MTL optimization methods…

Machine Learning · Computer Science 2021-09-20 Michael Crawshaw , Jana Košecká

LLM unlearning has emerged as a promising approach, aiming to enable models to forget hazardous/undesired knowledge at low cost while preserving as much model utility as possible. Among existing techniques, the most straightforward method…

Machine Learning · Computer Science 2025-10-28 Zirui Pang , Hao Zheng , Zhijie Deng , Ling Li , Zixin Zhong , Jiaheng Wei

This paper explores Machine Unlearning (MU), an emerging field that is gaining increased attention due to concerns about neural models unintentionally remembering personal or sensitive information. We present SeUL, a novel method that…

Computation and Language · Computer Science 2024-12-17 Lingzhi Wang , Xingshan Zeng , Jinsong Guo , Kam-Fai Wong , Georg Gottlob

Machine unlearning focuses on efficiently removing specific data from trained models, addressing privacy and compliance concerns with reasonable costs. Although exact unlearning ensures complete data removal equivalent to retraining, it is…

Cryptography and Security · Computer Science 2025-06-17 Nima Naderloui , Shenao Yan , Binghui Wang , Jie Fu , Wendy Hui Wang , Weiran Liu , Yuan Hong

Large Language Models (LLMs) are increasingly integrated into real-world applications, raising concerns about privacy, security and the need to remove undesirable knowledge. Machine Unlearning has emerged as a promising solution, yet faces…

Machine Learning · Computer Science 2025-10-22 Yisheng Zhong , Zhengbang Yang , Zhuangdi Zhu

Information removal or suppression in large language models (LLMs) is a desired functionality, useful in AI regulation, legal compliance, safety, and privacy. LLM unlearning methods aim to remove information on demand from LLMs. Current LLM…

Artificial Intelligence · Computer Science 2025-07-09 Debdeep Sanyal , Murari Mandal

The rapid proliferation of image generation models and other artificial intelligence (AI) systems has intensified concerns regarding data privacy and user consent. As the availability of public datasets declines, major technology companies…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Ishrak Hamim Mahi , Siam Ferdous , Md Sakib Sadman Badhon , Nabid Hasan Omi , Md Habibun Nabi Hemel , Farig Yousuf Sadeque , Md. Tanzim Reza

Machine unlearning aims to remove private or sensitive data from a pre-trained model while preserving the model's robustness. Despite recent advances, this technique has not been explored in medical image classification. This work evaluates…

Image and Video Processing · Electrical Eng. & Systems 2025-08-27 Andreza M. C. Falcao , Filipe R. Cordeiro

Multimodal recommendation systems (MRS) jointly model user-item interaction graphs and rich item content, but this tight coupling makes user data difficult to remove once learned. Approximate machine unlearning offers an efficient…

Artificial Intelligence · Computer Science 2026-04-13 Zhanting Zhou , KaHou Tam , Ziqiang Zheng , Zeyu Ma , Yang Yang

Text guided diffusion models are used by millions of users, but can be easily exploited to produce harmful content. Concept unlearning methods aim at reducing the models' likelihood of generating harmful content. Traditionally, this has…

Artificial Intelligence · Computer Science 2026-02-10 Mansi , Avinash Kori , Francesca Toni , Soteris Demetriou

We explore machine unlearning (MU) in the domain of large language models (LLMs), referred to as LLM unlearning. This initiative aims to eliminate undesirable data influence (e.g., sensitive or illegal information) and the associated model…