English
Related papers

Related papers: Machine Unlearning via Null Space Calibration

200 papers

Machine learning models may inadvertently memorize sensitive, unauthorized, or malicious data, posing risks of privacy breaches, security vulnerabilities, and performance degradation. To address these issues, machine unlearning has emerged…

Machine Learning · Computer Science 2024-04-08 Jie Xu , Zihan Wu , Cong Wang , Xiaohua Jia

User specifications or legal frameworks often require information to be removed from pretrained models, including large language models (LLMs). This requires deleting or "forgetting" a set of data points from an already-trained model, which…

Machine Learning · Computer Science 2025-07-18 Vaidehi Patil , Elias Stengel-Eskin , Mohit Bansal

Machine unlearning aims to remove the influence of specific samples from a trained model. A key challenge in this process is over-unlearning, where the model's performance on the remaining data significantly drops due to the change in the…

Machine Learning · Computer Science 2025-07-30 Huiqiang Chen , Tianqing Zhu , Xin Yu , Wanlei Zhou

Machine unlearning seeks to remove the influence of particular data or class from trained models to meet privacy, legal, or ethical requirements. Existing unlearning methods tend to forget shallowly: phenomenon of an unlearned model pretend…

Machine Learning · Computer Science 2025-07-23 Jaeheun Jung , Bosung Jung , Suhyun Bae , Donghun Lee

Machine unlearning (MU) aims to eliminate information that has been learned from specific training data, namely forgetting data, from a pre-trained model. Currently, the mainstream of existing MU methods involves modifying the forgetting…

Machine Learning · Computer Science 2025-10-13 Zhengbao He , Tao Li , Xinwen Cheng , Zhehao Huang , Xiaolin Huang

Machine Unlearning (MU) aims to remove the information of specific training data from a trained model, ensuring compliance with privacy regulations and user requests. While one line of existing MU methods relies on linear parameter updates…

Artificial Intelligence · Computer Science 2026-05-13 Yingdan Shi , Ren Wang

Machine unlearning methods have become increasingly important for selective concept removal in large pre-trained models. While recent work has explored unlearning in Euclidean contrastive vision-language models, the effectiveness of concept…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Àlex Pujol Vidal , Sergio Escalera , Kamal Nasrollahi , Thomas B. Moeslund

Machine unlearning aims to remove the influence of specific training data from a learned model without full retraining. While recent work has begun to explore unlearning in quantum machine learning, existing approaches largely rely on…

Machine Learning · Computer Science 2026-02-10 Nausherwan Malik , Zubair Khalid , Muhammad Faryad

Machine unlearning aims to remove the influence of problematic training data after a model has been trained. The primary challenge in machine unlearning is ensuring that the process effectively removes specified data without compromising…

Machine Learning · Computer Science 2026-03-10 Aviv Shamsian , Eitan Shaar , Aviv Navon , Gal Chechik , Ethan Fetaya

Machine learning has attracted widespread attention and evolved into an enabling technology for a wide range of highly successful applications, such as intelligent computer vision, speech recognition, medical diagnosis, and more. Yet a…

Cryptography and Security · Computer Science 2023-06-07 Heng Xu , Tianqing Zhu , Lefeng Zhang , Wanlei Zhou , Philip S. Yu

This study investigates the machine unlearning techniques within the context of large language models (LLMs), referred to as \textit{LLM unlearning}. LLM unlearning offers a principled approach to removing the influence of undesirable data…

Computation and Language · Computer Science 2025-06-03 Jiahui Geng , Qing Li , Herbert Woisetschlaeger , Zongxiong Chen , Fengyu Cai , Yuxia Wang , Preslav Nakov , Hans-Arno Jacobsen , Fakhri Karray

Machine unlearning, the efficient deletion of the impact of specific data in a trained model, remains a challenging problem. Current machine unlearning approaches that focus primarily on data-centric or weight-based strategies frequently…

Machine Learning · Computer Science 2025-08-07 Thang Duc Tran , Thai Hoang Le

The past a few years have witnessed the great success of large language models, demonstrating powerful capabilities in comprehending textual data and generating human-like languages. Large language models achieve success by being trained on…

Computation and Language · Computer Science 2025-03-20 Estrid He , Tabinda Sarwar , Ibrahim Khalil , Xun Yi , Ke Wang

Machine unlearning is a prominent and challenging field, driven by regulatory demands for user data deletion and heightened privacy awareness. Existing approaches involve retraining model or multiple finetuning steps for each deletion…

Machine Learning · Computer Science 2024-08-07 Sangamesh Kodge , Gobinda Saha , Kaushik Roy

Machine Learning (ML) models have been shown to potentially leak sensitive information, thus raising privacy concerns in ML-driven applications. This inspired recent research on removing the influence of specific data samples from a trained…

Machine Learning · Computer Science 2023-10-30 Youyang Qu , Xin Yuan , Ming Ding , Wei Ni , Thierry Rakotoarivelo , David Smith

Machine Unlearning is an emerging paradigm for selectively removing the impact of training datapoints from a network. Unlike existing methods that target a limited subset or a single class, our framework unlearns all classes in a single…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Samuele Poppi , Sara Sarto , Marcella Cornia , Lorenzo Baraldi , Rita Cucchiara

We formalize the problem of machine unlearning as design of efficient unlearning algorithms corresponding to learning algorithms which perform a selection of adaptive queries from structured query classes. We give efficient unlearning…

Machine Learning · Computer Science 2023-07-24 Enayat Ullah , Raman Arora

Machine unlearning algorithms are increasingly important as legal concerns arise around the provenance of training data, but verifying the success of unlearning is often difficult. Provable guarantees for unlearning are often limited to…

Machine Learning · Computer Science 2025-04-22 Stanley Wei , Sadhika Malladi , Sanjeev Arora , Amartya Sanyal

Machine unlearning, i.e. having a model forget about some of its training data, has become increasingly more important as privacy legislation promotes variants of the right-to-be-forgotten. In the context of deep learning, approaches for…

Machine Learning · Computer Science 2022-02-22 Anvith Thudi , Hengrui Jia , Ilia Shumailov , Nicolas Papernot

As large language models (LLMs) are trained on massive datasets, they have raised significant privacy and ethical concerns due to their potential to inadvertently retain sensitive information. Unlearning seeks to selectively remove specific…

Computation and Language · Computer Science 2025-06-17 Philipp Spohn , Leander Girrbach , Jessica Bader , Zeynep Akata