English
Related papers

Related papers: Memory-Efficient Distributed Unlearning

200 papers

Machine unlearning aims to unlearn specified training data (e.g. sensitive or copyrighted material). A prominent approach is to fine-tune an existing model with an unlearning loss that retains overall utility. The space of suitable…

Machine Learning · Computer Science 2026-02-10 Pawel Batorski , Paul Swoboda

Machine unlearning aims to remove the influence of specific data from trained models while preserving general utility. Existing approximate unlearning methods often rely on performance-degradation heuristics, such as loss maximization or…

Machine Learning · Computer Science 2026-03-13 Jonas Mirlach , Sonia Laguna , Julia E. Vogt

We study the problem of unlearning datapoints from a learnt model. The learner first receives a dataset $S$ drawn i.i.d. from an unknown distribution, and outputs a model $\widehat{w}$ that performs well on unseen samples from the same…

Machine Learning · Computer Science 2021-07-23 Ayush Sekhari , Jayadev Acharya , Gautam Kamath , Ananda Theertha Suresh

Machine unlearning, an emerging research topic focusing on compliance with data privacy regulations, enables trained models to remove the information learned from specific data. While many existing methods indirectly address this issue by…

Machine Learning · Computer Science 2024-12-24 Seonguk Seo , Dongwan Kim , Bohyung Han

Machine unlearning has garnered significant attention due to its ability to selectively erase knowledge obtained from specific training data samples in an already trained machine learning model. This capability enables data holders to…

Machine Learning · Computer Science 2024-03-13 Vinay Chakravarthi Gogineni , Esmaeil S. Nadimi

Deep neural networks (DNNs) are becoming increasingly deeper, wider, and non-linear due to the growing demands on prediction accuracy and analysis quality. When training a DNN model, the intermediate activation data must be saved in the…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-11-24 Sian Jin , Guanpeng Li , Shuaiwen Leon Song , Dingwen Tao

Machine unlearning aims to remove points from the training dataset of a machine learning model after training: e.g., when a user requests their data to be deleted. While many unlearning methods have been proposed, none of them enable users…

Machine Learning · Computer Science 2025-03-06 Thorsten Eisenhofer , Doreen Riepel , Varun Chandrasekaran , Esha Ghosh , Olga Ohrimenko , Nicolas Papernot

Machine Unlearning (MU) algorithms have become increasingly critical due to the imperative adherence to data privacy regulations. The primary objective of MU is to erase the influence of specific data samples on a given model without the…

Cryptography and Security · Computer Science 2024-02-23 Zheyuan Liu , Guangyao Dou , Yijun Tian , Chunhui Zhang , Eli Chien , Ziwei Zhu

Machine unlearning addresses the problem of updating a machine learning model/system trained on a dataset $S$ so that the influence of a set of deletion requests $U \subseteq S$ on the unlearned model is minimized. The gold standard…

Machine Learning · Computer Science 2025-06-09 Linda Lu , Ayush Sekhari , Karthik Sridharan

Unlearning the data observed during the training of a machine learning (ML) model is an important task that can play a pivotal role in fortifying the privacy and security of ML-based applications. This paper raises the following questions:…

Machine Learning · Computer Science 2023-06-01 Ayush K Tarun , Vikram S Chundawat , Murari Mandal , Mohan Kankanhalli

Machine unlearning is rapidly becoming a practical requirement, driven by privacy regulations, data errors, and the need to remove harmful or corrupted training samples. Despite this, most existing methods tackle the problem purely from a…

Machine Learning · Computer Science 2026-04-03 Sonia Laguna , Jorge da Silva Goncalves , Moritz Vandenhirtz , Alain Ryser , Irene Cannistraci , Julia E. Vogt

Privacy concerns associated with machine learning models have driven research into machine unlearning, which aims to erase the memory of specific target training data from already trained models. This issue also arises in federated…

Machine Learning · Computer Science 2025-03-14 Yuyuan Li , Jiaming Zhang , Yixiu Liu , Chaochao Chen

For a responsible and safe deployment of diffusion models in various domains, regulating the generated outputs from these models is desirable because such models could generate undesired, violent, and obscene outputs. To tackle this…

Machine Learning · Computer Science 2026-03-24 Subhodip Panda , Varun M S , Shreyans Jain , Sarthak Kumar Maharana , Prathosh A. P

With the introduction of data protection and privacy regulations, it has become crucial to remove the lineage of data on demand from a machine learning (ML) model. In the last few years, there have been notable developments in machine…

Machine Learning · Computer Science 2023-06-01 Ayush K Tarun , Vikram S Chundawat , Murari Mandal , Mohan Kankanhalli

The trustworthy machine learning (ML) community is increasingly recognizing the crucial need for models capable of selectively 'unlearning' data points after training. This leads to the problem of machine unlearning (MU), aiming to…

Machine Learning · Computer Science 2024-07-10 Chongyu Fan , Jiancheng Liu , Alfred Hero , Sijia Liu

Large Language Models (LLMs) deployed in real-world settings increasingly face the need to unlearn sensitive, outdated, or proprietary information. Existing unlearning methods typically formulate forgetting and retention as a regularized…

Computation and Language · Computer Science 2025-10-28 Taha Entesari , Arman Hatami , Rinat Khaziev , Anil Ramakrishna , Mahyar Fazlyab

Training machine learning models requires the storage of large datasets, which often contain sensitive or private data. Storing data is associated with a number of potential risks which increase over time, such as database breaches and…

Machine Learning · Computer Science 2026-04-14 Aviraj Newatia , Michael Cooper , Viet Nguyen , Rahul G. Krishnan

Machine unlearning refers to removing the influence of a specified subset of training data from a machine learning model, efficiently, after it has already been trained. This is important for key applications, including making the model…

Machine unlearning (MU) is becoming a promising paradigm to achieve the "right to be forgotten", where the training trace of any chosen data points could be eliminated, while maintaining the model utility on general testing samples after…

Machine Learning · Computer Science 2024-10-22 Junjie Chen , Qian Chen , Jian Lou , Xiaoyu Zhang , Kai Wu , Zilong Wang

As the use of machine learning (ML) models is becoming increasingly popular in many real-world applications, there are practical challenges that need to be addressed for model maintenance. One such challenge is to 'undo' the effect of a…

Machine Learning · Computer Science 2022-03-01 Quoc Phong Nguyen , Ryutaro Oikawa , Dinil Mon Divakaran , Mun Choon Chan , Bryan Kian Hsiang Low