English
Related papers

Related papers: PRUNE: A Patching Based Repair Framework for Certi…

200 papers

Machine unlearning aims to remove specific data points from a trained model, often striving to emulate "perfect retraining", i.e., producing the model that would have been obtained had the deleted data never been included. We demonstrate…

Machine Learning · Computer Science 2026-02-19 Aloni Cohen , Refael Kohen , Kobbi Nissim , Uri Stemmer

Given the prevalence of large language models (LLMs) and the prohibitive cost of training these models from scratch, dynamically forgetting specific knowledge e.g., private or proprietary, without retraining the model has become an…

Computation and Language · Computer Science 2024-08-09 Tyler Lizzo , Larry Heck

The "Right to be Forgotten" rule in machine learning (ML) practice enables some individual data to be deleted from a trained model, as pursued by recently developed machine unlearning techniques. To truly comply with the rule, a natural and…

Cryptography and Security · Computer Science 2022-10-24 Jiasi Weng , Shenglong Yao , Yuefeng Du , Junjie Huang , Jian Weng , Cong Wang

Machine unlearning algorithms are increasingly important as legal concerns arise around the provenance of training data, but verifying the success of unlearning is often difficult. Provable guarantees for unlearning are often limited to…

Machine Learning · Computer Science 2025-04-22 Stanley Wei , Sadhika Malladi , Sanjeev Arora , Amartya Sanyal

As deep learning models are becoming larger and data-hungrier, there are growing ethical, legal and technical concerns over use of data: in practice, agreements on data use may change over time, rendering previously-used training data…

Machine Learning · Computer Science 2024-05-20 Nazanin Mohammadi Sepahvand , Vincent Dumoulin , Eleni Triantafillou , Gintare Karolina Dziugaite

It often happens that some sensitive personal information, such as credit card numbers or passwords, are mistakenly incorporated in the training of machine learning models and need to be removed afterwards. The removal of such information…

Machine Learning · Computer Science 2025-04-25 Saber Malekmohammadi , Hong kyu Lee , Li Xiong

Machine unlearning is the process of efficiently removing specific information from a trained machine learning model without retraining from scratch. Existing unlearning methods, which often provide provable guarantees, typically involve…

Machine Learning · Computer Science 2026-02-04 Somnath Basu Roy Chowdhury , Rahul Kidambi , Avinava Dubey , David Wang , Gokhan Mergen , Amr Ahmed , Aranyak Mehta

Modern privacy regulations grant citizens the right to be forgotten by products, services and companies. In case of machine learning (ML) applications, this necessitates deletion of data not only from storage archives but also from ML…

Machine Learning · Computer Science 2023-06-01 Vikram S Chundawat , Ayush K Tarun , Murari Mandal , Mohan Kankanhalli

Machine unlearning algorithms aim to efficiently remove data from a model without retraining it from scratch, in order to remove corrupted or outdated data or respect a user's ``right to be forgotten." Certified machine unlearning is a…

Machine Learning · Computer Science 2025-12-16 Siqiao Mu , Diego Klabjan

Machine unlearning (MU) aims to eliminate information that has been learned from specific training data, namely forgetting data, from a pre-trained model. Currently, the mainstream of existing MU methods involves modifying the forgetting…

Machine Learning · Computer Science 2025-10-13 Zhengbao He , Tao Li , Xinwen Cheng , Zhehao Huang , Xiaolin Huang

Machine unlearning aims to enable models to forget specific data instances when receiving deletion requests. Current research centres on efficient unlearning to erase the influence of data from the model and neglects the subsequent impacts…

Machine Learning · Computer Science 2024-04-23 Huiqiang Chen , Tianqing Zhu , Xin Yu , Wanlei Zhou

Machine unlearning -- efficiently removing the effect of a small "forget set" of training data on a pre-trained machine learning model -- has recently attracted significant research interest. Despite this interest, however, recent work…

Machine Learning · Computer Science 2024-11-13 Kristian Georgiev , Roy Rinberg , Sung Min Park , Shivam Garg , Andrew Ilyas , Aleksander Madry , Seth Neel

Machine unlearning aims to remove knowledge of the specific training data in a well-trained model. Currently, machine unlearning methods typically handle all forgetting data in a single batch, removing the corresponding knowledge all at…

Machine Learning · Computer Science 2025-07-22 Shaofei Shen , Chenhao Zhang , Yawen Zhao , Alina Bialkowski , Weitong Chen , Miao Xu

In order to adhere to regulatory standards governing individual data privacy and safety, machine learning models must systematically eliminate information derived from specific subsets of a user's training data that can no longer be…

Machine Learning · Computer Science 2024-03-26 Subhodip Panda , Shashwat Sourav , Prathosh A. P

Machine unlearning aims to remove the influence of specific data from trained models while preserving general utility. Existing approximate unlearning methods often rely on performance-degradation heuristics, such as loss maximization or…

Machine Learning · Computer Science 2026-03-13 Jonas Mirlach , Sonia Laguna , Julia E. Vogt

The inability to filter out in advance all potentially problematic data from the pre-training of large language models has given rise to the need for methods for unlearning specific pieces of knowledge after training. Existing techniques…

Computation and Language · Computer Science 2026-04-17 Seyun Bae , Seokhan Lee , Eunho Yang

As large language models (LLMs) are trained on massive datasets, they have raised significant privacy and ethical concerns due to their potential to inadvertently retain sensitive information. Unlearning seeks to selectively remove specific…

Computation and Language · Computer Science 2025-06-17 Philipp Spohn , Leander Girrbach , Jessica Bader , Zeynep Akata

Machine unlearning is the process of efficiently removing the influence of a training data instance from a trained machine learning model without retraining it from scratch. A popular subclass of unlearning approaches is exact machine…

Deep machine unlearning is the problem of `removing' from a trained neural network a subset of its training set. This problem is very timely and has many applications, including the key tasks of removing biases (RB), resolving confusion…

Machine Learning · Computer Science 2023-10-31 Meghdad Kurmanji , Peter Triantafillou , Jamie Hayes , Eleni Triantafillou

Unlearning seeks to remove specific knowledge from large language models (LLMs), but its effectiveness remains contested. On one side, "forgotten" knowledge can often be recovered through interventions such as light fine-tuning; on the…

Computation and Language · Computer Science 2025-09-30 Qingjie Zhang , Haoting Qian , Zhicong Huang , Cheng Hong , Minlie Huang , Ke Xu , Chao Zhang , Han Qiu