English
Related papers

Related papers: Train Once, Forget Precisely: Anchored Optimizatio…

200 papers

In Machine Learning, the emergence of \textit{the right to be forgotten} gave birth to a paradigm named \textit{machine unlearning}, which enables data holders to proactively erase their data from a trained model. Existing machine…

Cryptography and Security · Computer Science 2022-07-01 Yi Liu , Lei Xu , Xingliang Yuan , Cong Wang , Bo Li

Neural networks unintentionally memorize training data, creating privacy risks in federated learning (FL) systems, such as inference and reconstruction attacks on sensitive data. To mitigate these risks and to comply with privacy…

Machine Learning · Computer Science 2025-09-22 Van-Tuan Tran , Hong-Hanh Nguyen-Le , Quoc-Viet Pham

Machine unlearning, where users can request the deletion of a forget dataset, is becoming increasingly important because of numerous privacy regulations. Initial works on ``exact'' unlearning (e.g., retraining) incur large computational…

Machine Learning · Computer Science 2025-11-17 Ali Ebrahimpour-Boroojeny , Hari Sundaram , Varun Chandrasekaran

Privacy regulations require the erasure of data from deep learning models. This is a significant challenge that is amplified in Federated Learning, where data remains on clients, making full retraining or coordinated updates often…

Machine Learning · Computer Science 2026-01-27 Antonio Balordi , Lorenzo Manini , Fabio Stella , Alessio Merlo

Human beings are able to master a variety of knowledge and skills with ongoing learning. By contrast, dramatic performance degradation is observed when new tasks are added to an existing neural network model. This phenomenon, termed as…

Machine Learning · Computer Science 2019-10-25 Xin Yao , Tianchi Huang , Chenglei Wu , Rui-Xiao Zhang , Lifeng Sun

Machine unlearning is a process to remove specific data points from a trained model while maintaining the performance on the retain data, addressing privacy or legal requirements. Despite its importance, existing unlearning evaluations tend…

Machine Learning · Computer Science 2026-01-30 Yongwoo Kim , Sungmin Cha , Donghyun Kim

Machine unlearning is the process of efficiently removing specific information from a trained machine learning model without retraining from scratch. Existing unlearning methods, which often provide provable guarantees, typically involve…

Machine Learning · Computer Science 2026-02-04 Somnath Basu Roy Chowdhury , Rahul Kidambi , Avinava Dubey , David Wang , Gokhan Mergen , Amr Ahmed , Aranyak Mehta

Machine unlearning (MU) seeks to eliminate the influence of specific training examples from deployed models. As large language models (LLMs) become widely used, managing risks arising from insufficient forgetting or utility loss is…

Machine Learning · Computer Science 2025-12-16 Si Qi Goh , Yongsen Zheng , Ziyao Liu , Sami Hormi , Kwok-Yan Lam

The rapid progress of AI, combined with its unprecedented public adoption and the propensity of large neural networks to memorize training data, has given rise to significant data privacy concerns. To address these concerns, machine…

Machine Learning · Computer Science 2023-11-23 Ali Abbasi , Chayne Thrash , Elaheh Akbari , Daniel Zhang , Soheil Kolouri

The trustworthy machine learning (ML) community is increasingly recognizing the crucial need for models capable of selectively 'unlearning' data points after training. This leads to the problem of machine unlearning (MU), aiming to…

Machine Learning · Computer Science 2024-07-10 Chongyu Fan , Jiancheng Liu , Alfred Hero , Sijia Liu

Current unlearning methods for large language models usually rely on reverse optimization to reduce target token probabilities. However, this paradigm disrupts the subsequent tokens prediction, degrading model performance and linguistic…

Computation and Language · Computer Science 2025-05-29 Haoming Xu , Ningyuan Zhao , Liming Yang , Sendong Zhao , Shumin Deng , Mengru Wang , Bryan Hooi , Nay Oo , Huajun Chen , Ningyu Zhang

The ability to learn new concepts continually is necessary in this ever-changing world. However, deep neural networks suffer from catastrophic forgetting when learning new categories. Many works have been proposed to alleviate this…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Fu-Yun Wang , Da-Wei Zhou , Han-Jia Ye , De-Chuan Zhan

Conformal unlearning aims to ensure that a trained conformal predictor miscovers data points with specific shared characteristics, such as those from a particular label class, associated with a specific user, or belonging to a defined…

Machine Learning · Computer Science 2026-02-13 Yahya Alkhatib , Muhammad Ahmar Jamal , Wee Peng Tay

The practical needs of the ``right to be forgotten'' and poisoned data removal call for efficient \textit{machine unlearning} techniques, which enable machine learning models to unlearn, or to forget a fraction of training data and its…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Min Chen , Weizhuo Gao , Gaoyang Liu , Kai Peng , Chen Wang

Machine unlearning is the process of removing the impact of a particular set of training samples from a pretrained model. It aims to fulfill the "right to be forgotten", which grants the individuals such as patients the right to reconsider…

Machine Learning · Computer Science 2024-07-11 Reza Nasirigerdeh , Nader Razmi , Julia A. Schnabel , Daniel Rueckert , Georgios Kaissis

Learning based feature matching methods have been commonly studied in recent years. The core issue for learning feature matching is to how to learn (1) discriminative representations for feature points (or regions) within each intra-image…

Computer Vision and Pattern Recognition · Computer Science 2023-05-31 Bo Jiang , Shuxian Luo , Xiao Wang , Chuanfu Li , Jin Tang

Machine unlearning is an emerging technology that has come to attract widespread attention. A number of factors, including regulations and laws, privacy, and usability concerns, have resulted in this need to allow a trained model to forget…

Machine Learning · Computer Science 2024-06-18 Heng Xu , Tianqing Zhu , Lefeng Zhang , Wanlei Zhou , Wei Zhao

In this paper, we consider the problem of fine-grained image retrieval in an incremental setting, when new categories are added over time. On the one hand, repeatedly training the representation on the extended dataset is time-consuming. On…

Computer Vision and Pattern Recognition · Computer Science 2020-10-19 Wei Chen , Yu Liu , Weiping Wang , Tinne Tuytelaars , Erwin M. Bakker , Michael Lew

Machine Unlearning is an emerging paradigm for selectively removing the impact of training datapoints from a network. Unlike existing methods that target a limited subset or a single class, our framework unlearns all classes in a single…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Samuele Poppi , Sara Sarto , Marcella Cornia , Lorenzo Baraldi , Rita Cucchiara

Deep neural networks often rely on spurious correlations in training data, leading to biased or unfair predictions in safety-critical domains such as medicine and autonomous driving. While conventional bias mitigation typically requires…

Computer Vision and Pattern Recognition · Computer Science 2025-09-10 Sai Siddhartha Chary Aylapuram , Veeraraju Elluru , Shivang Agarwal