English
Related papers

Related papers: Learning to Forget using Hypernetworks

200 papers

Large language models trained on web-scale corpora can memorize undesirable data containing misinformation, copyrighted material, or private or sensitive information. Recently, several machine unlearning algorithms have been proposed to…

Computation and Language · Computer Science 2025-05-27 Keivan Rezaei , Khyathi Chandu , Soheil Feizi , Yejin Choi , Faeze Brahman , Abhilasha Ravichander

This work delves into the complexities of machine unlearning in the face of distributional shifts, particularly focusing on the challenges posed by non-uniform feature and label removal. With the advent of regulations like the GDPR…

Machine Learning · Computer Science 2024-03-14 Ling Han , Nanqing Luo , Hao Huang , Jing Chen , Mary-Anne Hartley

Machine unlearning has great significance in guaranteeing model security and protecting user privacy. Additionally, many legal provisions clearly stipulate that users have the right to demand model providers to delete their own data from…

Machine Learning · Computer Science 2021-05-14 Yingzhe He , Guozhu Meng , Kai Chen , Jinwen He , Xingbo Hu

Machine unlearning refers to the process of mitigating the influence of specific training data on machine learning models based on removal requests from data owners. However, one important area that has been largely overlooked in the…

Cryptography and Security · Computer Science 2025-07-17 Dayong Ye , Tianqing Zhu , Congcong Zhu , Derui Wang , Kun Gao , Zewei Shi , Sheng Shen , Wanlei Zhou , Minhui Xue

The widespread adoption of diffusion models in image generation has increased the demand for privacy-compliant unlearning. However, due to the high-dimensional nature and complex feature representations of diffusion models, achieving…

Computer Vision and Pattern Recognition · Computer Science 2025-09-10 Zhenyu Yu , Mohd Yamani Inda Idris , Pei Wang

The Right to be Forgotten is a core principle outlined by regulatory frameworks such as the EU's General Data Protection Regulation (GDPR). This principle allows individuals to request that their personal data be deleted from deployed…

Machine Learning · Computer Science 2024-02-19 Alex Oesterling , Jiaqi Ma , Flavio P. Calmon , Hima Lakkaraju

In Machine Learning, the emergence of \textit{the right to be forgotten} gave birth to a paradigm named \textit{machine unlearning}, which enables data holders to proactively erase their data from a trained model. Existing machine…

Cryptography and Security · Computer Science 2022-07-01 Yi Liu , Lei Xu , Xingliang Yuan , Cong Wang , Bo Li

Today, computer systems hold large amounts of personal data. Yet while such an abundance of data allows breakthroughs in artificial intelligence, and especially machine learning (ML), its existence can be a threat to user privacy, and it…

We address the problem of machine unlearning, where the goal is to remove the influence of specific training data from a model upon request, motivated by privacy concerns and regulatory requirements such as the "right to be forgotten."…

Machine Learning · Computer Science 2025-06-12 Anastasia Koloskova , Youssef Allouah , Animesh Jha , Rachid Guerraoui , Sanmi Koyejo

Machine unlearning, a process enabling pre-trained models to remove the influence of specific training samples, has attracted significant attention in recent years. Although extensive research has focused on developing efficient machine…

Machine Learning · Computer Science 2026-01-13 Heng Xu , Tianqing Zhu , Dayong Ye , Lefeng Zhang , Le Wang , Wanlei Zhou

Since the recent advent of regulations for data protection (e.g., the General Data Protection Regulation), there has been increasing demand in deleting information learned from sensitive data in pre-trained models without retraining from…

Machine Learning · Computer Science 2024-01-17 Sungmin Cha , Sungjun Cho , Dasol Hwang , Honglak Lee , Taesup Moon , Moontae Lee

In the rapid advancement of artificial intelligence, privacy protection has become crucial, giving rise to machine unlearning. Machine unlearning is a technique that removes specific data influences from trained models without the need for…

Machine Learning · Computer Science 2025-06-23 Wenhan Chang , Tianqing Zhu , Ping Xiong , Yufeng Wu , Faqian Guan , Wanlei Zhou

With the explosive growth of deep learning applications and increasing privacy concerns, the right to be forgotten has become a critical requirement in various AI industries. For example, given a facial recognition system, some individuals…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Dasol Choi , Dongbin Na

Machine unlearning aims to remove knowledge of the specific training data in a well-trained model. Currently, machine unlearning methods typically handle all forgetting data in a single batch, removing the corresponding knowledge all at…

Machine Learning · Computer Science 2025-07-22 Shaofei Shen , Chenhao Zhang , Yawen Zhao , Alina Bialkowski , Weitong Chen , Miao Xu

As deep learning models are becoming larger and data-hungrier, there are growing ethical, legal and technical concerns over use of data: in practice, agreements on data use may change over time, rendering previously-used training data…

Machine Learning · Computer Science 2024-05-20 Nazanin Mohammadi Sepahvand , Vincent Dumoulin , Eleni Triantafillou , Gintare Karolina Dziugaite

Machine unlearning, which enables a model to forget specific data, is crucial for ensuring data privacy and model reliability. However, its effectiveness can be severely undermined in real-world scenarios where models learn unintended…

Machine Learning · Computer Science 2026-02-26 JuneHyoung Kwon , MiHyeon Kim , Eunju Lee , Yoonji Lee , Seunghoon Lee , YoungBin Kim

Machine Unlearning (MU) aims at removing the influence of specific data from a pretrained model while preserving performance on the remaining data. In this work, a novel perspective for MU is presented upon low-dimensional feature…

Machine Learning · Computer Science 2026-02-02 Kun Fang , Qinghua Tao , Junxu Liu , Yaxin Xiao , Qingqing Ye , Jian Sun , Haibo Hu

As machine learning becomes more pervasive and data privacy regulations evolve, the ability to remove private or copyrighted information from trained models is becoming an increasingly critical requirement. Existing unlearning methods often…

This paper introduces Unilogit, a novel self-distillation method for machine unlearning in Large Language Models. Unilogit addresses the challenge of selectively forgetting specific information while maintaining overall model utility, a…

Computation and Language · Computer Science 2025-05-12 Stefan Vasilev , Christian Herold , Baohao Liao , Seyyed Hadi Hashemi , Shahram Khadivi , Christof Monz

Machine unlearning is a critical area of research aimed at safeguarding data privacy by enabling the removal of sensitive information from machine learning models. One unique challenge in this field is catastrophic unlearning, where erasing…

Machine Learning · Computer Science 2025-02-17 Zhuoyi Peng , Yixuan Tang , Yi Yang