English
Related papers

Related papers: Machine Unlearning under Overparameterization

200 papers

Machine unlearning aims to remove the influence of specific training data from a learned model without full retraining. While recent work has begun to explore unlearning in quantum machine learning, existing approaches largely rely on…

Machine Learning · Computer Science 2026-02-10 Nausherwan Malik , Zubair Khalid , Muhammad Faryad

Machine unlearning is the problem of removing the effect of a subset of training data (the ''forget set'') from a trained model without damaging the model's utility e.g. to comply with users' requests to delete their data, or remove…

Machine Learning · Computer Science 2024-11-01 Kairan Zhao , Meghdad Kurmanji , George-Octavian Bărbulescu , Eleni Triantafillou , Peter Triantafillou

The empirical success of machine learning models with many more parameters than measurements has generated an interest in the theory of overparameterisation, i.e., underdetermined models. This paradigm has recently been studied in domains…

As generative models become increasingly powerful and pervasive, the ability to unlearn specific data, whether due to privacy concerns, legal requirements, or the correction of harmful content, has become increasingly important. Unlike in…

Machine Learning · Computer Science 2025-09-26 Pinak Mandal , Georg A. Gottwald

Machine unlearning, an emerging research topic focusing on compliance with data privacy regulations, enables trained models to remove the information learned from specific data. While many existing methods indirectly address this issue by…

Machine Learning · Computer Science 2024-12-24 Seonguk Seo , Dongwan Kim , Bohyung Han

This study investigates the concept of the `right to be forgotten' within the context of large language models (LLMs). We explore machine unlearning as a pivotal solution, with a focus on pre-trained models--a notably under-researched area.…

Computation and Language · Computer Science 2024-05-31 Jin Yao , Eli Chien , Minxin Du , Xinyao Niu , Tianhao Wang , Zezhou Cheng , Xiang Yue

Machine unlearning is a process to remove specific data points from a trained model while maintaining the performance on the retain data, addressing privacy or legal requirements. Despite its importance, existing unlearning evaluations tend…

Machine Learning · Computer Science 2026-01-30 Yongwoo Kim , Sungmin Cha , Donghyun Kim

Machine unlearning aims to remove the influence of specific data from trained models while preserving general utility. Existing approximate unlearning methods often rely on performance-degradation heuristics, such as loss maximization or…

Machine Learning · Computer Science 2026-03-13 Jonas Mirlach , Sonia Laguna , Julia E. Vogt

Machine unlearning, i.e. having a model forget about some of its training data, has become increasingly more important as privacy legislation promotes variants of the right-to-be-forgotten. In the context of deep learning, approaches for…

Machine Learning · Computer Science 2022-02-22 Anvith Thudi , Hengrui Jia , Ilia Shumailov , Nicolas Papernot

Machine unlearning is the process of removing the impact of a particular set of training samples from a pretrained model. It aims to fulfill the "right to be forgotten", which grants the individuals such as patients the right to reconsider…

Machine Learning · Computer Science 2024-07-11 Reza Nasirigerdeh , Nader Razmi , Julia A. Schnabel , Daniel Rueckert , Georgios Kaissis

Machine unlearning is the process of efficiently removing specific information from a trained machine learning model without retraining from scratch. Existing unlearning methods, which often provide provable guarantees, typically involve…

Machine Learning · Computer Science 2026-02-04 Somnath Basu Roy Chowdhury , Rahul Kidambi , Avinava Dubey , David Wang , Gokhan Mergen , Amr Ahmed , Aranyak Mehta

Machine learning models may inadvertently memorize sensitive, unauthorized, or malicious data, posing risks of privacy breaches, security vulnerabilities, and performance degradation. To address these issues, machine unlearning has emerged…

Machine Learning · Computer Science 2024-04-08 Jie Xu , Zihan Wu , Cong Wang , Xiaohua Jia

Machine Unlearning has recently garnered significant attention, aiming to selectively remove knowledge associated with specific data while preserving the model's performance on the remaining data. A fundamental challenge in this process is…

Machine Learning · Computer Science 2025-07-29 Gaurav Patel , Qiang Qiu

How can we effectively remove or ''unlearn'' undesirable information, such as specific features or the influence of individual data points, from a learning outcome while minimizing utility loss and ensuring rigorous guarantees? We introduce…

Machine Learning · Computer Science 2025-12-30 Shizhou Xu , Thomas Strohmer

Machine unlearning is the process through which a deployed machine learning model is made to forget about some of its training data points. While naively retraining the model from scratch is an option, it is almost always associated with…

Machine Learning · Computer Science 2022-03-03 Anvith Thudi , Gabriel Deza , Varun Chandrasekaran , Nicolas Papernot

In the context of machine unlearning, the primary challenge lies in effectively removing traces of private data from trained models while maintaining model performance and security against privacy attacks like membership inference attacks.…

Machine Learning · Computer Science 2024-06-26 Tao Huang , Ziyang Chen , Jiayang Meng , Qingyu Huang , Xu Yang , Xun Yi , Ibrahim Khalil

Machine unlearning aims to solve the problem of removing the influence of selected training examples from a learned model. Despite the increasing attention to this problem, it remains an open research question how to evaluate unlearning in…

Machine Learning · Computer Science 2024-11-08 Teodora Baluta , Pascal Lamblin , Daniel Tarlow , Fabian Pedregosa , Gintare Karolina Dziugaite

As pretrained models are increasingly shared on the web, ensuring that models can forget or delete sensitive, copyrighted, or private information upon request has become crucial. Machine unlearning has been proposed to address this…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Yurim Jang , Jaeung Lee , Dohyun Kim , Jaemin Jo , Simon S. Woo

Large language models (LLMs) may memorize sensitive or copyrighted content, raising privacy and legal concerns. Due to the high cost of retraining from scratch, researchers attempt to employ machine unlearning to remove specific content…

Computation and Language · Computer Science 2025-08-12 Xiaojian Yuan , Tianyu Pang , Chao Du , Kejiang Chen , Weiming Zhang , Min Lin

Machine unlearning is an emerging field that selectively removes specific data samples from a trained model. This capability is crucial for addressing privacy concerns, complying with data protection regulations, and correcting errors or…

Machine Learning · Computer Science 2025-01-29 Zitong Li , Qingqing Ye , Haibo Hu