English
Related papers

Related papers: Evaluating of Machine Unlearning: Robustness Verif…

200 papers

Methods for knowledge editing and unlearning in large language models seek to edit or remove undesirable knowledge or capabilities without compromising general language modeling performance. This work investigates how mechanistic…

Machine Learning · Computer Science 2024-12-06 Phillip Guo , Aaquib Syed , Abhay Sheshadri , Aidan Ewart , Gintare Karolina Dziugaite

There has been a growing interest in Machine Unlearning recently, primarily due to legal requirements such as the General Data Protection Regulation (GDPR) and the California Consumer Privacy Act. Thus, multiple approaches were presented to…

Machine Learning · Computer Science 2022-09-20 Alexander Becker , Thomas Liebig

Machine unlearning (MU) seeks to remove knowledge of specific data samples from trained models without the necessity for complete retraining, a task made challenging by the dual objectives of effective erasure of data and maintaining the…

Machine Learning · Computer Science 2024-07-16 Mark He Huang , Lin Geng Foo , Jun Liu

Recent studies have shown that deep neural networks (DNNs) are vulnerable to adversarial attacks, including evasion and backdoor (poisoning) attacks. On the defense side, there have been intensive efforts on improving both empirical and…

Machine Learning · Computer Science 2023-08-04 Maurice Weber , Xiaojun Xu , Bojan Karlaš , Ce Zhang , Bo Li

Large Language Models (LLMs) embed sensitive, human-generated data, prompting the need for unlearning methods. Although certified unlearning offers strong privacy guarantees, its restrictive assumptions make it unsuitable for LLMs, giving…

Machine Learning · Computer Science 2025-06-03 Rongzhe Wei , Mufei Li , Mohsen Ghassemi , Eleonora Kreačić , Yifan Li , Xiang Yue , Bo Li , Vamsi K. Potluru , Pan Li , Eli Chien

Machine unlearning aims to remove sensitive or undesired data from large language models. However, recent studies suggest that unlearning is often shallow, claiming that removed knowledge can easily be recovered. In this work, we critically…

Machine Learning · Computer Science 2025-06-03 Zhili Feng , Yixuan Even Xu , Alexander Robey , Robert Kirk , Xander Davies , Yarin Gal , Avi Schwarzschild , J. Zico Kolter

Machine unlearning, the study of efficiently removing the impact of specific training instances on a model, has garnered increased attention in recent years due to regulatory guidelines such as the \emph{Right to be Forgotten}. Achieving…

Machine Learning · Computer Science 2024-06-07 Martin Pawelczyk , Seth Neel , Himabindu Lakkaraju

With the implementation of personal data privacy regulations, the field of machine learning (ML) faces the challenge of the "right to be forgotten". Machine unlearning has emerged to address this issue, aiming to delete data and reduce its…

Machine Learning · Computer Science 2024-04-02 Yi Xu

Machine unlearning is the process of removing the impact of a particular set of training samples from a pretrained model. It aims to fulfill the "right to be forgotten", which grants the individuals such as patients the right to reconsider…

Machine Learning · Computer Science 2024-07-11 Reza Nasirigerdeh , Nader Razmi , Julia A. Schnabel , Daniel Rueckert , Georgios Kaissis

Machine unlearning (MU) is gaining increasing attention due to the need to remove or modify predictions made by machine learning (ML) models. While training models have become more efficient and accurate, the importance of unlearning…

Machine Learning · Computer Science 2024-10-28 Thanveer Shaik , Xiaohui Tao , Haoran Xie , Lin Li , Xiaofeng Zhu , Qing Li

Large language models (LLMs) may memorize sensitive or copyrighted content, raising privacy and legal concerns. Due to the high cost of retraining from scratch, researchers attempt to employ machine unlearning to remove specific content…

Computation and Language · Computer Science 2025-08-12 Xiaojian Yuan , Tianyu Pang , Chao Du , Kejiang Chen , Weiming Zhang , Min Lin

With the increasing adoption of Large Language Models (LLMs), more customization is needed to ensure privacy-preserving and safe generation. We address this objective from two critical aspects: unlearning of sensitive information and…

Machine Learning · Computer Science 2025-10-17 Fatmazohra Rezkellah , Ramzi Dakhmouche

Machine unlearning aims to remove the influence of specific training data from pre-trained models without retraining from scratch, and is increasingly important for large language models (LLMs) due to safety, privacy, and legal concerns.…

Computation and Language · Computer Science 2026-03-17 Ruihao Pan , Suhang Wang

Machine unlearning (MU) is to make a well-trained model behave as if it had never been trained on specific data. In today's over-parameterized models, dominated by neural networks, a common approach is to manually relabel data and fine-tune…

Machine Learning · Computer Science 2025-07-21 Ruikai Yang , Mingzhen He , Zhengbao He , Youmei Qiu , Xiaolin Huang

As the adoption of machine learning models increases, ensuring robust models against adversarial attacks is increasingly important. With unsupervised machine learning gaining more attention, ensuring it is robust against attacks is vital.…

Machine Learning · Computer Science 2023-06-02 Mathias Lundteigen Mohus , Jinyue Li

The high cost of model training makes it increasingly desirable to develop techniques for unlearning. These techniques seek to remove the influence of a training example without having to retrain the model from scratch. Intuitively, once a…

Machine Learning · Computer Science 2024-05-22 Jamie Hayes , Ilia Shumailov , Eleni Triantafillou , Amr Khalifa , Nicolas Papernot

We revisit the efficacy of several practical methods for approximate machine unlearning developed for large-scale deep learning. In addition to complying with data deletion requests, one often-cited potential application for unlearning…

Machine Learning · Computer Science 2026-01-16 Martin Pawelczyk , Jimmy Z. Di , Yiwei Lu , Gautam Kamath , Ayush Sekhari , Seth Neel

It often happens that some sensitive personal information, such as credit card numbers or passwords, are mistakenly incorporated in the training of machine learning models and need to be removed afterwards. The removal of such information…

Machine Learning · Computer Science 2025-04-25 Saber Malekmohammadi , Hong kyu Lee , Li Xiong

In the context of machine unlearning, the primary challenge lies in effectively removing traces of private data from trained models while maintaining model performance and security against privacy attacks like membership inference attacks.…

Machine Learning · Computer Science 2024-06-26 Tao Huang , Ziyang Chen , Jiayang Meng , Qingyu Huang , Xu Yang , Xun Yi , Ibrahim Khalil

As machine-learning (ML) based systems for malware detection become more prevalent, it becomes necessary to quantify the benefits compared to the more traditional anti-virus (AV) systems widely used today. It is not practical to build an…

Cryptography and Security · Computer Science 2018-06-14 William Fleshman , Edward Raff , Richard Zak , Mark McLean , Charles Nicholas