English
Related papers

Related papers: Remember What You Want to Forget: Algorithms for M…

200 papers

Document understanding models have recently demonstrated remarkable performance by leveraging extensive collections of user documents. However, since documents often contain large amounts of personal data, their usage can pose a threat to…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Lei Kang , Mohamed Ali Souibgui , Fei Yang , Lluis Gomez , Ernest Valveny , Dimosthenis Karatzas

Machine unlearning is essential for meeting legal obligations such as the right to be forgotten, which requires the removal of specific data from machine learning models upon request. While several approaches to unlearning have been…

Machine Learning · Computer Science 2025-05-13 Maximilian Egger , Rawad Bitar , Rüdiger Urbanke

LLMs have been found to memorize training textual sequences and regurgitate verbatim said sequences during text generation time. This fact is known to be the cause of privacy and related (e.g., copyright) problems. Unlearning in LLMs then…

Machine Learning · Computer Science 2024-05-07 George-Octavian Barbulescu , Peter Triantafillou

Despite the strong capabilities of Large Language Models (LLMs) to acquire knowledge from their training corpora, the memorization of sensitive information in the corpora such as copyrighted, biased, and private content has led to ethical…

Computation and Language · Computer Science 2025-05-29 James Y. Huang , Wenxuan Zhou , Fei Wang , Fred Morstatter , Sheng Zhang , Hoifung Poon , Muhao Chen

Recently enacted legislation grants individuals certain rights to decide in what fashion their personal data may be used, and in particular a "right to be forgotten". This poses a challenge to machine learning: how to proceed when an…

Machine Learning · Computer Science 2020-07-09 Thomas Baumhauer , Pascal Schöttle , Matthias Zeppelzauer

Personal digital data is a critical asset, and governments worldwide have enforced laws and regulations to protect data privacy. Data users have been endowed with the right to be forgotten of their data. In the course of machine learning…

Machine Learning · Computer Science 2024-03-14 Na Li , Chunyi Zhou , Yansong Gao , Hui Chen , Anmin Fu , Zhi Zhang , Yu Shui

Machine unlearning is a crucial tool for enabling a classification model to forget specific data that are used in the training time. Recently, various studies have presented machine unlearning algorithms and evaluated their methods on…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Dasol Choi , Dongbin Na

Machine unlearning considers the removal of the contribution of a set of data points from a trained model. In a distributed setting, where a server orchestrates training using data available at a set of remote users, unlearning is essential…

Signal Processing · Electrical Eng. & Systems 2025-05-07 Natalie Lang , Alon Helvitz , Nir Shlezinger

Machine learning models based on neural networks (NNs) are enjoying ever-increasing attention in the DB community. However, an important issue has been largely overlooked, namely the challenge of dealing with the highly dynamic nature of…

Databases · Computer Science 2023-11-30 Meghdad Kurmanji , Eleni Triantafillou , Peter Triantafillou

Machine unlearning is the task of updating a trained model to forget specific training data without retraining from scratch. In this paper, we investigate how unlearning of deep neural networks (DNNs) is affected by the model…

Machine Learning · Computer Science 2026-05-20 Gal Alon , Yehuda Dar

Federated learning is a promising privacy-preserving paradigm for distributed machine learning. In this context, there is sometimes a need for a specialized process called machine unlearning, which is required when the effect of some…

Cryptography and Security · Computer Science 2024-06-19 Heng Xu , Tianqing Zhu , Lefeng Zhang , Wanlei Zhou , Philip S. Yu

Machine learning models (mainly neural networks) are used more and more in real life. Users feed their data to the model for training. But these processes are often one-way. Once trained, the model remembers the data. Even when data is…

Machine Learning · Computer Science 2022-10-03 Zihao Cao , Jianzong Wang , Shijing Si , Zhangcheng Huang , Jing Xiao

This study investigates the concept of the `right to be forgotten' within the context of large language models (LLMs). We explore machine unlearning as a pivotal solution, with a focus on pre-trained models--a notably under-researched area.…

Computation and Language · Computer Science 2024-05-31 Jin Yao , Eli Chien , Minxin Du , Xinyao Niu , Tianhao Wang , Zezhou Cheng , Xiang Yue

Data privacy and security have become a non-negligible factor in load forecasting. Previous researches mainly focus on training stage enhancement. However, once the model is trained and deployed, it may need to `forget' (i.e., remove the…

Machine Learning · Computer Science 2024-03-12 Wangkun Xu , Fei Teng

We show that the influence of a subset of the training samples can be removed -- or "forgotten" -- from the weights of a network trained on large-scale image classification tasks, and we provide strong computable bounds on the amount of…

Machine Learning · Computer Science 2021-06-22 Aditya Golatkar , Alessandro Achille , Avinash Ravichandran , Marzia Polito , Stefano Soatto

Current research on deep machine unlearning primarily focuses on improving or evaluating the overall effectiveness of unlearning methods while overlooking the varying difficulty of unlearning individual training samples. As a result, the…

Machine Learning · Computer Science 2025-02-24 Hammad Rizwan , Mahtab Sarvmaili , Hassan Sajjad , Ga Wu

In the problem of generalized zero-shot learning, the datapoints from unknown classes are not available during training. The main challenge for generalized zero-shot learning is the unbalanced data distribution which makes it hard for the…

Computer Vision and Pattern Recognition · Computer Science 2018-11-09 Hongguang Zhang , Piotr Koniusz

Large Language Models are typically trained on datasets collected from the web, which may inadvertently contain harmful or sensitive personal information. To address growing privacy concerns, unlearning methods have been proposed to remove…

Machine Learning · Computer Science 2025-10-23 Xiaoyu Wu , Yifei Pang , Terrance Liu , Zhiwei Steven Wu

Given the prevalence of large language models (LLMs) and the prohibitive cost of training these models from scratch, dynamically forgetting specific knowledge e.g., private or proprietary, without retraining the model has become an…

Computation and Language · Computer Science 2024-08-09 Tyler Lizzo , Larry Heck

Machine unlearning refers to the task of removing a subset of training data, thereby removing its contributions to a trained model. Approximate unlearning are one class of methods for this task which avoid the need to retrain the model from…

Machine Learning · Computer Science 2022-09-14 Ambrish Rawat , James Requeima , Wessel Bruinsma , Richard Turner