English
Related papers

Related papers: Data Unlearning Beyond Uniform Forgetting via Diff…

200 papers

Machine Learning (ML) models have been shown to potentially leak sensitive information, thus raising privacy concerns in ML-driven applications. This inspired recent research on removing the influence of specific data samples from a trained…

Machine Learning · Computer Science 2023-10-30 Youyang Qu , Xin Yuan , Ming Ding , Wei Ni , Thierry Rakotoarivelo , David Smith

Diffusion models have achieved remarkable success in generating high-quality images thanks to their novel training procedures applied to unprecedented amounts of data. However, training a diffusion model from scratch is computationally…

Machine Learning · Computer Science 2023-03-28 Michał Zając , Kamil Deja , Anna Kuzina , Jakub M. Tomczak , Tomasz Trzciński , Florian Shkurti , Piotr Miłoś

Large language models (LLMs) have achieved significant progress from pre-training on and memorizing a wide range of textual data, however, this process might suffer from privacy issues and violations of data protection regulations. As a…

Computation and Language · Computer Science 2023-11-01 Jiaao Chen , Diyi Yang

Continual learning is the process of training machine learning models on a sequence of tasks where data distributions change over time. A well-known obstacle in this setting is catastrophic forgetting, a phenomenon in which a model…

Machine Learning · Computer Science 2025-02-18 Andrii Krutsylo

Machine unlearning strives to uphold the data owners' right to be forgotten by enabling models to selectively forget specific data. Recent advances suggest pre-computing and storing statistics extracted from second-order information and…

Machine Learning · Computer Science 2025-02-07 Xinbao Qiao , Meng Zhang , Ming Tang , Ermin Wei

Machine unlearning has garnered significant attention due to its ability to selectively erase knowledge obtained from specific training data samples in an already trained machine learning model. This capability enables data holders to…

Machine Learning · Computer Science 2024-03-13 Vinay Chakravarthi Gogineni , Esmaeil S. Nadimi

Unsupervised representation learning, particularly sequential disentanglement, aims to separate static and dynamic factors of variation in data without relying on labels. This remains a challenging problem, as existing approaches based on…

Machine Learning · Computer Science 2025-10-08 Hedi Zisling , Ilan Naiman , Nimrod Berman , Supasorn Suwajanakorn , Omri Azencot

Machine unlearning is a process to remove specific data points from a trained model while maintaining the performance on the retain data, addressing privacy or legal requirements. Despite its importance, existing unlearning evaluations tend…

Machine Learning · Computer Science 2026-01-30 Yongwoo Kim , Sungmin Cha , Donghyun Kim

Class-incremental learning aims to learn new classes in an incremental fashion without forgetting the previously learned ones. Several research works have shown how additional data can be used by incremental models to help mitigate…

Machine Learning · Computer Science 2023-10-11 Quentin Jodelet , Xin Liu , Yin Jun Phua , Tsuyoshi Murata

Machine unlearning is the process through which a deployed machine learning model is made to forget about some of its training data points. While naively retraining the model from scratch is an option, it is almost always associated with…

Machine Learning · Computer Science 2022-03-03 Anvith Thudi , Gabriel Deza , Varun Chandrasekaran , Nicolas Papernot

Machine unlearning aims to eliminate the influence of a subset of training samples (i.e., unlearning samples) from a trained model. Effectively and efficiently removing the unlearning samples without negatively impacting the overall model…

Machine Learning · Computer Science 2024-01-22 Hong kyu Lee , Qiuchen Zhang , Carl Yang , Jian Lou , Li Xiong

Machine unlearning (MU) seeks to remove knowledge of specific data samples from trained models without the necessity for complete retraining, a task made challenging by the dual objectives of effective erasure of data and maintaining the…

Machine Learning · Computer Science 2024-07-16 Mark He Huang , Lin Geng Foo , Jun Liu

We introduce Compartmentalized Diffusion Models (CDM), a method to train different diffusion models (or prompts) on distinct data sources and arbitrarily compose them at inference time. The individual models can be trained in isolation, at…

Machine Learning · Computer Science 2024-10-15 Aditya Golatkar , Alessandro Achille , Ashwin Swaminathan , Stefano Soatto

Machine unlearning--the ability to remove designated concepts from a pre-trained model--has advanced rapidly, particularly for text-to-image diffusion models. However, existing methods typically assume that unlearning requests arrive all at…

Machine Learning · Computer Science 2026-03-04 Justin Lee , Zheda Mai , Jinsu Yoo , Chongyu Fan , Cheng Zhang , Wei-Lun Chao

Deep machine unlearning is the problem of `removing' from a trained neural network a subset of its training set. This problem is very timely and has many applications, including the key tasks of removing biases (RB), resolving confusion…

Machine Learning · Computer Science 2023-10-31 Meghdad Kurmanji , Peter Triantafillou , Jamie Hayes , Eleni Triantafillou

The rise of the phenomenon of the "right to be forgotten" has prompted research on machine unlearning, which grants data owners the right to actively withdraw data that has been used for model training, and requires the elimination of the…

Machine Learning · Computer Science 2023-08-29 Xulong Zhang , Jianzong Wang , Ning Cheng , Yifu Sun , Chuanyao Zhang , Jing Xiao

Machine unlearning is an emerging technology that has come to attract widespread attention. A number of factors, including regulations and laws, privacy, and usability concerns, have resulted in this need to allow a trained model to forget…

Machine Learning · Computer Science 2024-06-18 Heng Xu , Tianqing Zhu , Lefeng Zhang , Wanlei Zhou , Wei Zhao

The Right to be Forgotten is a core principle outlined by regulatory frameworks such as the EU's General Data Protection Regulation (GDPR). This principle allows individuals to request that their personal data be deleted from deployed…

Machine Learning · Computer Science 2024-02-19 Alex Oesterling , Jiaqi Ma , Flavio P. Calmon , Hima Lakkaraju

As a highly expressive generative model, diffusion models have demonstrated exceptional success across various domains, including image generation, natural language processing, and combinatorial optimization. However, as data distributions…

Machine Learning · Computer Science 2025-10-27 Myunsoo Kim , Donghyeon Ki , Seong-Woong Shim , Byung-Jun Lee

Machine unlearning has emerged as a critical capability for addressing privacy, safety, and regulatory concerns in large language models (LLMs). Existing methods operate at the sequence level, applying uniform updates across all tokens…

Computation and Language · Computer Science 2026-05-07 Jiawei Wu , Doudou Zhou