English
Related papers

Related papers: Unlearning in Diffusion models under Data Constrai…

200 papers

While many unsupervised learning models focus on one family of tasks, either generative or discriminative, we explore the possibility of a unified representation learner: a model which addresses both families of tasks simultaneously. We…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Soumik Mukhopadhyay , Matthew Gwilliam , Yosuke Yamaguchi , Vatsal Agarwal , Namitha Padmanabhan , Archana Swaminathan , Tianyi Zhou , Jun Ohya , Abhinav Shrivastava

Recent generative models face significant risks of producing harmful content, which has underscored the importance of machine unlearning (MU) as a critical technique for eliminating the influence of undesired data. However, existing MU…

Machine Learning · Computer Science 2025-07-31 Xiang Li , Qianli Shen , Haonan Wang , Kenji Kawaguchi

Large Language Models (LLMs) unlearning is crucial for removing hazardous or privacy-leaking information from the model. Practical LLM unlearning demands satisfying multiple challenging objectives simultaneously: removing undesirable…

Machine Learning · Computer Science 2026-04-20 Yisheng Zhong , Sijia Liu , Zhuangdi Zhu

Machine Unlearning aims to remove undesired information from trained models without requiring full retraining from scratch. Despite recent advancements, their underlying loss landscapes and optimization dynamics received less attention. In…

Machine Learning · Computer Science 2025-04-10 Jiali Cheng , Hadi Amiri

Machine unlearning is a complex process that necessitates the model to diminish the influence of the training data while keeping the loss of accuracy to a minimum. Despite the numerous studies on machine unlearning in recent years, the…

Machine Learning · Computer Science 2024-05-14 Zixin Wang , Kongyang Chen

Machine Unlearning, the process of selectively eliminating the influence of certain data examples used during a model's training, has gained significant attention as a means for practitioners to comply with recent data protection…

Machine Learning · Computer Science 2024-03-22 Daniel Trippa , Cesare Campagnano , Maria Sofia Bucarelli , Gabriele Tolomei , Fabrizio Silvestri

Machine unlearning poses challenges in removing mislabeled, contaminated, or problematic data from a pretrained model. Current unlearning approaches and evaluation metrics are solely focused on model predictions, which limits insight into…

Machine Learning · Computer Science 2026-04-13 Khoa Tran , Simon S. Woo

We consider a practical scenario of machine unlearning to erase a target dataset, which causes unexpected behavior from the trained model. The target dataset is often assumed to be fully identifiable in a standard unlearning scenario. Such…

Machine Learning · Computer Science 2023-03-15 Youngsik Yoon , Jinhwan Nam , Hyojeong Yun , Jaeho Lee , Dongwoo Kim , Jungseul Ok

Diffusion models (DMs) have become the new trend of generative models and have demonstrated a powerful ability of conditional synthesis. Among those, text-to-image diffusion models pre-trained on large-scale image-text pairs are highly…

Computer Vision and Pattern Recognition · Computer Science 2023-03-06 Wenliang Zhao , Yongming Rao , Zuyan Liu , Benlin Liu , Jie Zhou , Jiwen Lu

The increasing adaptation of vision models across domains, such as satellite imagery and medical scans, has raised an emerging privacy risk: models may inadvertently retain and leak sensitive source-domain specific information in the target…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Arnav Devalapally , Poornima Jain , Kartik Srinivas , Vineeth N. Balasubramanian

Discrete diffusion models have recently shown great promise for modeling complex discrete data, with masked diffusion models (MDMs) offering a compelling trade-off between quality and generation speed. MDMs denoise by progressively…

Machine Learning · Computer Science 2026-04-15 Tianyu Xie , Shuchen Xue , Zijin Feng , Tianyang Hu , Jiacheng Sun , Zhenguo Li , Cheng Zhang

Advanced text-to-image diffusion models raise safety concerns regarding identity privacy violation, copyright infringement, and Not Safe For Work content generation. Towards this, unlearning methods have been developed to erase these…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Xiaoxuan Han , Songlin Yang , Wei Wang , Yang Li , Jing Dong

Unrestricted adversarial attacks present a serious threat to deep learning models and adversarial defense techniques. They pose severe security problems for deep learning applications because they can effectively bypass defense mechanisms.…

Machine Learning · Computer Science 2024-07-16 Xuelong Dai , Kaisheng Liang , Bin Xiao

While the capabilities of generative foundational models have advanced rapidly in recent years, methods to prevent harmful and unsafe behaviors remain underdeveloped. Among the pressing challenges in AI safety, machine unlearning (MU) has…

Machine Learning · Computer Science 2025-02-12 Marcin Sendera , Łukasz Struski , Kamil Książek , Kryspin Musiol , Jacek Tabor , Dawid Rymarczyk

Recent advances in machine learning, particularly in Natural Language Processing (NLP), have produced powerful models trained on vast datasets. However, these models risk leaking sensitive information, raising privacy concerns. In response,…

Machine Learning · Computer Science 2025-09-19 Haoyu Tang , Ye Liu , Xi Zhao , Xukai Liu , Yanghai Zhang , Kai Zhang , Xiaofang Zhou , Enhong Chen

Machine unlearning in text-to-image diffusion models aims to remove targeted concepts while preserving overall utility. Prior diffusion unlearning methods typically rely on supervised weight edits or global penalties; reinforcement-learning…

Machine Learning · Computer Science 2026-02-17 Mykola Vysotskyi , Zahar Kohut , Mariia Shpir , Taras Rumezhak , Volodymyr Karpiv

Generative modeling has recently undergone remarkable advancements, primarily propelled by the transformative implications of Diffusion Probabilistic Models (DPMs). The impressive capability of these models, however, often entails…

Machine Learning · Computer Science 2023-10-03 Gongfan Fang , Xinyin Ma , Xinchao Wang

Image restoration is a long-standing problem in low-level computer vision with many interesting applications. We describe a flexible learning framework based on the concept of nonlinear reaction diffusion models for various image…

Computer Vision and Pattern Recognition · Computer Science 2016-08-23 Yunjin Chen , Thomas Pock

Deep neural networks (DNNs) have achieved remarkable success across diverse domains, but their performance can be severely degraded by noisy or corrupted training data. Conventional noise mitigation methods often rely on explicit…

Machine Learning · Computer Science 2025-06-16 Deliang Jin , Gang Chen , Shuo Feng , Yufeng Ling , Haoran Zhu

Recent diffusion-based generative models achieve remarkable results by training on massive datasets, yet this practice raises concerns about memorization and copyright infringement. A proposed remedy is to train exclusively on noisy data…

Machine Learning · Computer Science 2025-06-04 Haoye Lu , Qifan Wu , Yaoliang Yu