English
Related papers

Related papers: Boosting Alignment for Post-Unlearning Text-to-Ima…

200 papers

Text-conditioned image generation models have recently achieved astonishing results in image quality and text alignment and are consequently employed in a fast-growing number of applications. Since they are highly data-driven, relying on…

Computer Vision and Pattern Recognition · Computer Science 2023-05-31 Manuel Brack , Felix Friedrich , Patrick Schramowski , Kristian Kersting

The technological advancements in diffusion models (DMs) have demonstrated unprecedented capabilities in text-to-image generation and are widely used in diverse applications. However, they have also raised significant societal concerns,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Yihua Zhang , Chongyu Fan , Yimeng Zhang , Yuguang Yao , Jinghan Jia , Jiancheng Liu , Gaoyuan Zhang , Gaowen Liu , Ramana Rao Kompella , Xiaoming Liu , Sijia Liu

Machine unlearning in text-to-image diffusion models aims to remove targeted concepts while preserving overall utility. Prior diffusion unlearning methods typically rely on supervised weight edits or global penalties; reinforcement-learning…

Machine Learning · Computer Science 2026-02-17 Mykola Vysotskyi , Zahar Kohut , Mariia Shpir , Taras Rumezhak , Volodymyr Karpiv

Generative models have been widely studied in computer vision. Recently, diffusion models have drawn substantial attention due to the high quality of their generated images. A key desired property of image generative models is the ability…

Computer Vision and Pattern Recognition · Computer Science 2022-12-20 Qiucheng Wu , Yujian Liu , Handong Zhao , Ajinkya Kale , Trung Bui , Tong Yu , Zhe Lin , Yang Zhang , Shiyu Chang

Recent advances in generative deep learning have enabled the creation of high-quality synthetic images in text-to-image generation. Prior work shows that fine-tuning a pretrained diffusion model on ImageNet and generating synthetic training…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Zhuoran Yu , Chenchen Zhu , Sean Culatana , Raghuraman Krishnamoorthi , Fanyi Xiao , Yong Jae Lee

Recent advances in large-scale text-to-image diffusion models have heightened concerns about their potential misuse, especially in generating harmful or misleading content. This underscores the urgent need for effective machine unlearning,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Agnieszka Polowczyk , Alicja Polowczyk , Dawid Malarz , Artur Kasymov , Marcin Mazur , Jacek Tabor , Przemysław Spurek

Generative AI (GenAI), which aims to synthesize realistic and diverse data samples from latent variables or other data modalities, has achieved remarkable results in various domains, such as natural language, images, audio, and graphs.…

Machine Learning · Computer Science 2024-08-02 Shiji Zhou , Lianzhe Wang , Jiangnan Ye , Yongliang Wu , Heng Chang

We present UniGen-1.5, a unified multimodal large language model (MLLM) for advanced image understanding, generation and editing. Building upon UniGen, we comprehensively enhance the model architecture and training pipeline to strengthen…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Rui Tian , Mingfei Gao , Haiming Gang , Jiasen Lu , Zhe Gan , Yinfei Yang , Zuxuan Wu , Afshin Dehghan

Training multimodal generative models on large, uncurated datasets can result in users being exposed to harmful, unsafe and controversial or culturally-inappropriate outputs. While model editing has been proposed to remove or filter…

Computer Vision and Pattern Recognition · Computer Science 2025-03-06 Jordan Vice , Naveed Akhtar , Mubarak Shah , Richard Hartley , Ajmal Mian

Neural language models often fail to generate diverse and informative texts, limiting their applicability in real-world problems. While previous approaches have proposed to address these issues by identifying and penalizing undesirable…

Computation and Language · Computer Science 2023-09-25 Jimin Hong , ChaeHun Park , Jaegul Choo

Large language models (LLMs) should undergo rigorous audits to identify potential risks, such as copyright and privacy infringements. Once these risks emerge, timely updates are crucial to remove undesirable responses, ensuring legal and…

Machine Learning · Computer Science 2025-02-27 Qizhou Wang , Jin Peng Zhou , Zhanke Zhou , Saebyeol Shin , Bo Han , Kilian Q. Weinberger

Visual generative AI models often encounter challenges related to text-image alignment and reasoning limitations. This paper presents a novel method for selectively enhancing the signal at critical denoising steps, optimizing image…

Computer Vision and Pattern Recognition · Computer Science 2025-04-25 Paul Grimal , Hervé Le Borgne , Olivier Ferret

Text guided diffusion models are used by millions of users, but can be easily exploited to produce harmful content. Concept unlearning methods aim at reducing the models' likelihood of generating harmful content. Traditionally, this has…

Artificial Intelligence · Computer Science 2026-02-10 Mansi , Avinash Kori , Francesca Toni , Soteris Demetriou

Text-to-image generative models have made significant advancements in recent years; however, accurately capturing intricate details in textual prompts-such as entity missing, attribute binding errors, and incorrect relationships remains a…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Amir Mohammad Izadi , Seyed Mohammad Hadi Hosseini , Soroush Vafaie Tabar , Ali Abdollahi , Armin Saghafian , Mahdieh Soleymani Baghshah

The heightened emphasis on the regulation of deep generative models, propelled by escalating concerns pertaining to privacy and compliance with regulatory frameworks, underscores the imperative need for precise control mechanisms over these…

Machine Learning · Computer Science 2024-06-21 Subhodip Panda , Prathosh AP

Large language models inevitably retain sensitive information, defined as inputs that may induce harmful generations, due to training on massive web corpora, raising concerns for privacy and safety. Existing machine unlearning methods…

Machine Learning · Computer Science 2026-05-21 Yujie Lin , Chengyi Yang , Zhishang Xiang , Yiping Song , Jinsong Su

In this work, we introduce Adapt & Align, a method for continual learning of neural networks by aligning latent representations in generative models. Neural Networks suffer from abrupt loss in performance when retrained with additional…

Machine Learning · Computer Science 2023-12-22 Kamil Deja , Bartosz Cywiński , Jan Rybarczyk , Tomasz Trzciński

We formulate the machine unlearning problem as a general constrained optimization problem. It unifies the first-order methods from the approximate machine unlearning literature. This paper then introduces the concept of feasible updates as…

Machine Learning · Computer Science 2025-11-05 Virgile Dine , Teddy Furon , Charly Faure

As generative models become powerful, concerns around transparency, accountability, and copyright violations have intensified. Understanding how specific training data contributes to a model's output is critical. We introduce a framework…

Artificial Intelligence · Computer Science 2025-12-03 Theodoros Aivalis , Iraklis A. Klampanos , Antonis Troumpoukis , Joemon M. Jose

Machine unlearning is the process of efficiently removing specific information from a trained machine learning model without retraining from scratch. Existing unlearning methods, which often provide provable guarantees, typically involve…

Machine Learning · Computer Science 2026-02-04 Somnath Basu Roy Chowdhury , Rahul Kidambi , Avinava Dubey , David Wang , Gokhan Mergen , Amr Ahmed , Aranyak Mehta