English
Related papers

Related papers: Separable Multi-Concept Erasure from Diffusion Mod…

200 papers

Concept erasure in text-to-image diffusion models seeks to remove undesired concepts while preserving overall generative capability. Localized erasure methods aim to restrict edits to the spatial region occupied by the target concept.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Zhuan Shi , Alireza Dehghanpour Farashah , Rik de Vries , Golnoosh Farnadi

Generative models play an important role in missing data imputation in that they aim to learn the joint distribution of full data. However, applying advanced deep generative models (such as Diffusion models) to missing data imputation is…

Machine Learning · Computer Science 2025-05-27 Hengrui Zhang , Liancheng Fang , Qitian Wu , Philip S. Yu

Image classification serves as the cornerstone of computer vision, traditionally achieved through discriminative models based on deep neural networks. Recent advancements have introduced classification methods derived from generative…

Computer Vision and Pattern Recognition · Computer Science 2024-12-16 Chunxiao Li , Xiaoxiao Wang , Boming Miao , Chuanlong Xie , Zizhe Wang , Yao Zhu

Deployed text-to-image diffusion models increasingly require post-hoc concept unlearning for copyright claims, artist opt-outs, safety updates, and protected-content mitigation without full retraining. A central challenge is erase-retain…

Machine Learning · Computer Science 2026-05-19 Ashutosh Ranjan , Vivek Srivastava , Shirish Karande , Murari Mandal

Text-to-image (T2I) diffusion models have shown exceptional capabilities in generating images that closely correspond to textual prompts. However, the advancement of T2I diffusion models presents significant risks, as the models could be…

Computer Vision and Pattern Recognition · Computer Science 2025-08-21 Jie Ren , Kangrui Chen , Yingqian Cui , Shenglai Zeng , Hui Liu , Yue Xing , Jiliang Tang , Lingjuan Lyu

Diffusion models achieve remarkable fidelity in image synthesis, yet precise control over their outputs for targeted editing remains challenging. A key step toward controllability is to identify interpretable directions in the model's…

Computer Vision and Pattern Recognition · Computer Science 2026-02-13 Tharun Anand , Mohammad Hassan Vali , Arno Solin , Green Rosh , BH Pawan Prasad

Recent advances in text-to-image diffusion models have enabled the photorealistic generation of images from text prompts. Despite the great progress, existing models still struggle to generate compositional multi-concept images naturally,…

Computer Vision and Pattern Recognition · Computer Science 2023-10-12 Hazarapet Tunanyan , Dejia Xu , Shant Navasardyan , Zhangyang Wang , Humphrey Shi

Diffusion models have shown remarkable abilities in generating realistic and high-quality images from text prompts. However, a trained model remains largely black-box; little do we know about the roles of its components in exhibiting a…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Quang H. Nguyen , Hoang Phan , Khoa D. Doan

The proliferation of text-to-image diffusion models has raised significant privacy and security concerns, particularly regarding the generation of copyrighted or harmful images. In response, concept erasure (defense) methods have been…

Machine Learning · Computer Science 2025-10-06 Alex D. Richardson , Kaicheng Zhang , Lucas Beerens , Dongdong Chen

The exceptional generative capability of text-to-image models has raised substantial safety concerns regarding the generation of Not-Safe-For-Work (NSFW) content and potential copyright infringement. To address these concerns, previous…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Feng Han , Kai Chen , Chao Gong , Zhipeng Wei , Jingjing Chen , Yu-Gang Jiang

Concept erasure helps stop diffusion models (DMs) from generating harmful content; but current methods face robustness retention trade off. Robustness means the model fine-tuned by concept erasure methods resists reactivation of erased…

Machine Learning · Computer Science 2026-02-16 Fengpeng Li , Kemou Li , Qizhou Wang , Bo Han , Jiantao Zhou

Evaluating diffusion-based image-editing models is a crucial task in the field of Generative AI. Specifically, it is imperative to assess their capacity to execute diverse editing tasks while preserving the image content and realism. While…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Stefan Stefanache , Lluís Pastor Pérez , Julen Costa Watanabe , Ernesto Sanchez Tejedor , Thomas Hofmann , Enis Simsar

The expansion of large-scale text-to-image diffusion models has raised growing concerns about their potential to generate undesirable or harmful content, ranging from fabricated depictions of public figures to sexually explicit images. To…

Cryptography and Security · Computer Science 2025-05-01 Jonas Henry Grebe , Tobias Braun , Marcus Rohrbach , Anna Rohrbach

Concept erasure is the task of erasing information about a concept (e.g., gender or race) from a representation set while retaining the maximum possible utility -- information from original representations. Concept erasure is useful in…

Text-to-image diffusion models can synthesize high-quality images, but they have various limitations. Here we highlight a common failure mode of these models, namely, generating uncommon concepts and structured concepts like hand palms. We…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Dvir Samuel , Rami Ben-Ari , Simon Raviv , Nir Darshan , Gal Chechik

In this work, we investigate the capability of generating images from pre-trained diffusion models at much higher resolutions than the training image sizes. In addition, the generated images should have arbitrary image aspect ratios. When…

Computer Vision and Pattern Recognition · Computer Science 2023-10-12 Yingqing He , Shaoshu Yang , Haoxin Chen , Xiaodong Cun , Menghan Xia , Yong Zhang , Xintao Wang , Ran He , Qifeng Chen , Ying Shan

The technological advancements in diffusion models (DMs) have demonstrated unprecedented capabilities in text-to-image generation and are widely used in diverse applications. However, they have also raised significant societal concerns,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Yihua Zhang , Chongyu Fan , Yimeng Zhang , Yuguang Yao , Jinghan Jia , Jiancheng Liu , Gaoyuan Zhang , Gaowen Liu , Ramana Rao Kompella , Xiaoming Liu , Sijia Liu

The widespread adoption of text-to-image (T2I) diffusion models has raised concerns about their potential to generate copyrighted, inappropriate, or sensitive imagery. As a practical solution, machine unlearning aims to erase unwanted…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Kaiyuan Deng , Bo Hui , Gen Li , Jie Ji , Minghai Qin , Geng Yuan , Xiaolong Ma

Text-to-image diffusion models rely on massive, web-scale datasets. Training them from scratch is computationally expensive, and as a result, developers often prefer to make incremental updates to existing models. These updates often…

Machine Learning · Computer Science 2025-09-29 Vinith M. Suriyakumar , Rohan Alur , Ayush Sekhari , Manish Raghavan , Ashia C. Wilson

Recent generative data augmentation methods conditioned on both image and text prompts struggle to balance between fidelity and diversity, as it is challenging to preserve essential image details while aligning with varied text prompts.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-20 Tianchen Zhao , Xuanbai Chen , Zhihua Li , Jun Fang , Dongsheng An , Xiang Xu , Zhuowen Tu , Yifan Xing