English
Related papers

Related papers: MIST: Mitigating Intersectional Bias with Disentan…

200 papers

Previous studies have established that language models manifest stereotyped biases. Existing debiasing strategies, such as retraining a model with counterfactual data, representation projection, and prompting often fail to efficiently…

Computation and Language · Computer Science 2025-03-12 Xin Xu , Wei Xu , Ningyu Zhang , Julian McAuley

The text to medical image (T2MedI) with latent diffusion model has great potential to alleviate the scarcity of medical imaging data and explore the underlying appearance distribution of lesions in a specific patient status description.…

Computer Vision and Pattern Recognition · Computer Science 2025-01-09 Xu Han , Fangfang Fan , Jingzhao Rong , Zhen Li , Georges El Fakhri , Qingyu Chen , Xiaofeng Liu

Transformer-based diffusion models have recently superseded traditional U-Net architectures, with multimodal diffusion transformers (MM-DiT) emerging as the dominant approach in state-of-the-art models like Stable Diffusion 3 and Flux.1.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Joonghyuk Shin , Alchan Hwang , Yujin Kim , Daneul Kim , Jaesik Park

Diffusion models have recently shown strong progress in generative tasks, offering a more stable alternative to GAN-based approaches for makeup transfer. Existing methods often suffer from limited datasets, poor disentanglement between…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Qihe Pan , Yiming Wu , Xing Zhao , Liang Xie , Guodao Sun , Ronghua Liang

Recent large-scale text-to-image diffusion models generate photorealistic images but often struggle to accurately depict interactions between humans and objects due to their limited ability to differentiate various interaction words. In…

Graphics · Computer Science 2025-03-21 SeungJu Cha , Kwanyoung Lee , Ye-Chan Kim , Hyunwoo Oh , Dong-Jin Kim

Mitigating biases in generative AI and, particularly in text-to-image models, is of high importance given their growing implications in society. The biased datasets used for training pose challenges in ensuring the responsible development…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Carolina Lopez Olmos , Alexandros Neophytou , Sunando Sengupta , Dim P. Papadopoulos

Text-to-image diffusion models have demonstrated remarkable effectiveness in rapid and high-fidelity personalization, even when provided with only a few user images. However, the effectiveness of personalization techniques has lead to…

Computer Vision and Pattern Recognition · Computer Science 2025-10-06 Naresh Kumar Devulapally , Shruti Agarwal , Tejas Gokhale , Vishnu Suresh Lokhande

Artistic image stylization aims to render the content provided by text or image with the target style, where content and style decoupling is the key to achieve satisfactory results. However, current methods for content and style…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Ma Zhuoqi , Zhang Yixuan , You Zejun , Tian Long , Liu Xiyang

Fashion illustration is a crucial medium for designers to convey their creative vision and transform design concepts into tangible representations that showcase the interplay between clothing and the human body. In the context of fashion…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Alberto Baldrati , Davide Morelli , Marcella Cornia , Marco Bertini , Rita Cucchiara

Images produced by text-to-image diffusion models might not always faithfully represent the semantic intent of the provided text prompt, where the model might overlook or entirely fail to produce certain objects. Existing solutions often…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Tuna Han Salih Meral , Enis Simsar , Federico Tombari , Pinar Yanardag

Diffusion-based generative models demonstrate state-of-the-art performance across various image synthesis tasks, yet their tendency to replicate and amplify dataset biases remains poorly understood. Although previous research has viewed…

Machine Learning · Computer Science 2025-12-24 Nathan Roos , Ekaterina Iakovleva , Ani Gjergji , Vito Paolo Pastore , Enzo Tartaglione

Text-to-image diffusion models have recently become highly capable, yet their behavior in multi-object scenes remains unreliable: models often produce an incorrect number of instances and exhibit semantics leaking across objects. We trace…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Sanghyun Jo , Wooyeol Lee , Ziseok Lee , Kyungsu Kim

Diffusion probabilistic models (DPMs) have exhibited exceptional proficiency in generating visual media of outstanding quality and realism. Nonetheless, their potential in non-generative domains, such as face recognition, has yet to be…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Bowen Sun , Shibao Zheng

Recent advances in diffusion transformers have shown remarkable generalization in visual synthesis, yet most dense perception methods still rely on text-to-image (T2I) generators designed for stochastic generation. We revisit this paradigm…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Yiqing Shi , Yiren Song , Mike Zheng Shou

Despite recent significant strides achieved by diffusion-based Text-to-Image (T2I) models, current systems are still less capable of ensuring decent compositional generation aligned with text prompts, particularly for the multi-object…

Computer Vision and Pattern Recognition · Computer Science 2024-02-01 Zhipeng Bao , Yijun Li , Krishna Kumar Singh , Yu-Xiong Wang , Martial Hebert

With recent advances in image and video diffusion models for content creation, a plethora of techniques have been proposed for customizing their generated content. In particular, manipulating the cross-attention layers of Text-to-Image…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Saman Motamed , Wouter Van Gansbeke , Luc Van Gool

We present the first text-based image editing approach for object parts based on pre-trained diffusion models. Diffusion-based image editing approaches capitalized on the deep understanding of diffusion models of image semantics to perform…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Aleksandar Cvejic , Abdelrahman Eldesokey , Peter Wonka

Text-to-image diffusion models have emerged as an evolutionary for producing creative content in image synthesis. Based on the impressive generation abilities of these models, instruction-guided diffusion models can edit images with simple…

Cryptography and Security · Computer Science 2024-08-21 Ruoxi Chen , Haibo Jin , Yixin Liu , Jinyin Chen , Haohan Wang , Lichao Sun

This paper considers the problem of utilizing a large-scale text-to-image diffusion model to tackle the challenging Inexact Segmentation (IS) task. Unlike traditional approaches that rely heavily on discriminative-model-based paradigms or…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Tianjiao Zhang , Fei Zhang , Jiangchao Yao , Ya Zhang , Yanfeng Wang

Recently, text-guided image editing has achieved significant success. However, existing methods can only apply simple textures like wood or gold when changing the texture of an object. Complex textures such as cloud or fire pose a…

Computer Vision and Pattern Recognition · Computer Science 2025-01-15 Zihan Su , Junhao Zhuang , Chun Yuan