中文
相关论文

相关论文: Role Bias in Diffusion Models: Diagnosing and Miti…

200 篇论文

Multimodal autoregressive (AR) models, based on next-token prediction and transformer architecture, have demonstrated remarkable capabilities in various multimodal tasks including text-to-image (T2I) generation. Despite their strong…

计算机视觉与模式识别 · 计算机科学 2025-12-02 Yi Wu , Shengju Qian , Lingting Zhu , Lei Liu , Wandi Qiao , Ziqiang Li , Lequan Yu , Bin Li

Existing text-to-image diffusion models, while excelling at subject synthesis, exhibit a persistent foreground bias that treats the background as a passive and under-optimized byproduct. This imbalance compromises global scene coherence and…

计算机视觉与模式识别 · 计算机科学 2026-04-14 Yang Deng , David Mould , Paul L. Rosin , Yu-Kun Lai

Recursive Self-Improvement (RSI) enables intelligence systems to autonomously refine their capabilities. This paper explores the application of RSI in text-to-image diffusion models, addressing the challenge of training collapse caused by…

计算机视觉与模式识别 · 计算机科学 2025-02-17 Xulu Zhang , Xiaoyong Wei , Jinlin Wu , Jiaxin Wu , Zhaoxiang Zhang , Zhen Lei , Qing Li

Text-to-image models are known to struggle with generating images that perfectly align with textual prompts. Several previous studies have focused on evaluating image-text alignment in text-to-image generation. However, these evaluations…

计算机视觉与模式识别 · 计算机科学 2025-10-28 Huixuan Zhang , Xiaojun Wan

Modern Text-to-Image (T2I) Diffusion models have revolutionized image editing by enabling the generation of high-quality photorealistic images. While the de facto method for performing edits with T2I models is through text instructions,…

计算机视觉与模式识别 · 计算机科学 2024-11-07 Ashutosh Srivastava , Tarun Ram Menta , Abhinav Java , Avadhoot Jadhav , Silky Singh , Surgan Jandial , Balaji Krishnamurthy

Despite recent progress, text-to-image models still struggle to generate semantically diverse and compositionally accurate multi-person interaction scenes, often collapsing to repetitive layouts, stereotypical poses, and poorly grounded…

计算机视觉与模式识别 · 计算机科学 2026-05-25 Wenxuan Peng , Bharath Hariharan , Hadar Averbuch-Elor

Current text-to-image (T2I) benchmarks evaluate models on rigid prompts, potentially underestimating true generative capabilities due to prompt sensitivity and creating biases that favor certain models while disadvantaging others. We…

计算机视觉与模式识别 · 计算机科学 2025-07-08 Haosheng Gan , Berk Tinaz , Mohammad Shahab Sepehri , Zalan Fabian , Mahdi Soltanolkotabi

Diffusion models have become prevalent in generative modeling due to their ability to sample from complex distributions. To improve the quality of generated samples and their compliance with user requirements, two commonly used methods are:…

机器学习 · 计算机科学 2025-12-01 Shervin Khalafi , Ignacio Hounie , Dongsheng Ding , Alejandro Ribeiro

Text-to-image (T2I) diffusion models generate high-quality images but often fail to capture the spatial relations specified in text prompts. This limitation can be traced to two factors: lack of fine-grained spatial supervision in training…

计算机视觉与模式识别 · 计算机科学 2025-12-30 Sarah Rastegar , Violeta Chatalbasheva , Sieger Falkena , Anuj Singh , Yanbo Wang , Tejas Gokhale , Hamid Palangi , Hadi Jamali-Rad

The popularization of Text-to-Image (T2I) diffusion models enables the generation of high-quality images from text descriptions. However, generating diverse customized images with reference visual attributes remains challenging. This work…

计算机视觉与模式识别 · 计算机科学 2025-04-22 Brian Nlong Zhao , Yuhang Xiao , Jiashu Xu , Xinyang Jiang , Yifan Yang , Dongsheng Li , Laurent Itti , Vibhav Vineet , Yunhao Ge

Diffusion models have demonstrated impressive capabilities in synthesizing diverse content. However, despite their high-quality outputs, these models often perpetuate social biases, including those related to gender and race. These biases…

计算机视觉与模式识别 · 计算机科学 2025-03-27 Yingdong Shi , Changming Li , Yifan Wang , Yongxiang Zhao , Anqi Pang , Sibei Yang , Jingyi Yu , Kan Ren

The development of diffusion-based generative models over the past decade has largely proceeded independently of progress in representation learning. These diffusion models typically rely on regression-based objectives and generally lack…

计算机视觉与模式识别 · 计算机科学 2025-07-25 Runqian Wang , Kaiming He

Text-to-Image (T2I) generation methods based on diffusion model have garnered significant attention in the last few years. Although these image synthesis methods produce visually appealing results, they frequently exhibit spelling errors…

计算机视觉与模式识别 · 计算机科学 2023-12-27 Yiming Zhao , Zhouhui Lian

Although progress has been made for text-to-image synthesis, previous methods fall short of generalizing to unseen or underrepresented attribute compositions in the input text. Lacking compositionality could have severe implications for…

计算机视觉与模式识别 · 计算机科学 2022-03-30 Zhiheng Li , Martin Renqiang Min , Kai Li , Chenliang Xu

This paper introduces LeftRefill, an innovative approach to efficiently harness large Text-to-Image (T2I) diffusion models for reference-guided image synthesis. As the name implies, LeftRefill horizontally stitches reference and target…

计算机视觉与模式识别 · 计算机科学 2024-03-05 Chenjie Cao , Yunuo Cai , Qiaole Dong , Yikai Wang , Yanwei Fu

Text-to-image diffusion models have drawn significant attention for their ability to generate diverse and high-fidelity images. However, when generating from multi-concept prompts, one concept token often dominates the generation,…

机器学习 · 计算机科学 2025-12-25 Hayeon Jeong , Jong-Seok Lee

Text-to-image diffusion models have demonstrated an impressive ability to produce high-quality outputs. However, they often struggle to accurately follow fine-grained spatial information in an input text. To this end, we propose a…

计算机视觉与模式识别 · 计算机科学 2024-10-22 Ran Galun , Sagie Benaim

Text-to-image models take a sentence (i.e., prompt) and generate images associated with this input prompt. These models have created award wining-art, videos, and even synthetic datasets. However, text-to-image (T2I) models can generate…

计算与语言 · 计算机科学 2023-06-12 Alexander Lin , Lucas Monteiro Paes , Sree Harsha Tanneru , Suraj Srinivas , Himabindu Lakkaraju

Bias in text-to-image (T2I) models can propagate unfair social representations and may be used to aggressively market ideas or push controversial agendas. Existing T2I model bias evaluation methods only focus on social biases. We look…

计算机视觉与模式识别 · 计算机科学 2023-12-21 Jordan Vice , Naveed Akhtar , Richard Hartley , Ajmal Mian

Text-to-image (T2I) generation has been actively studied using Diffusion Models and Autoregressive Models. Recently, Masked Generative Transformers have gained attention as an alternative to Autoregressive Models to overcome the inherent…

计算机视觉与模式识别 · 计算机科学 2025-08-08 Wonjun Kang , Byeongkeun Ahn , Minjae Lee , Kevin Galim , Seunghyuk Oh , Hyung Il Koo , Nam Ik Cho