English
Related papers

Related papers: TIAM -- A Metric for Evaluating Alignment in Text-…

200 papers

Recent advancements in Text-to-Image (T2I) diffusion models have demonstrated impressive success in generating high-quality images with zero-shot generalization capabilities. Yet, current models struggle to closely adhere to prompt…

Computer Vision and Pattern Recognition · Computer Science 2024-01-31 Hyun Kang , Dohae Lee , Myungjin Shin , In-Kwon Lee

Text-to-image diffusion models have demonstrated remarkable capability in generating realistic images from arbitrary text prompts. However, they often produce inconsistent results for compositional prompts such as "two dogs" or "a penguin…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Shuangqi Li , Hieu Le , Jingyi Xu , Mathieu Salzmann

Deep generative models have shown impressive results in text-to-image synthesis. However, current text-to-image models often generate images that are inadequately aligned with text prompts. We propose a fine-tuning method for aligning such…

Text-to-Image (T2I) generation is primarily driven by Diffusion Models (DM) which rely on random Gaussian noise. Thus, like playing the slots at a casino, a DM will produce different results given the same user-defined inputs. This imposes…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Joong Ho Kim , Nicholas Thai , Souhardya Saha Dip , Dong Lao , Keith G. Mills

Text-to-image (T2I) models have rapidly advanced, enabling the generation of high-quality images from text prompts across various domains. However, these models present notable safety concerns, including the risk of generating harmful,…

Computation and Language · Computer Science 2025-07-28 Lijun Li , Zhelun Shi , Xuhao Hu , Bowen Dong , Yiran Qin , Xihui Liu , Lu Sheng , Jing Shao

Text-to-image models have shown remarkable progress in generating high-quality images from user-provided prompts. Despite this, the quality of these images varies due to the models' sensitivity to human language nuances. With advancements…

Artificial Intelligence · Computer Science 2024-06-14 Xinrui Yang , Zhuohan Wang , Anthony Hu

Text-to-image (T2I) generation model has made significant advancements, resulting in high-quality images aligned with an input prompt. However, despite T2I generation's ability to generate fine-grained images, it still faces challenges in…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Taekyung Lee , Donggyu Lee , Myungjoo Kang

Text-to-image generative models are a new and powerful way to generate visual artwork. However, the open-ended nature of text as interaction is double-edged; while users can input anything and have access to an infinite range of…

Human-Computer Interaction · Computer Science 2023-09-29 Vivian Liu , Lydia B. Chilton

Recent advances in text-to-image (T2I) diffusion models have facilitated creative and photorealistic image synthesis. By varying the random seeds, we can generate many images for a fixed text prompt. Technically, the seed controls the…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 Katherine Xu , Lingzhi Zhang , Jianbo Shi

Rectified Flow (RF) models trained with a Flow matching framework have achieved state-of-the-art performance on Text-to-Image (T2I) conditional generation. Yet, multiple benchmarks show that synthetic images can still suffer from poor…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Chao Wang , Giulio Franzese , Alessandro Finamore , Pietro Michiardi

With AI-generated content becoming ubiquitous across the web, social media, and other digital platforms, it is vital to examine how such content are inspired and generated. The creation of AI-generated images often involves refining the…

Artificial Intelligence · Computer Science 2025-04-30 Khoi Trinh , Scott Seidenberger , Raveen Wijewickrama , Murtuza Jadliwala , Anindya Maiti

We provide a new multi-task benchmark for evaluating text-to-image models. We perform a human evaluation comparing the most common open-source (Stable Diffusion) and commercial (DALL-E 2) models. Twenty computer science AI graduate students…

Compositionality is a critical capability in Text-to-Image (T2I) models, as it reflects their ability to understand and combine multiple concepts from text descriptions. Existing evaluations of compositional capability rely heavily on…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Xindi Wu , Dingli Yu , Yangsibo Huang , Olga Russakovsky , Sanjeev Arora

Despite advances in generation quality, current text-to-image (T2I) models often lack diversity, generating homogeneous outputs. This work introduces a framework to address the need for robust diversity evaluation in T2I models. Our…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Isabela Albuquerque , Ira Ktena , Olivia Wiles , Ivana Kajić , Amal Rannen-Triki , Cristina Vasconcelos , Aida Nematzadeh

Text-to-image (T2I) diffusion models have demonstrated impressive capabilities in generating high-quality images given a text prompt. However, ensuring the prompt-image alignment remains a considerable challenge, i.e., generating images…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Liyao Jiang , Negar Hassanpour , Mohammad Salameh , Mohan Sai Singamsetti , Fengyu Sun , Wei Lu , Di Niu

Text-to-Image (T2I) models have shown great performance in generating images based on textual prompts. However, these models are vulnerable to unsafe input to generate unsafe content like sexual, harassment and illegal-activity images.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Zongyu Wu , Hongcheng Gao , Yueze Wang , Xiang Zhang , Suhang Wang

Despite their impressive capabilities, diffusion-based text-to-image (T2I) models can lack faithfulness to the text prompt, where generated images may not contain all the mentioned objects, attributes or relations. To alleviate these…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Shyamgopal Karthik , Karsten Roth , Massimiliano Mancini , Zeynep Akata

Accurate color alignment in text-to-image (T2I) generation is critical for applications such as fashion, product visualization, and interior design, yet current diffusion models struggle with nuanced and compound color terms (e.g., Tiffany…

Computer Vision and Pattern Recognition · Computer Science 2025-09-15 Sung-Lin Tsai , Bo-Lun Huang , Yu Ting Shen , Cheng Yu Yeo , Chiang Tseng , Bo-Kai Ruan , Wen-Sheng Lien , Hong-Han Shuai

Recent text-to-image (T2I) generation models have advanced significantly, enabling the creation of high-fidelity images from textual prompts. However, existing evaluation benchmarks primarily focus on the explicit alignment between…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Wenchao Zhang , Jiahe Tian , Runze He , Jizhong Han , Jiao Dai , Miaomiao Feng , Wei Mi , Xiaodan Zhang

This work presents an open-source unified benchmarking and evaluation framework for text-to-image generation models, with a particular focus on the impact of metadata augmented prompts. Leveraging the DeepFashion-MultiModal dataset, we…

Graphics · Computer Science 2025-05-09 Kapil Wanaskar , Gaytri Jena , Magdalini Eirinaki