English
Related papers

Related papers: Commonsense-T2I Challenge: Can Text-to-Image Gener…

200 papers

Current text-to-image generative models struggle to accurately represent object states (e.g., "a table without a bottle," "an empty tumbler"). In this work, we first design a fully-automatic pipeline to generate high-quality synthetic data…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Tianle Chen , Chaitanya Chakka , Deepti Ghadiyaram

Diffusion models have emerged as a dominant paradigm for generative modeling across a wide range of domains, including prompt-conditional generation. The vast majority of samplers, however, rely on forward discretization of the reverse…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Zhenghan Fang , Jian Zheng , Qiaozi Gao , Xiaofeng Gao , Jeremias Sulam

Text-to-image (TTI) systems, particularly those utilizing open-source frameworks, have become increasingly prevalent in the production of Artificial Intelligence (AI)-generated visuals. While existing literature has explored various…

Human-Computer Interaction · Computer Science 2024-08-29 Maria-Teresa De Rosa Palmini , Laura Wagner , Eva Cetinic

Text-to-image generation methods produce high-resolution and high-quality images, but these methods should not produce immoral images that may contain inappropriate content from the perspective of commonsense morality. In this paper, we aim…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Seongbeom Park , Suhong Moon , Jinkyu Kim

Text-to-image (T2I) systems increasingly rely on upstream prompters, either humans or multimodal large language models (MLLMs), to translate user intent into detailed prompts. Yet current benchmarks fix the prompt and only evaluate T2I…

Artificial Intelligence · Computer Science 2026-05-22 Hanjun Luo , Zhimu Huang , Sylvia Chung , Yiran Wang , Yingbin Jin , Jialin Li , Jiang Li , Xinfeng Li , Hanan Salam

The incredible generative ability of large-scale text-to-image (T2I) models has demonstrated strong power of learning complex structures and meaningful semantics. However, relying solely on text prompts cannot fully take advantage of the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Chong Mou , Xintao Wang , Liangbin Xie , Yanze Wu , Jian Zhang , Zhongang Qi , Ying Shan , Xiaohu Qie

In this paper, we present an empirical study introducing a nuanced evaluation framework for text-to-image (T2I) generative models, applied to human image synthesis. Our framework categorizes evaluations into two distinct groups: first,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Muxi Chen , Yi Liu , Jian Yi , Changran Xu , Qiuxia Lai , Hongliang Wang , Tsung-Yi Ho , Qiang Xu

Recent advances in text-to-image diffusion models have enabled the photorealistic generation of images from text prompts. Despite the great progress, existing models still struggle to generate compositional multi-concept images naturally,…

Computer Vision and Pattern Recognition · Computer Science 2023-10-12 Hazarapet Tunanyan , Dejia Xu , Shant Navasardyan , Zhangyang Wang , Humphrey Shi

Text-to-Image (T2I) diffusion models are widely recognized for their ability to generate high-quality and diverse images based on text prompts. However, despite recent advances, these models are still prone to generating unsafe images…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Jiangweizhi Peng , Zhiwei Tang , Gaowen Liu , Charles Fleming , Mingyi Hong

In this paper, we investigate when and how visual representations learned by two different generative models diverge. Given two text-to-image models, our goal is to discover visual attributes that appear in images generated by one model but…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Lisa Dunlap , Joseph E. Gonzalez , Trevor Darrell , Fabian Caba Heilbron , Josef Sivic , Bryan Russell

Text-to-image (T2I) models have raised increasing safety concerns due to their capacity to generate NSFW and other banned objects. To mitigate these risks, safety filters and concept removal techniques have been introduced to block…

Cryptography and Security · Computer Science 2026-01-13 Xi Ye , Yiwen Liu , Lina Wang , Run Wang , Geying Yang , Yufei Hou , Jiayi Yu

Blending visual and textual concepts into a new visual concept is a unique and powerful trait of human beings that can fuel creativity. However, in practice, cross-modal conceptual blending for humans is prone to cognitive biases, like…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Wonwoong Cho , Yanxia Zhang , Yan-Ying Chen , David I. Inouye

We investigate the generation of minority samples using pretrained text-to-image (T2I) latent diffusion models. Minority instances, in the context of T2I generation, can be defined as ones living on low-density regions of text-conditional…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Soobin Um , Jong Chul Ye

When humans read a specific text, they often visualize the corresponding images, and we hope that computers can do the same. Text-to-image synthesis (T2I), which focuses on generating high-quality images from textual descriptions, has…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Nonghai Zhang , Hao Tang

Text-to-image generation models have recently achieved astonishing results in image quality, flexibility, and text alignment, and are consequently employed in a fast-growing number of applications. Through improvements in multilingual…

With the rise of text-to-image (T2I) generative AI models reaching wide audiences, it is critical to evaluate model robustness against non-obvious attacks to mitigate the generation of offensive images. By focusing on ``implicitly…

Despite their wide-spread success, Text-to-Image models (T2I) still struggle to produce images that are both aesthetically pleasing and faithful to the user's input text. We introduce DreamSync, a model-agnostic training algorithm by design…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Jiao Sun , Deqing Fu , Yushi Hu , Su Wang , Royi Rassin , Da-Cheng Juan , Dana Alon , Charles Herrmann , Sjoerd van Steenkiste , Ranjay Krishna , Cyrus Rashtchian

Text-to-image (T2I) generation aims at producing realistic images corresponding to text descriptions. Generative Adversarial Network (GAN) has proven to be successful in this task. Typical T2I GANs are 2 phase methods that first pretrain an…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Yibin Liu , Jianyu Zhang , Li Zhang , Shijian Li , Gang Pan

One challenge in text-to-image (T2I) generation is the inadvertent reflection of culture gaps present in the training data, which signifies the disparity in generated image quality when the cultural elements of the input text are rarely…

Computer Vision and Pattern Recognition · Computer Science 2023-07-07 Bingshuai Liu , Longyue Wang , Chenyang Lyu , Yong Zhang , Jinsong Su , Shuming Shi , Zhaopeng Tu

Recently, the strong latent Diffusion Probabilistic Model (DPM) has been applied to high-quality Text-to-Image (T2I) generation (e.g., Stable Diffusion), by injecting the encoded target text prompt into the gradually denoised diffusion…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Mingyang Yi , Aoxue Li , Yi Xin , Zhenguo Li