English
Related papers

Related papers: Word-Level Explanations for Analyzing Bias in Text…

200 papers

As machine learning-enabled Text-to-Image (TTI) systems are becoming increasingly prevalent and seeing growing adoption as commercial services, characterizing the social biases they exhibit is a necessary first step to lowering their risk…

Computers and Society · Computer Science 2023-11-13 Alexandra Sasha Luccioni , Christopher Akiki , Margaret Mitchell , Yacine Jernite

Text-to-Image generative systems are progressing rapidly to be a source of advertisement and media and could soon serve as image searches or artists. However, there is a significant concern about the representativity bias these models…

Human-Computer Interaction · Computer Science 2024-10-21 Asma Yamani , Malak Baslyman

Text-to-Image (T2I) generative models have revolutionized content creation, yet they inherently risk amplifying societal biases. While sociological research provides systematic classifications of bias, existing T2I benchmarks largely…

Computers and Society · Computer Science 2026-04-15 Hanjun Luo , Zhimu Huang , Haoyu Huang , Ziye Deng , Ruizhe Chen , Xinfeng Li , Zuozhu Liu , Hanan Salam

Text-to-image (T2I) diffusion models have revolutionized generative modeling by producing high-fidelity, diverse, and visually realistic images from textual prompts. Despite these advances, existing models struggle with complex prompts…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Eric Hanchen Jiang , Yasi Zhang , Zhi Zhang , Yixin Wan , Andrew Lizarraga , Shufan Li , Ying Nian Wu

The proliferation of text-to-image diffusion models (T2I DMs) has led to an increased presence of AI-generated images in daily life. However, biased T2I models can generate content with specific tendencies, potentially influencing people's…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Huayang Huang , Xiangye Jin , Jiaxu Miao , Yu Wu

Text-to-image generative models are a new and powerful way to generate visual artwork. However, the open-ended nature of text as interaction is double-edged; while users can input anything and have access to an infinite range of…

Human-Computer Interaction · Computer Science 2023-09-29 Vivian Liu , Lydia B. Chilton

The rapid advancements of Text-to-Image (T2I) models have ushered in a new phase of AI-generated content, marked by their growing ability to interpret and follow user instructions. However, existing T2I model evaluation benchmarks fall…

Computer Vision and Pattern Recognition · Computer Science 2025-06-26 Xinyu Wei , Jinrui Zhang , Zeqing Wang , Hongyang Wei , Zhen Guo , Lei Zhang

Text-to-Image (T2I) diffusion models are widely recognized for their ability to generate high-quality and diverse images based on text prompts. However, despite recent advances, these models are still prone to generating unsafe images…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Jiangweizhi Peng , Zhiwei Tang , Gaowen Liu , Charles Fleming , Mingyi Hong

Text-to-image models are known to propagate social biases. For example, when prompted to generate images of people in certain professions, these models tend to systematically generate specific genders or ethnicities. In this paper, we show…

Computation and Language · Computer Science 2024-10-25 Guorun Wang , Lucia Specia

We study idiom-based visual puns--images that align an idiom's literal and figurative meanings--and present an iterative framework that coordinates a large language model (LLM), a text-to-image model (T2IM), and a multimodal LLM (MLLM) for…

Computation and Language · Computer Science 2025-12-01 Kelaiti Xiao , Liang Yang , Dongyu Zhang , Paerhati Tulajiang , Hongfei Lin

The rapid proliferation of multimodal generative models has sparked critical discussions on their reliability, fairness and potential for misuse. While text-to-image models excel at producing high-fidelity, user-guided content, they often…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Jordan Vice , Naveed Akhtar , Leonid Sigal , Richard Hartley , Ajmal Mian

Text-to-image (T2I) models have achieved remarkable progress, yet they continue to struggle with complex prompts that require simultaneously handling multiple objects, relations, and attributes. Existing inference-time strategies, such as…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Shantanu Jaiswal , Mihir Prabhudesai , Nikash Bhardwaj , Zheyang Qin , Amir Zadeh , Chuan Li , Katerina Fragkiadaki , Deepak Pathak

Diffusion models for Text-to-Image (T2I) conditional generation have recently achieved tremendous success. Yet, aligning these models with user's intentions still involves a laborious trial-and-error process, and this challenging alignment…

Machine Learning · Computer Science 2025-02-12 Chao Wang , Giulio Franzese , Alessandro Finamore , Massimo Gallo , Pietro Michiardi

Progress in Text-to-Image (T2I) models has significantly improved the generation of images from textual descriptions. However, existing evaluation metrics do not adequately assess the models' ability to handle a diverse range of textual…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Jingtao Cao , Zheng Zhang , Hongru Wang , Kam-Fai Wong

Recent large-scale text-driven synthesis models have attracted much attention thanks to their remarkable capabilities of generating highly diverse images that follow given text prompts. Such text-based synthesis methods are particularly…

Computer Vision and Pattern Recognition · Computer Science 2022-08-03 Amir Hertz , Ron Mokady , Jay Tenenbaum , Kfir Aberman , Yael Pritch , Daniel Cohen-Or

Reward models (RMs) are inherently non-neutral value functions designed and trained to encode specific objectives, such as human preferences or text-image alignment. RMs have become crucial components of text-to-image (T2I) generation…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Salma Abdel Magid , Grace Guo , Esin Tureci , Amaya Dharmasiri , Vikram V. Ramaswamy , Hanspeter Pfister , Olga Russakovsky

We investigate the generation of minority samples using pretrained text-to-image (T2I) latent diffusion models. Minority instances, in the context of T2I generation, can be defined as ones living on low-density regions of text-conditional…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Soobin Um , Jong Chul Ye

Text-to-image generation models~(e.g., Stable Diffusion) have achieved significant advancements, enabling the creation of high-quality and realistic images based on textual descriptions. Prompt inversion, the task of identifying the textual…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Mingzhe Li , Kejing Xia , Gehao Zhang , Zhenting Wang , Guanhong Tao , Siqi Pan , Juan Zhai , Shiqing Ma

In creativity support and computational co-creativity contexts, the task of discovering appropriate prompts for use with text-to-image generative models remains difficult. In many cases the creator wishes to evoke a certain impression with…

Artificial Intelligence · Computer Science 2023-02-21 Francisco Ibarrola , Rohan Lulham , Kazjon Grace

Text-to-image models, which can generate high-quality images based on textual input, have recently enabled various content-creation tools. Despite significantly affecting a wide range of downstream applications, the distributions of these…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Yanzhe Zhang , Lu Jiang , Greg Turk , Diyi Yang