English
Related papers

Related papers: When Cultures Meet: Multicultural Text-to-Image Ge…

200 papers

Pretrained large language models have revolutionized many applications but still face challenges related to cultural bias and a lack of cultural commonsense knowledge crucial for guiding cross-culture communication and interactions.…

Computation and Language · Computer Science 2024-02-15 Yi Fung , Ruining Zhao , Jae Doo , Chenkai Sun , Heng Ji

Multimodal Large Language Models (MLLMs) have made significant strides in visual understanding and generation tasks. However, generating interleaved image-text content remains a challenge, which requires integrated multimodal understanding…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Pengfei Zhou , Xiaopeng Peng , Jiajun Song , Chuanhao Li , Zhaopan Xu , Yue Yang , Ziyao Guo , Hao Zhang , Yuqi Lin , Yefei He , Lirui Zhao , Shuo Liu , Tianhua Li , Yuxuan Xie , Xiaojun Chang , Yu Qiao , Wenqi Shao , Kaipeng Zhang

Text-conditioned image generation has gained significant attention in recent years and are processing increasingly longer and comprehensive text prompt. In everyday life, dense and intricate text appears in contexts like advertisements,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Alex Jinpeng Wang , Dongxing Mao , Jiawei Zhang , Weiming Han , Zhuobai Dong , Linjie Li , Yiqi Lin , Zhengyuan Yang , Libo Qin , Fuwei Zhang , Lijuan Wang , Min Li

The rapid advancement of Text-to-Image(T2I) generative models has enabled the synthesis of high-quality images guided by textual descriptions. Despite this significant progress, these models are often susceptible in generating contents that…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Yichen Sun , Zhixuan Chu , Zhan Qin , Kui Ren

Recent advances in Multimodal Large Language Models (MLLMs) have demonstrated impressive capabilities. However, evaluating their capacity for human-like understanding in One-Image Guides remains insufficiently explored. One-Image Guides are…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Jiancong Xie , Wenjin Wang , Zhuomeng Zhang , Zihan Liu , Qi Liu , Ke Feng , Zixun Sun , Yuedong Yang

Text-To-Image (TTI) models, such as DALL-E and StableDiffusion, have demonstrated remarkable prompt-based image generation capabilities. Multilingual encoders may have a substantial impact on the cultural agency of these models, as language…

Computation and Language · Computer Science 2024-08-14 Mor Ventura , Eyal Ben-David , Anna Korhonen , Roi Reichart

In a globalized world, cultural elements from diverse origins frequently appear together within a single visual scene. We refer to these as culture mixing scenarios, yet how Large Vision-Language Models (LVLMs) perceive them remains…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Eunsu Kim , Junyeong Park , Na Min An , Junseong Kim , Hitesh Laxmichand Patel , Jiho Jin , Julia Kruk , Amit Agarwal , Srikant Panda , Fenal Ashokbhai Ilasariya , Hyunjung Shim , Alice Oh

The increasing ubiquity of text-to-image (T2I) models as tools for visual content generation raises concerns about their ability to accurately represent diverse cultural contexts -- where missed cues can stereotype communities and undermine…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Shravan Nayak , Mehar Bhatia , Xiaofeng Zhang , Verena Rieser , Lisa Anne Hendricks , Sjoerd van Steenkiste , Yash Goyal , Karolina Stańczak , Aishwarya Agrawal

Text-to-image generative models often reflect the biases of the training data, leading to unequal representations of underrepresented groups. This study investigates inclusive text-to-image generative models that generate images based on…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Cheng Zhang , Xuanbai Chen , Siqi Chai , Chen Henry Wu , Dmitry Lagun , Thabo Beeler , Fernando De la Torre

Text-to-image generative models are a new and powerful way to generate visual artwork. However, the open-ended nature of text as interaction is double-edged; while users can input anything and have access to an infinite range of…

Human-Computer Interaction · Computer Science 2023-09-29 Vivian Liu , Lydia B. Chilton

Text-to-image diffusion models have recently enabled the creation of visually compelling, detailed images from textual prompts. However, their ability to accurately represent various cultural nuances remains an open question. In our work,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-26 Zahra Bayramli , Ayhan Suleymanzade , Na Min An , Huzama Ahmad , Eunsu Kim , Junyeong Park , James Thorne , Alice Oh

Text-to-image (T2I) models have garnered significant attention for generating high-quality images aligned with text prompts. However, rapid T2I model advancements reveal limitations in early benchmarks, lacking comprehensive evaluations,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-27 Jingjing Chang , Yixiao Fang , Peng Xing , Shuhan Wu , Wei Cheng , Rui Wang , Xianfang Zeng , Gang Yu , Hai-Bao Chen

Despite recent advancements in vision-language models, their performance remains suboptimal on images from non-western cultures due to underrepresentation in training datasets. Various benchmarks have been proposed to test models' cultural…

Computation and Language · Computer Science 2024-07-02 Mehar Bhatia , Sahithya Ravi , Aditya Chinchure , Eunjeong Hwang , Vered Shwartz

Large language models (LLMs) face challenges in aligning with diverse cultural values despite their remarkable performance in generation, which stems from inherent monocultural biases and difficulties in capturing nuanced cultural…

Computation and Language · Computer Science 2026-01-05 Jiahao Yuan , Zixiang Di , Shangzixin Zhao , Zhiqing Cui , Hanqing Wang , Guisong Yang , Usman Naseem

Recent developments in large language models (LLM) and generative AI have unleashed the astonishing capabilities of text-to-image generation systems to synthesize high-quality images that are faithful to a given reference text, known as a…

Human-Computer Interaction · Computer Science 2023-03-17 Yutong Xie , Zhaoying Pan , Jinge Ma , Luo Jie , Qiaozhu Mei

The recent advancements in text-to-image generative models have been remarkable. Yet, the field suffers from a lack of evaluation metrics that accurately reflect the performance of these models, particularly lacking fine-grained metrics…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Zhiyu Tan , Xiaomeng Yang , Luozheng Qin , Mengping Yang , Cheng Zhang , Hao Li

The field of advanced text-to-image generation is witnessing the emergence of unified frameworks that integrate powerful text encoders, such as CLIP and T5, with Diffusion Transformer backbones. Although there have been efforts to control…

Computer Vision and Pattern Recognition · Computer Science 2025-02-28 Liang Chen , Shuai Bai , Wenhao Chai , Weichu Xie , Haozhe Zhao , Leon Vinci , Junyang Lin , Baobao Chang

Infographics are composite visual artifacts that combine data visualizations with textual and illustrative elements to communicate information. While recent text-to-image (T2I) models can generate aesthetically appealing images, their…

Despite significant progress in generative AI, comprehensive evaluation remains challenging because of the lack of effective metrics and standardized benchmarks. For instance, the widely-used CLIPScore measures the alignment between a…

Computer Vision and Pattern Recognition · Computer Science 2024-06-19 Zhiqiu Lin , Deepak Pathak , Baiqi Li , Jiayao Li , Xide Xia , Graham Neubig , Pengchuan Zhang , Deva Ramanan

In recent years, Multimodal Large Language Models (MLLMs) have achieved remarkable progress on a wide range of multimodal benchmarks. Despite these advances, most existing benchmarks mainly focus on single-image or multi-image…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Bingli Wang , Huanze Tang , Haijun Lv , Zhishan Lin , Lixin Gu , Lei Feng , Qipeng Guo , Kai Chen