English
Related papers

Related papers: Civiverse: A Dataset for Analyzing User Engagement…

200 papers

Effective communication is central to achieving positive healthcare outcomes in mental health contexts, yet international students often face linguistic and cultural barriers that hinder their communication of mental distress. In this…

Neurons and Cognition · Quantitative Biology 2025-12-05 Sui He , Shenbin Qian

With recent advancements in diffusion models, users can generate high-quality images by writing text prompts in natural language. However, generating images with desired details requires proper prompts, and it is often unclear how a model…

Computer Vision and Pattern Recognition · Computer Science 2023-07-07 Zijie J. Wang , Evan Montoya , David Munechika , Haoyang Yang , Benjamin Hoover , Duen Horng Chau

Recently, diffusion-based deep generative models (e.g., Stable Diffusion) have shown impressive results in text-to-image synthesis. However, current text-to-image models often require multiple passes of prompt engineering by humans in order…

Computation and Language · Computer Science 2023-11-14 Tingfeng Cao , Chengyu Wang , Bingyan Liu , Ziheng Wu , Jinhui Zhu , Jun Huang

Generative text-to-image models have gained great popularity among the public for their powerful capability to generate high-quality images based on natural language prompts. However, developing effective prompts for desired images can be…

Artificial Intelligence · Computer Science 2023-11-02 Yingchaojie Feng , Xingbo Wang , Kam Kwai Wong , Sijia Wang , Yuhong Lu , Minfeng Zhu , Baicheng Wang , Wei Chen

The stories and characters that captivate us as we grow up shape unique fantasy worlds, with images serving as the primary medium for visually experiencing these realms. Personalizing generative models through fine-tuning with…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Yuxin Zhang , Minyan Luo , Weiming Dong , Xiao Yang , Haibin Huang , Chongyang Ma , Oliver Deussen , Tong-Yee Lee , Changsheng Xu

Generative AI for the creation of images is becoming a staple in the toolkit of digital artists and visual designers. The interaction with these systems is mediated by \emph{prompting}, a process in which users write a short text to…

Computers and Society · Computer Science 2024-02-20 Maddalena Torricelli , Mauro Martino , Andrea Baronchelli , Luca Maria Aiello

Text-to-image generation models that generate images based on prompt descriptions have attracted an increasing amount of attention during the past few months. Despite their encouraging performance, these models raise concerns about the…

Cryptography and Security · Computer Science 2023-01-10 Zeyang Sha , Zheng Li , Ning Yu , Yang Zhang

This paper introduces the "CIVICS: Culturally-Informed & Values-Inclusive Corpus for Societal impacts" dataset, designed to evaluate the social and cultural variation of Large Language Models (LLMs) across multiple languages and…

Computation and Language · Computer Science 2024-05-24 Giada Pistilli , Alina Leidinger , Yacine Jernite , Atoosa Kasirzadeh , Alexandra Sasha Luccioni , Margaret Mitchell

Current text-to-image generative models struggle to accurately represent object states (e.g., "a table without a bottle," "an empty tumbler"). In this work, we first design a fully-automatic pipeline to generate high-quality synthetic data…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Tianle Chen , Chaitanya Chakka , Deepti Ghadiyaram

Text-to-image (T2I) models, such as Stable Diffusion, have exhibited remarkable performance in generating high-quality images from text descriptions in recent years. However, text-to-image models may be tricked into generating…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Xinfeng Li , Yuchen Yang , Jiangyi Deng , Chen Yan , Yanjiao Chen , Xiaoyu Ji , Wenyuan Xu

Text-to-image (T2I) models have rapidly advanced, enabling the generation of high-quality images from text prompts across various domains. However, these models present notable safety concerns, including the risk of generating harmful,…

Computation and Language · Computer Science 2025-07-28 Lijun Li , Zhelun Shi , Xuhao Hu , Bowen Dong , Yiran Qin , Xihui Liu , Lu Sheng , Jing Shao

The biases exhibited by text-to-image (TTI) models are often treated as independent, though in reality, they may be deeply interrelated. Addressing bias along one dimension - such as ethnicity or age - can inadvertently affect another, like…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Pushkar Shukla , Aditya Chinchure , Emily Diana , Alexander Tolbert , Kartik Hosanagar , Vineeth N Balasubramanian , Leonid Sigal , Matthew Turk

The ability to collect a large dataset of human preferences from text-to-image users is usually limited to companies, making such datasets inaccessible to the public. To address this issue, we create a web app that enables text-to-image…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Yuval Kirstain , Adam Polyak , Uriel Singer , Shahbuland Matiana , Joe Penna , Omer Levy

Recent text-to-image models can generate high-quality images from natural-language prompts, yet controlling typography remains challenging: requested typographic appearance is often ignored or only weakly followed. We address this…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Xia Xin , Yuki Endo , Yoshihiro Kanamori

Text-to-image models take a sentence (i.e., prompt) and generate images associated with this input prompt. These models have created award wining-art, videos, and even synthetic datasets. However, text-to-image (T2I) models can generate…

Computation and Language · Computer Science 2023-06-12 Alexander Lin , Lucas Monteiro Paes , Sree Harsha Tanneru , Suraj Srinivas , Himabindu Lakkaraju

Generative AI has enabled novice designers to quickly create professional-looking visual representations for product concepts. However, novices have limited domain knowledge that could constrain their ability to write prompts that…

Human-Computer Interaction · Computer Science 2026-03-30 Sirui Tao , Ivan Liang , Cindy Peng , Zhiqing Wang , Srishti Palani , Steven P. Dow

It has been shown that many generative models inherit and amplify societal biases. To date, there is no uniform/systematic agreed standard to control/adjust for these biases. This study examines the presence and manipulation of societal…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Philip Wootaek Shin , Jihyun Janice Ahn , Wenpeng Yin , Jack Sampson , Vijaykrishnan Narayanan

The rapid proliferation of multimodal generative models has sparked critical discussions on their reliability, fairness and potential for misuse. While text-to-image models excel at producing high-fidelity, user-guided content, they often…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Jordan Vice , Naveed Akhtar , Leonid Sigal , Richard Hartley , Ajmal Mian

Novel research aimed at text-to-image (T2I) generative AI safety often relies on publicly available datasets for training and evaluation, making the quality and composition of these datasets crucial. This paper presents a comprehensive…

Computation and Language · Computer Science 2025-03-04 Rakeen Rouf , Trupti Bavalatti , Osama Ahmed , Dhaval Potdar , Faraz Jawed

We provide a new multi-task benchmark for evaluating text-to-image models. We perform a human evaluation comparing the most common open-source (Stable Diffusion) and commercial (DALL-E 2) models. Twenty computer science AI graduate students…