English
Related papers

Related papers: A Friendly Face: Do Text-to-Image Systems Rely on …

200 papers

While stereotypes are well-documented in human social interactions, AI systems are often presumed to be less susceptible to such biases. Previous studies have focused on biases inherited from training data, but whether stereotypes can…

Computation and Language · Computer Science 2026-02-18 Jingyu Guo , Yingying Xu

While vision-language models (VLMs) have achieved remarkable performance improvements recently, there is growing evidence that these models also posses harmful biases with respect to social attributes such as gender and race. Prior studies…

Computer Vision and Pattern Recognition · Computer Science 2023-10-05 Phillip Howard , Avinash Madasu , Tiep Le , Gustavo Lujan Moreno , Vasudev Lal

The rapid adoption of text-to-image diffusion models in society underscores an urgent need to address their biases. Without interventions, these biases could propagate a skewed worldview and restrict opportunities for minority groups. In…

Machine Learning · Computer Science 2024-03-18 Xudong Shen , Chao Du , Tianyu Pang , Min Lin , Yongkang Wong , Mohan Kankanhalli

In this work, we systematically study the problem of personalized text-to-image generation, where the output image is expected to portray information about specific human subjects. E.g., generating images of oneself appearing at imaginative…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Panos Achlioptas , Alexandros Benetatos , Iordanis Fostiropoulos , Dimitris Skourtis

Text-to-image generation models that generate images based on prompt descriptions have attracted an increasing amount of attention during the past few months. Despite their encouraging performance, these models raise concerns about the…

Cryptography and Security · Computer Science 2023-01-10 Zeyang Sha , Zheng Li , Ning Yu , Yang Zhang

Large language models (LLMs) are widely applied across diverse domains, raising concerns about their limitations and potential risks. In this study, we investigate two types of bias that LLMs may display: stereotype bias and deviation bias.…

Computation and Language · Computer Science 2026-05-20 Daniel Wang , Eli Brignac , Minjia Mao , Xiao Fang

Recent advances in generative AI have enabled visual content creation through text-to-image (T2I) generation. However, despite their creative potential, T2I models often replicate and amplify societal stereotypes -- particularly those…

Human-Computer Interaction · Computer Science 2025-05-28 Saharsh Barve , Andy Mao , Jiayue Melissa Shi , Prerna Juneja , Koustuv Saha

The increasing tendency to collect large and uncurated datasets to train vision-and-language models has raised concerns about fair representations. It is known that even small but manually annotated datasets, such as MSCOCO, are affected by…

Computer Vision and Pattern Recognition · Computer Science 2023-04-07 Noa Garcia , Yusuke Hirota , Yankun Wu , Yuta Nakashima

As machine learning methods are deployed in real-world settings such as healthcare, legal systems, and social science, it is crucial to recognize how they shape social biases and stereotypes in these sensitive decision-making processes.…

Computation and Language · Computer Science 2021-06-25 Paul Pu Liang , Chiyu Wu , Louis-Philippe Morency , Ruslan Salakhutdinov

Recent text-conditioned image generation models have demonstrated an exceptional capacity to produce diverse and creative imagery with high visual quality. However, when pre-trained on billion-sized datasets randomly collected from the…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Yue Jiang , Yueming Lyu , Tianxiang Ma , Bo Peng , Jing Dong

In recent times, there have been increasing accusations on artificial intelligence systems and algorithms of computer vision of possessing implicit biases. Even though these conversations are more prevalent now and systems are improving by…

Computer Vision and Pattern Recognition · Computer Science 2020-11-30 Sharadha Srinivasan , Madan Musuvathi

Societal bias towards certain communities is a big problem that affects a lot of machine learning systems. This work aims at addressing the racial bias present in many modern gender recognition systems. We learn race invariant…

Machine Learning · Computer Science 2019-11-21 Komal K. Teru , Aishik Chakraborty

Generative AI is an emerging technology that will have a profound impact on society and individuals. Only a decade ago, it was thought that creative work would be among the last to be automated - yet today, we see AI encroaching on creative…

Human-Computer Interaction · Computer Science 2023-05-03 Jonas Oppenlaender , Aku Visuri , Ville Paananen , Rhema Linder , Johanna Silvennoinen

Text-to-image generation models have grown in popularity due to their ability to produce high-quality images from a text prompt. One use for this technology is to enable the creation of more accessible art creation software. In this paper,…

Human-Computer Interaction · Computer Science 2023-09-06 Atieh Taheri , Mohammad Izadi , Gururaj Shriram , Negar Rostamzadeh , Shaun Kane

The past few years have witnessed renewed interest in NLP tasks at the interface between vision and language. One intensively-studied problem is that of automatically generating text from images. In this paper, we extend this problem to the…

Text-to-image models are known to propagate social biases. For example, when prompted to generate images of people in certain professions, these models tend to systematically generate specific genders or ethnicities. In this paper, we show…

Computation and Language · Computer Science 2024-10-25 Guorun Wang , Lucia Specia

Bias in text-to-image (T2I) models can propagate unfair social representations and may be used to aggressively market ideas or push controversial agendas. Existing T2I model bias evaluation methods only focus on social biases. We look…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Jordan Vice , Naveed Akhtar , Richard Hartley , Ajmal Mian

Questions regarding implicitness, ambiguity and underspecification are crucial for understanding the task validity and ethical concerns of multimodal image+text systems, yet have received little attention to date. This position paper maps…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Ben Hutchinson , Jason Baldridge , Vinodkumar Prabhakaran

This survey reviews the progress of diffusion models in generating images from text, ~\textit{i.e.} text-to-image diffusion models. As a self-contained work, this survey starts with a brief introduction of how diffusion models work for…

Computer Vision and Pattern Recognition · Computer Science 2024-11-11 Chenshuang Zhang , Chaoning Zhang , Mengchun Zhang , In So Kweon , Junmo Kim

Text-guided synthesis of images has made a giant leap towards becoming a mainstream phenomenon. With text-to-image generation systems, anybody can create digital images and artworks. This provokes the question of whether text-to-image…

Human-Computer Interaction · Computer Science 2022-11-01 Jonas Oppenlaender