English
Related papers

Related papers: OpenBias: Open-set Bias Detection in Text-to-Image…

200 papers

Text-to-Image Diffusion Models such as Stable-Diffusion and Imagen have achieved unprecedented quality of photorealism with state-of-the-art FID scores on MS-COCO and other generation benchmarks. Given a caption, image generation requires…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Samyadeep Basu , Nanxuan Zhao , Vlad Morariu , Soheil Feizi , Varun Manjunatha

In the last two years, text-to-image diffusion models have become extremely popular. As their quality and usage increase, a major concern has been the need for better output control. In addition to prompt engineering, one effective method…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Clément Bonnet , Ariel N. Lee , Franck Wertel , Antoine Tamano , Tanguy Cizain , Pablo Ducru

Due to the high potential for abuse of GenAI systems, the task of detecting synthetic images has recently become of great interest to the research community. Unfortunately, existing image-space detectors quickly become obsolete as new…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 George Cazenavette , Avneesh Sud , Thomas Leung , Ben Usman

Creating high-quality and realistic images is now possible thanks to the impressive advancements in image generation. A description in natural language of your desired output is all you need to obtain breathtaking results. However, as the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Giuseppe Cartella , Vittorio Cuculo , Marcella Cornia , Rita Cucchiara

As text-to-image systems continue to grow in popularity with the general public, questions have arisen about bias and diversity in the generated images. Here, we investigate properties of images generated in response to prompts which are…

Computers and Society · Computer Science 2023-02-15 Kathleen C. Fraser , Svetlana Kiritchenko , Isar Nejadgholi

Diffusion models (DMs) have become the new trend of generative models and have demonstrated a powerful ability of conditional synthesis. Among those, text-to-image diffusion models pre-trained on large-scale image-text pairs are highly…

Computer Vision and Pattern Recognition · Computer Science 2023-03-06 Wenliang Zhao , Yongming Rao , Zuyan Liu , Benlin Liu , Jie Zhou , Jiwen Lu

This paper examines potential biases and inconsistencies in emotional evocation of images produced by generative artificial intelligence (AI) models and their potential bias toward negative emotions. In particular, we assess this bias by…

Computers and Society · Computer Science 2024-12-17 Maneet Mehta , Cody Buntain

Large Language Models (LLMs) inherit explicit and implicit biases from their training datasets. Identifying and mitigating biases in LLMs is crucial to ensure fair outputs, as they can perpetuate harmful stereotypes and misinformation. This…

Machine Learning · Computer Science 2025-11-19 Fatima Kazi , Alex Young , Yash Inani , Setareh Rafatirad

Text-to-Image (T2I) generation models have been widely adopted across various industries, yet are criticized for frequently exhibiting societal stereotypes. While a growing body of research has emerged to evaluate and mitigate these biases,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Megan Smith , Venkatesh Thirugnana Sambandham , Florian Richter , Laura Crompton , Matthias Uhl , Torsten Schön

Detecting biases in the outputs produced by generative models is essential to reduce the potential risks associated with their application in critical settings. However, the majority of existing methodologies for identifying biases in…

Computation and Language · Computer Science 2025-02-04 Erica Coppolillo , Giuseppe Manco , Luca Maria Aiello

Addressing biases in computer vision models is crucial for real-world AI deployments. However, mitigating visual biases is challenging due to their unexplainable nature, often identified indirectly through visualization or sample…

Machine Learning · Computer Science 2024-03-28 Younghyun Kim , Sangwoo Mo , Minkyu Kim , Kyungmin Lee , Jaeho Lee , Jinwoo Shin

This research focuses on the development and enhancement of text-to-image denoising diffusion models, addressing key challenges such as limited sample diversity and training instability. By incorporating Classifier-Free Guidance (CFG) and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-10 Rajdeep Roshan Sahu

A plethora of text-guided image editing methods has recently been developed by leveraging the impressive capabilities of large-scale diffusion-based generative models especially Stable Diffusion. Despite the success of diffusion models in…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Qihe Pan , Zhen Zhao , Zicheng Wang , Sifan Long , Yiming Wu , Wei Ji , Haoran Liang , Ronghua Liang

Large-scale text-to-image diffusion models have made amazing advances. However, the status quo is to use text input alone, which can impede controllability. In this work, we propose GLIGEN, Grounded-Language-to-Image Generation, a novel…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Yuheng Li , Haotian Liu , Qingyang Wu , Fangzhou Mu , Jianwei Yang , Jianfeng Gao , Chunyuan Li , Yong Jae Lee

Taking advantage of the many recent advances in deep learning, text-to-image generative models currently have the merit of attracting the general public attention. Two of these models, DALL-E 2 and Imagen, have demonstrated that highly…

Computer Vision and Pattern Recognition · Computer Science 2022-09-23 Robin Zbinden

Text-to-image models take a sentence (i.e., prompt) and generate images associated with this input prompt. These models have created award wining-art, videos, and even synthetic datasets. However, text-to-image (T2I) models can generate…

Computation and Language · Computer Science 2023-06-12 Alexander Lin , Lucas Monteiro Paes , Sree Harsha Tanneru , Suraj Srinivas , Himabindu Lakkaraju

Beam search is an effective and widely used decoding algorithm in many sequence-to-sequence (seq2seq) text generation tasks. However, in open-ended text generation, beam search is often found to produce repetitive and generic texts,…

Computation and Language · Computer Science 2020-05-25 Liang Wang , Jinlong Liu , Jingming Liu

Text-conditioned image generation models have recently shown immense qualitative success using denoising diffusion processes. However, unlike discriminative vision-and-language models, it is a non-trivial task to subject these…

Computer Vision and Pattern Recognition · Computer Science 2023-11-06 Benno Krojer , Elinor Poole-Dayan , Vikram Voleti , Christopher Pal , Siva Reddy

Text-to-image generative models have increasingly been used to assist designers during concept generation in various creative domains, such as graphic design, user interface design, and fashion design. However, their applications in…

Artificial Intelligence · Computer Science 2024-07-23 Leah Chong , Jude Rayan , Steven Dow , Ioanna Lykourentzou , Faez Ahmed

Diffusion models have become the go-to method for text-to-image generation, producing high-quality images from pure noise. However, the inner workings of diffusion models is still largely a mystery due to their black-box nature and complex,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Berk Tinaz , Zalan Fabian , Mahdi Soltanolkotabi