English
Related papers

Related papers: Ensuring Visual Commonsense Morality for Text-to-I…

200 papers

Text-to-image generative models have enabled high-resolution image synthesis across different domains, but require users to specify the content they wish to generate. In this paper, we consider the inverse problem -- given a collection of…

Computer Vision and Pattern Recognition · Computer Science 2023-08-04 Nan Liu , Yilun Du , Shuang Li , Joshua B. Tenenbaum , Antonio Torralba

This survey reviews the progress of diffusion models in generating images from text, ~\textit{i.e.} text-to-image diffusion models. As a self-contained work, this survey starts with a brief introduction of how diffusion models work for…

Computer Vision and Pattern Recognition · Computer Science 2024-11-11 Chenshuang Zhang , Chaoning Zhang , Mengchun Zhang , In So Kweon , Junmo Kim

Text-guided synthesis of images has made a giant leap towards becoming a mainstream phenomenon. With text-to-image generation systems, anybody can create digital images and artworks. This provokes the question of whether text-to-image…

Human-Computer Interaction · Computer Science 2022-11-01 Jonas Oppenlaender

Text-to-image generation intends to automatically produce a photo-realistic image, conditioned on a textual description. It can be potentially employed in the field of art creation, data augmentation, photo-editing, etc. Although many…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Zhenxing Zhang , Lambert Schomaker

State-of-the-art Text-to-Image models like Stable Diffusion and DALLE$\cdot$2 are revolutionizing how people generate visual content. At the same time, society has serious concerns about how adversaries can exploit such models to generate…

Computer Vision and Pattern Recognition · Computer Science 2023-08-17 Yiting Qu , Xinyue Shen , Xinlei He , Michael Backes , Savvas Zannettou , Yang Zhang

Text-to-image synthesis aims to automatically generate images according to text descriptions given by users, which is a highly challenging task. The main issues of text-to-image synthesis lie in two gaps: the heterogeneous and homogeneous…

Computer Vision and Pattern Recognition · Computer Science 2018-08-22 Mingkuan Yuan , Yuxin Peng

Text-to-image generation has shown remarkable progress with the emergence of diffusion models. However, these models often generate factually inconsistent images, failing to accurately reflect the factual information and common sense…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Youngsun Lim , Hyunjung Shim

Previous text-to-image synthesis algorithms typically use explicit textual instructions to generate/manipulate images accurately, but they have difficulty adapting to guidance in the form of coarsely matched texts. In this work, we attempt…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Mengyao Cui , Zhe Zhu , Shao-Ping Lu , Yulu Yang

In recent years, text-to-image (T2I) generation models have made significant progress in generating high-quality images that align with text descriptions. However, these models also face the risk of unsafe generation, potentially producing…

Cryptography and Security · Computer Science 2025-04-16 Huming Qiu , Guanxu Chen , Mi Zhang , Xiaohan Zhang , Xiaoyu You , Min Yang

Text to Image Synthesis refers to the process of automatic generation of a photo-realistic image starting from a given text and is revolutionizing many real-world applications. In order to perform such process it is necessary to exploit…

Machine Learning · Computer Science 2019-10-10 Marco Menardi , Alex Falcon , Saida S. Mohamed , Lorenzo Seidenari , Giuseppe Serra , Alberto Del Bimbo , Carlo Tasso

Evaluating text-to-image generative models remains a challenge, despite the remarkable progress being made in their overall performances. While existing metrics like CLIPScore work for coarse evaluations, they lack the sensitivity to…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Georgia Gabriela Sampaio , Ruixiang Zhang , Shuangfei Zhai , Jiatao Gu , Josh Susskind , Navdeep Jaitly , Yizhe Zhang

Text-to-image generative models have achieved unprecedented success in generating high-quality images based on natural language descriptions. However, it is shown that these models tend to favor specific social groups when prompted with…

Computation and Language · Computer Science 2022-10-28 Hritik Bansal , Da Yin , Masoud Monajatipoor , Kai-Wei Chang

Training multimodal generative models on large, uncurated datasets can result in users being exposed to harmful, unsafe and controversial or culturally-inappropriate outputs. While model editing has been proposed to remove or filter…

Computer Vision and Pattern Recognition · Computer Science 2025-03-06 Jordan Vice , Naveed Akhtar , Mubarak Shah , Richard Hartley , Ajmal Mian

AI-based text-to-image models do not only excel at generating realistic images, they also give designers more and more fine-grained control over the image content. Consequently, these approaches have gathered increased attention within the…

Computer Vision and Pattern Recognition · Computer Science 2025-01-30 Sebastian Hartwig , Dominik Engel , Leon Sick , Hannah Kniesel , Tristan Payer , Poonam Poonam , Michael Glöckler , Alex Bäuerle , Timo Ropinski

We develop an approach for text-to-image generation that embraces additional retrieval images, driven by a combination of implicit visual guidance loss and generative objectives. Unlike most existing text-to-image generation methods which…

Computer Vision and Pattern Recognition · Computer Science 2022-08-19 Xin Yuan , Zhe Lin , Jason Kuen , Jianming Zhang , John Collomosse

The goal of this paper is to embed controllable factors, i.e., natural language descriptions, into image-to-image translation with generative adversarial networks, which allows text descriptions to determine the visual attributes of…

Computer Vision and Pattern Recognition · Computer Science 2020-02-14 Bowen Li , Xiaojuan Qi , Philip H. S. Torr , Thomas Lukasiewicz

Text-to-image generation is conducted through Generative Adversarial Networks (GANs) or transformer models. However, the current challenge lies in accurately generating images based on textual descriptions, especially in scenarios where the…

Human-Computer Interaction · Computer Science 2024-01-10 Yang Li , Huaqiang Jiang , Yangkai Wu

Typical methods for text-to-image synthesis seek to design effective generative architecture to model the text-to-image mapping directly. It is fairly arduous due to the cross-modality translation. In this paper we circumvent this problem…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Jiadong Liang , Wenjie Pei , Feng Lu

Text-to-image diffusion models have been adopted into key commercial workflows, such as art generation and image editing. Characterising the implicit social biases they exhibit, such as gender and racial stereotypes, is a necessary first…

Computers and Society · Computer Science 2023-12-19 Adhithya Prakash Saravanan , Rafal Kocielnik , Roy Jiang , Pengrui Han , Anima Anandkumar

The burgeoning landscape of text-to-image models, exemplified by innovations such as Midjourney and DALLE 3, has revolutionized content creation across diverse sectors. However, these advancements bring forth critical ethical concerns,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Yuzhu Cai , Sheng Yin , Yuxi Wei , Chenxin Xu , Weibo Mao , Felix Juefei-Xu , Siheng Chen , Yanfeng Wang