English
Related papers

Related papers: Text to Image Generation: Leaving no Language Behi…

200 papers

Text-to-image diffusion models have achieved widespread popularity due to their unprecedented image generation capability. In particular, their ability to synthesize and modify human faces has spurred research into using generated face…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Harrison Rosenberg , Shimaa Ahmed , Guruprasad V Ramesh , Ramya Korlakai Vinayak , Kassem Fawaz

Text-to-image generation (T2I) refers to the text-guided generation of high-quality images. In the past few years, T2I has attracted widespread attention and numerous works have emerged. In this survey, we comprehensively review 141 works…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Pengfei Yang , Ngai-Man Cheung , Xinda Ma

In this paper, we design and train a Generative Image-to-text Transformer, GIT, to unify vision-language tasks such as image/video captioning and question answering. While generative models provide a consistent network architecture between…

Computer Vision and Pattern Recognition · Computer Science 2022-12-19 Jianfeng Wang , Zhengyuan Yang , Xiaowei Hu , Linjie Li , Kevin Lin , Zhe Gan , Zicheng Liu , Ce Liu , Lijuan Wang

In recent years, the study of artificial intelligence (AI) has undergone a paradigm shift. This has been propelled by the groundbreaking capabilities of generative models both in supervised and unsupervised learning scenarios. Generative AI…

Machine Learning · Computer Science 2024-05-21 Sandeep Singh Sengar , Affan Bin Hasan , Sanjay Kumar , Fiona Carroll

As a challenging task, text-to-image generation aims to generate photo-realistic and semantically consistent images according to the given text descriptions. Existing methods mainly extract the text information from only one sentence to…

Computer Vision and Pattern Recognition · Computer Science 2022-09-29 Xintian Wu , Hanbin Zhao , Liangli Zheng , Shouhong Ding , Xi Li

Users interact with text, image, code, or other editors on a daily basis. However, machine learning models are rarely trained in the settings that reflect the interactivity between users and their editor. This is understandable as training…

Computation and Language · Computer Science 2023-11-14 Felix Faltings , Michel Galley , Baolin Peng , Kianté Brantley , Weixin Cai , Yizhe Zhang , Jianfeng Gao , Bill Dolan

Text-to-image generative models are capable of producing high-quality images that often faithfully depict concepts described using natural language. In this work, we comprehensively evaluate a range of text-to-image models on numerical…

Machine Learning · Computer Science 2025-02-07 Ivana Kajić , Olivia Wiles , Isabela Albuquerque , Matthias Bauer , Su Wang , Jordi Pont-Tuset , Aida Nematzadeh

Text-to-image synthesis is the task of generating images from text descriptions. Image generation, by itself, is a challenging task. When we combine image generation and text, we bring complexity to a new level: we need to combine data from…

Machine Learning · Computer Science 2020-04-27 Douglas M. Souza , Jônatas Wehrmann , Duncan D. Ruiz

There are obvious benefits to integrating generative AI (artificial intelligence) into language learning and teaching. Those include using AI as a language tutor, creating learning materials, or assessing learner output. However, due to how…

Computation and Language · Computer Science 2024-10-21 Robert Godwin-Jones`

Generative artificial intelligence (AI) is a widely popular technology that will have a profound impact on society and individuals. Less than a decade ago, it was thought that creative work would be among the last to be automated - yet…

Human-Computer Interaction · Computer Science 2023-08-21 Jonas Oppenlaender , Johanna Silvennoinen , Ville Paananen , Aku Visuri

Text-guided synthesis of images has made a giant leap towards becoming a mainstream phenomenon. With text-to-image generation systems, anybody can create digital images and artworks. This provokes the question of whether text-to-image…

Human-Computer Interaction · Computer Science 2022-11-01 Jonas Oppenlaender

Language grounded image understanding tasks have often been proposed as a method for evaluating progress in artificial intelligence. Ideally, these tasks should test a plethora of capabilities that integrate computer vision, reasoning, and…

Machine Learning · Computer Science 2019-05-28 Kushal Kafle , Robik Shrestha , Christopher Kanan

Customizing pre-trained text-to-image generation model has attracted massive research interest recently, due to its huge potential in real-world applications. Although existing methods are able to generate creative content for a novel…

Computer Vision and Pattern Recognition · Computer Science 2024-05-10 Yufan Zhou , Ruiyi Zhang , Jiuxiang Gu , Tong Sun

Recent developments in large language models (LLM) and generative AI have unleashed the astonishing capabilities of text-to-image generation systems to synthesize high-quality images that are faithful to a given reference text, known as a…

Human-Computer Interaction · Computer Science 2023-03-17 Yutong Xie , Zhaoying Pan , Jinge Ma , Luo Jie , Qiaozhu Mei

The recent progress of text-to-image generation has been recognized in architectural design. Our study is the first to investigate the potential of text-to-image generators in supporting creativity during the early stages of the…

Human-Computer Interaction · Computer Science 2024-01-17 Ville Paananen , Jonas Oppenlaender , Aku Visuri

English as foreign language_EFL_students' use of text generated from artificial intelligence_AI_natural language generation_NLG_tools may improve their writing quality. However, it remains unclear to what extent AI-generated text in these…

Computation and Language · Computer Science 2024-06-17 David James Woo , Hengky Susanto , Chi Ho Yeung , Kai Guo , April Ka Yeng Fung

In this work, we propose and assess the potential of generative artificial intelligence (AI) to generate public engagement around potential clean energy sources. Such an application could increase energy literacy -- an awareness of…

Computers and Society · Computer Science 2023-12-05 Veda Joynt , Jacob Cooper , Naman Bhargava , Katie Vu , O Hwang Kwon , Todd R. Allen , Aditi Verma , Majdi I. Radaideh

Text-to-image generation has traditionally focused on finding better modeling assumptions for training on a fixed dataset. These assumptions might involve complex architectures, auxiliary losses, or side information such as object part…

Computer Vision and Pattern Recognition · Computer Science 2021-03-02 Aditya Ramesh , Mikhail Pavlov , Gabriel Goh , Scott Gray , Chelsea Voss , Alec Radford , Mark Chen , Ilya Sutskever

The success of autoregressive (AR) language models in text generation has inspired the computer vision community to adopt Large Language Models (LLMs) for image generation. However, considering the essential differences between text and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Xuantong Liu , Shaozhe Hao , Xianbiao Qi , Tianyang Hu , Jun Wang , Rong Xiao , Yuan Yao

This paper addresses the problem of manipulating images using natural language description. Our task aims to semantically modify visual attributes of an object in an image according to the text describing the new visual appearance. Although…

Computer Vision and Pattern Recognition · Computer Science 2018-11-29 Seonghyeon Nam , Yunji Kim , Seon Joo Kim