中文
相关论文

相关论文: Efficient Neural Architecture for Text-to-Image Sy…

200 篇论文

We study the problem of synthesizing immersive 3D indoor scenes from one or more images. Our aim is to generate high-resolution images and videos from novel viewpoints, including viewpoints that extrapolate far beyond the input images while…

计算机视觉与模式识别 · 计算机科学 2022-12-02 Jing Yu Koh , Harsh Agrawal , Dhruv Batra , Richard Tucker , Austin Waters , Honglak Lee , Yinfei Yang , Jason Baldridge , Peter Anderson

In this paper, we propose a novel controllable text-to-image generative adversarial network (ControlGAN), which can effectively synthesise high-quality images and also control parts of the image generation according to natural language…

计算机视觉与模式识别 · 计算机科学 2019-12-20 Bowen Li , Xiaojuan Qi , Thomas Lukasiewicz , Philip H. S. Torr

Generative Adversarial Networks (GANs) have been extremely successful in various application domains such as computer vision, medicine, and natural language processing. Moreover, transforming an object or person to a desired shape become a…

计算机视觉与模式识别 · 计算机科学 2020-12-29 Pourya Shamsolmoali , Masoumeh Zareapoor , Eric Granger , Huiyu Zhou , Ruili Wang , M. Emre Celebi , Jie Yang

Text-to-image generation has traditionally focused on finding better modeling assumptions for training on a fixed dataset. These assumptions might involve complex architectures, auxiliary losses, or side information such as object part…

计算机视觉与模式识别 · 计算机科学 2021-03-02 Aditya Ramesh , Mikhail Pavlov , Gabriel Goh , Scott Gray , Chelsea Voss , Alec Radford , Mark Chen , Ilya Sutskever

Internal learning for single-image generation is a framework, where a generator is trained to produce novel images based on a single image. Since these models are trained on a single image, they are limited in their scale and application.…

计算机视觉与模式识别 · 计算机科学 2021-10-07 Raphael Bensadoun , Shir Gur , Tomer Galanti , Lior Wolf

Synthesizing high-quality images from text descriptions is a challenging problem in computer vision and has many practical applications. Samples generated by existing text-to-image approaches can roughly reflect the meaning of the given…

计算机视觉与模式识别 · 计算机科学 2017-08-08 Han Zhang , Tao Xu , Hongsheng Li , Shaoting Zhang , Xiaogang Wang , Xiaolei Huang , Dimitris Metaxas

Image-to-image translation is significant to many computer vision and machine learning tasks such as image synthesis and video synthesis. It has primary applications in the graphics editing and animation industries. With the development of…

计算机视觉与模式识别 · 计算机科学 2019-12-17 Heng Wang , Donghao Zhang , Yang Song , Heng Huang , Mei Chen , Weidong Cai

Generative models are widely employed to enhance the photorealism of visual synthetic data for training computer vision algorithms. However, they often introduce visual artifacts that degrade the accuracy of these algorithms and require…

计算机视觉与模式识别 · 计算机科学 2026-03-19 Stefanos Pasios , Nikos Nikolaidis

In this paper, we propose a novel generative network (SegAttnGAN) that utilizes additional segmentation information for the text-to-image synthesis task. As the segmentation data introduced to the model provides useful guidance on the…

计算机视觉与模式识别 · 计算机科学 2020-05-27 Yuchuan Gou , Qiancheng Wu , Minghao Li , Bo Gong , Mei Han

Image translation is a burgeoning field in computer vision where the goal is to learn the mapping between an input image and an output image. However, most recent methods require multiple generators for modeling different domain mappings,…

计算机视觉与模式识别 · 计算机科学 2020-04-20 Xiaoming Yu , Xing Cai , Zhenqiang Ying , Thomas Li , Ge Li

Accurate interpretation and visual representation of complex prompts involving multiple objects, attributes, and spatial relationships is a critical challenge in text-to-image synthesis. Despite recent advancements in generating…

计算机视觉与模式识别 · 计算机科学 2026-02-11 Hirunima Jayasekara , Chuong Huynh , Yixuan Ren , Christabel Acquaye , Abhinav Shrivastava

We describe a new approach that improves the training of generative adversarial nets (GANs) for synthesizing diverse images from a text input. Our approach is based on the conditional version of GANs and expands on previous work leveraging…

计算机视觉与模式识别 · 计算机科学 2019-02-07 Miriam Cha , Youngjune L. Gwon , H. T. Kung

A picture is worth a thousand words, thus, it is crucial for conversational agents to understand, perceive, and effectively respond with pictures. However, we find that directly employing conventional image generation techniques is…

计算与语言 · 计算机科学 2024-02-09 Xiaowen Sun , Jiazhan Feng , Yuxuan Wang , Yuxuan Lai , Xingyu Shen , Dongyan Zhao

Generative Adversarial Networks (GANs) have been extremely successful in various application domains. Adversarial image synthesis has drawn increasing attention and made tremendous progress in recent years because of its wide range of…

计算机视觉与模式识别 · 计算机科学 2021-07-19 William Roy , Glen Kelly , Robert Leer , Frederick Ricardo

In this paper, we propose a way of synthesizing realistic images directly with natural language description, which has many useful applications, e.g. intelligent image manipulation. We attempt to accomplish such synthesis: given a source…

计算机视觉与模式识别 · 计算机科学 2017-07-24 Hao Dong , Simiao Yu , Chao Wu , Yike Guo

In recent years, the use of deep learning is becoming increasingly popular in computer vision. However, the effective training of deep architectures usually relies on huge sets of annotated data. This is critical in the medical field where…

图像与视频处理 · 电气工程与系统科学 2019-07-30 Paolo Andreini , Simone Bonechi , Monica Bianchini , Alessandro Mecocci , Franco Scarselli , Andrea Sodi

It's useful to automatically transform an image from its original form to some synthetic form (style, partial contents, etc.), while keeping the original structure or semantics. We define this requirement as the "image-to-image translation"…

计算机视觉与模式识别 · 计算机科学 2017-01-11 Hao Dong , Paarth Neekhara , Chao Wu , Yike Guo

Text-to-image generation models have progressed considerably in recent years, which can now generate impressive realistic images from arbitrary text. Most of such models are trained on web-scale image-text paired datasets, which may not be…

计算机视觉与模式识别 · 计算机科学 2022-10-26 Yufan Zhou , Chunyuan Li , Changyou Chen , Jianfeng Gao , Jinhui Xu

This survey reviews the progress of diffusion models in generating images from text, ~\textit{i.e.} text-to-image diffusion models. As a self-contained work, this survey starts with a brief introduction of how diffusion models work for…

计算机视觉与模式识别 · 计算机科学 2024-11-11 Chenshuang Zhang , Chaoning Zhang , Mengchun Zhang , In So Kweon , Junmo Kim

The goal of a speech-to-image transform is to produce a photo-realistic picture directly from a speech signal. Recently, various studies have focused on this task and have achieved promising performance. However, current speech-to-image…

计算机视觉与模式识别 · 计算机科学 2023-05-18 Zhenxing Zhang , Lambert Schomaker