English
Related papers

Related papers: Image-to-Image Translation with Text Guidance

200 papers

The goal of text-to-image synthesis is to generate a visually realistic image that matches a given text description. In practice, the captions annotated by humans for the same image have large variance in terms of contents and the choice of…

Machine Learning · Computer Science 2021-11-30 Hui Ye , Xiulong Yang , Martin Takac , Rajshekhar Sunderraman , Shihao Ji

Image-to-image translation tasks have been widely investigated with Generative Adversarial Networks (GANs) and dual learning. However, existing models lack the ability to control the translated results in the target domain and their results…

Computer Vision and Pattern Recognition · Computer Science 2018-05-02 Jianxin Lin , Yingce Xia , Tao Qin , Zhibo Chen , Tie-Yan Liu

Text-to-image synthesis is the task of generating images from text descriptions. Image generation, by itself, is a challenging task. When we combine image generation and text, we bring complexity to a new level: we need to combine data from…

Machine Learning · Computer Science 2020-04-27 Douglas M. Souza , Jônatas Wehrmann , Duncan D. Ruiz

Unpaired image-to-image translation is a class of vision problems whose goal is to find the mapping between different image domains using unpaired training data. Cycle-consistency loss is a widely used constraint for such problems. However,…

Computer Vision and Pattern Recognition · Computer Science 2021-01-19 Yihao Zhao , Ruihai Wu , Hao Dong

Recently, a unified model for image-to-image translation tasks within adversarial learning framework has aroused widespread research interests in computer vision practitioners. Their reported empirical success however lacks solid…

Machine Learning · Statistics 2018-06-20 Xudong Pan , Mi Zhang , Daizong Ding

Previous text-to-image synthesis algorithms typically use explicit textual instructions to generate/manipulate images accurately, but they have difficulty adapting to guidance in the form of coarsely matched texts. In this work, we attempt…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Mengyao Cui , Zhe Zhu , Shao-Ping Lu , Yulu Yang

Current image-to-image translation methods formulate the task with conditional generation models, leading to learning only the recolorization or regional changes as being constrained by the rich structural information provided by the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-28 Yu-Jie Chen , Shin-I Cheng , Wei-Chen Chiu , Hung-Yu Tseng , Hsin-Ying Lee

This paper presents a novel method to manipulate the visual appearance (pose and attribute) of a person image according to natural language descriptions. Our method can be boiled down to two stages: 1) text guided pose generation and 2)…

Computer Vision and Pattern Recognition · Computer Science 2019-04-11 Xingran Zhou , Siyu Huang , Bin Li , Yingming Li , Jiachen Li , Zhongfei Zhang

Text-to-image generation is conducted through Generative Adversarial Networks (GANs) or transformer models. However, the current challenge lies in accurately generating images based on textual descriptions, especially in scenarios where the…

Human-Computer Interaction · Computer Science 2024-01-10 Yang Li , Huaqiang Jiang , Yangkai Wu

Image-to-image translation aims to learn a mapping between different groups of visually distinguishable images. While recent methods have shown impressive ability to change even intricate appearance of images, they still rely on domain…

Computer Vision and Pattern Recognition · Computer Science 2021-05-10 Hanbit Lee , Jinseok Seol , Sang-goo Lee

Attribute guided face image synthesis aims to manipulate attributes on a face image. Most existing methods for image-to-image translation can either perform a fixed translation between any two image domains using a single attribute or…

Computer Vision and Pattern Recognition · Computer Science 2019-05-02 Behzad Bozorgtabar , Mohammad Saeed Rad , Hazım Kemal Ekenel , Jean-Philippe Thiran

Text-to-image synthesis (T2I) aims to generate photo-realistic images which are semantically consistent with the text descriptions. Existing methods are usually built upon conditional generative adversarial networks (GANs) and initialize an…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Kai Hu , Wentong Liao , Michael Ying Yang , Bodo Rosenhahn

We introduce a memory-driven semi-parametric approach to text-to-image generation, which is based on both parametric and non-parametric techniques. The non-parametric component is a memory bank of image features constructed from a training…

Computer Vision and Pattern Recognition · Computer Science 2022-08-16 Bowen Li , Philip H. S. Torr , Thomas Lukasiewicz

In this paper, we propose a novel way to interpret text information by extracting visual feature presentation from multiple high-resolution and photo-realistic synthetic images generated by Text-to-image Generative Adversarial Network (GAN)…

Computer Vision and Pattern Recognition · Computer Science 2019-08-05 Tao Hu , Chengjiang Long , Leheng Zhang , Chunxia Xiao

Text-to-image diffusion models have emerged as powerful tools for high-quality image generation and editing. Many existing approaches rely on text prompts as editing guidance. However, these methods are constrained by the need for manual…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Yuanyuan Chang , Yinghua Yao , Tao Qin , Mengmeng Wang , Ivor Tsang , Guang Dai

Text-to-image generation intends to automatically produce a photo-realistic image, conditioned on a textual description. It can be potentially employed in the field of art creation, data augmentation, photo-editing, etc. Although many…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Zhenxing Zhang , Lambert Schomaker

Image to image translation is the problem of transferring an image from a source domain to a different (but related) target domain. We present a new unsupervised image to image translation technique that leverages the underlying semantic…

Computer Vision and Pattern Recognition · Computer Science 2021-03-02 Pravakar Roy , Nicolai Häni , Jun-Jee Chao , Volkan Isler

Image-to-image translation is a class of vision and graphics problems where the goal is to learn the mapping between an input image and an output image using a training set of aligned image pairs. However, for many tasks, paired training…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Jun-Yan Zhu , Taesung Park , Phillip Isola , Alexei A. Efros

Text-to-image synthesis aims to generate natural images conditioned on text descriptions. The main difficulty of this task lies in effectively fusing text information into the image synthesis process. Existing methods usually adaptively…

Computer Vision and Pattern Recognition · Computer Science 2022-04-25 Senmao Ye , Fei Liu , Minkui Tan

Manipulating visual attributes of images through human-written text is a very challenging task. On the one hand, models have to learn the manipulation without the ground truth of the desired output. On the other hand, models have to deal…

Computer Vision and Pattern Recognition · Computer Science 2020-08-11 Yahui Liu , Marco De Nadai , Deng Cai , Huayang Li , Xavier Alameda-Pineda , Nicu Sebe , Bruno Lepri