English
Related papers

Related papers: Guided Image-to-Image Translation with Bi-Directio…

200 papers

Unsupervised image-to-image translation consists of learning a pair of mappings between two domains without known pairwise correspondences between points. The current convention is to approach this task with cycle-consistent GANs: using a…

Computer Vision and Pattern Recognition · Computer Science 2020-06-25 Matthew Amodio , Rim Assouel , Victor Schmidt , Tristan Sylvain , Smita Krishnaswamy , Yoshua Bengio

Recent studies have shown remarkable success in unsupervised image-to-image translation. However, if there has no access to enough images in target classes, learning a mapping from source classes to the target classes always suffers from…

Computer Vision and Pattern Recognition · Computer Science 2020-07-29 Yuanqi Chen , Xiaoming Yu , Shan Liu , Ge Li

Image captioning models generally lack the capability to take into account user interest, and usually default to global descriptions that try to balance readability, informativeness, and information overload. On the other hand, VQA models…

Computer Vision and Pattern Recognition · Computer Science 2021-11-12 Edwin G. Ng , Bo Pang , Piyush Sharma , Radu Soricut

Image-to-image (I2I) translation is a challenging topic in computer vision. We divide this problem into three tasks: strongly constrained translation, normally constrained translation, and weakly constrained translation. The constraint here…

Computer Vision and Pattern Recognition · Computer Science 2022-07-06 Weichen Fan , Jinghuan Chen , Jiabin Ma , Jun Hou , Shuai Yi

Unsupervised image-to-image translation methods learn to map images in a given class to an analogous image in a different class, drawing on unstructured (non-registered) datasets of images. While remarkably successful, current methods…

Computer Vision and Pattern Recognition · Computer Science 2019-09-10 Ming-Yu Liu , Xun Huang , Arun Mallya , Tero Karras , Timo Aila , Jaakko Lehtinen , Jan Kautz

Recently image-to-image translation has attracted significant interests in the literature, starting from the successful use of the generative adversarial network (GAN), to the introduction of cyclic constraint, to extensions to multiple…

Computer Vision and Pattern Recognition · Computer Science 2020-01-16 Zengming Shen , S. Kevin Zhou , Yifan Chen , Bogdan Georgescu , Xuqi Liu , Thomas S. Huang

In image fusion, images obtained from different sensors are fused to generate a single image with enhanced information. In recent years, state-of-the-art methods have adopted Convolution Neural Networks (CNNs) to encode meaningful features…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Vibashan VS , Jeya Maria Jose Valanarasu , Poojan Oza , Vishal M. Patel

Composed image retrieval searches for a target image based on a multi-modal user query comprised of a reference image and modification text describing the desired changes. Existing approaches to solving this challenging task learn a mapping…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Zheyuan Liu , Weixuan Sun , Yicong Hong , Damien Teney , Stephen Gould

We propose a novel model named Multi-Channel Attention Selection Generative Adversarial Network (SelectionGAN) for guided image-to-image translation, where we translate an input image into another while respecting an external semantic…

Computer Vision and Pattern Recognition · Computer Science 2022-10-07 Hao Tang , Philip H. S. Torr , Nicu Sebe

We propose a unified Generative Adversarial Network (GAN) for controllable image-to-image translation, i.e., transferring an image from a source to a target domain guided by controllable structures. In addition to conditioning on a…

Computer Vision and Pattern Recognition · Computer Science 2020-10-28 Hao Tang , Hong Liu , Nicu Sebe

Synthetic image translation has significant potentials in autonomous transportation systems. That is due to the expense of data collection and annotation as well as the unmanageable diversity of real-words situations. The main issue with…

Computer Vision and Pattern Recognition · Computer Science 2018-12-06 Sebastian Bujwid , Miquel Martí , Hossein Azizpour , Alessandro Pieropan

Given an input image from a source domain and a guidance image from a target domain, unsupervised many-to-many image-to-image (UMMI2I) translation methods seek to generate a plausible example from the target domain that preserves…

Computer Vision and Pattern Recognition · Computer Science 2021-08-23 Dina Bashkirova , Ben Usman , Kate Saenko

Recently there has been a rising interest in training agents, embodied in virtual environments, to perform language-directed tasks by deep reinforcement learning. In this paper, we propose a simple but effective neural language grounding…

Artificial Intelligence · Computer Science 2018-09-06 Haonan Yu , Xiaochen Lian , Haichao Zhang , Wei Xu

A self-driving car must be able to reliably handle adverse weather conditions (e.g., snowy) to operate safely. In this paper, we investigate the idea of turning sensor inputs (i.e., images) captured in an adverse condition into a benign one…

Computer Vision and Pattern Recognition · Computer Science 2022-09-26 Youya Xia , Josephine Monica , Wei-Lun Chao , Bharath Hariharan , Kilian Q Weinberger , Mark Campbell

In unsupervised image-to-image translation, the goal is to learn the mapping between an input image and an output image using a set of unpaired training images. In this paper, we propose an extension of the unsupervised image-to-image…

Computer Vision and Pattern Recognition · Computer Science 2017-11-28 Pramuditha Perera , Mahdi Abavisani , Vishal M. Patel

Image-to-image translation has recently received significant attention due to advances in deep learning. Most works focus on learning either a one-to-one mapping in an unsupervised way or a many-to-many mapping in a supervised way. However,…

Computer Vision and Pattern Recognition · Computer Science 2019-03-15 Liqian Ma , Xu Jia , Stamatios Georgoulis , Tinne Tuytelaars , Luc Van Gool

Image-to-image translation is a technique that focuses on transferring images from one domain to another while maintaining the essential content representations. In recent years, image-to-image translation has gained significant attention…

Image and Video Processing · Electrical Eng. & Systems 2024-04-02 Xixian Wu , Dian Chao , Yang Yang

Image-to-image translation aims to learn the mapping between two visual domains. There are two main challenges for many applications: 1) the lack of aligned training pairs and 2) multiple possible outputs from a single input image. In this…

Computer Vision and Pattern Recognition · Computer Science 2018-08-03 Hsin-Ying Lee , Hung-Yu Tseng , Jia-Bin Huang , Maneesh Kumar Singh , Ming-Hsuan Yang

Recently, there has been an increasing interest in image editing methods that employ pre-trained unconditional image generators (e.g., StyleGAN). However, applying these methods to translate images to multiple visual domains remains…

Computer Vision and Pattern Recognition · Computer Science 2022-03-07 Yahui Liu , Yajing Chen , Linchao Bao , Nicu Sebe , Bruno Lepri , Marco De Nadai

Image-to-image (I2I) translation is an established way of translating data from one domain to another but the usability of the translated images in the target domain when working with such dissimilar domains as the SAR/optical satellite…

Computer Vision and Pattern Recognition · Computer Science 2021-12-13 Alejandro D. Mousist