English
Related papers

Related papers: Toward Multimodal Image-to-Image Translation

200 papers

Recent advances of image-to-image translation focus on learning the one-to-many mapping from two aspects: multi-modal translation and multi-domain translation. However, the existing methods only consider one of the two perspectives, which…

Computer Vision and Pattern Recognition · Computer Science 2019-12-30 Xiaoming Yu , Yuanqi Chen , Thomas Li , Shan Liu , Ge Li

Multimodal image-to-image translation (I2IT) aims to learn a conditional distribution that explores multiple possible images in the target domain given an input image in the source domain. Conditional generative adversarial networks (cGANs)…

Computer Vision and Pattern Recognition · Computer Science 2021-05-11 Zhiwen Zuo , Lei Zhao , Zhizhong Wang , Haibo Chen , Ailin Li , Qijiang Xu , Wei Xing , Dongming Lu

Unsupervised image-to-image translation consists of learning a pair of mappings between two domains without known pairwise correspondences between points. The current convention is to approach this task with cycle-consistent GANs: using a…

Computer Vision and Pattern Recognition · Computer Science 2020-06-25 Matthew Amodio , Rim Assouel , Victor Schmidt , Tristan Sylvain , Smita Krishnaswamy , Yoshua Bengio

In multimodal unsupervised image-to-image translation tasks, the goal is to translate an image from the source domain to many images in the target domain. We present a simple method that produces higher quality images than current…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Yazeed Alharbi , Neil Smith , Peter Wonka

Image-to-image translation has drawn great attention during the past few years. It aims to translate an image in one domain to a given reference image in another domain. Due to its effectiveness and efficiency, many applications can be…

Computer Vision and Pattern Recognition · Computer Science 2019-11-05 Weihao Xia , Yujiu Yang , Jing-Hao Xue

Image-to-image translation, which translates input images to a different domain with a learned one-to-one mapping, has achieved impressive success in recent years. The success of translation mainly relies on the network architecture to…

Computer Vision and Pattern Recognition · Computer Science 2019-05-22 Wenju Xu , Shawn Keshmiri , Guanghui Wang

Recent advances in image-to-image translation have seen a rise in approaches generating diverse images through a single network. To indicate the target domain for a one-to-many mapping, the latent code is injected into the generator…

Computer Vision and Pattern Recognition · Computer Science 2020-04-20 Xiaoming Yu , Zhenqiang Ying , Thomas Li , Shan Liu , Ge Li

In unsupervised image-to-image translation, the goal is to learn the mapping between an input image and an output image using a set of unpaired training images. In this paper, we propose an extension of the unsupervised image-to-image…

Computer Vision and Pattern Recognition · Computer Science 2017-11-28 Pramuditha Perera , Mahdi Abavisani , Vishal M. Patel

We propose a method to fuse frozen text-only large language models (LLMs) with pre-trained image encoder and decoder models, by mapping between their embedding spaces. Our model demonstrates a wide suite of multimodal capabilities: image…

Computation and Language · Computer Science 2023-10-16 Jing Yu Koh , Daniel Fried , Ruslan Salakhutdinov

Image-to-image translation aims to learn the mapping between two visual domains. There are two main challenges for many applications: 1) the lack of aligned training pairs and 2) multiple possible outputs from a single input image. In this…

Computer Vision and Pattern Recognition · Computer Science 2018-08-03 Hsin-Ying Lee , Hung-Yu Tseng , Jia-Bin Huang , Maneesh Kumar Singh , Ming-Hsuan Yang

Interest in image-to-image translation has grown substantially in recent years with the success of unsupervised models based on the cycle-consistency assumption. The achievements of these models have been limited to a particular subset of…

Computer Vision and Pattern Recognition · Computer Science 2019-02-27 Matthew Amodio , Smita Krishnaswamy

We propose a novel approach for multi-modal Image-to-image (I2I) translation. To tackle the one-to-many relationship between input and output domains, previous works use complex training objectives to learn a latent embedding, jointly with…

Computer Vision and Pattern Recognition · Computer Science 2021-04-16 Moustafa Meshry , Yixuan Ren , Larry S Davis , Abhinav Shrivastava

Many image-to-image (I2I) translation problems are in nature of high diversity that a single input may have various counterparts. Prior works proposed the multi-modal network that can build a many-to-many mapping between two visual domains.…

Computer Vision and Pattern Recognition · Computer Science 2019-10-07 Jialu Huang , Jing Liao , Tak Wu Sam Kwong

Recent advances in conditional image generation tasks, such as image-to-image translation and image inpainting, are largely accounted to the success of conditional GAN models, which are often optimized by the joint use of the GAN loss with…

Machine Learning · Computer Science 2019-02-26 Soochan Lee , Junsoo Ha , Gunhee Kim

Unsupervised image-to-image translation is a class of computer vision problems which aims at modeling conditional distribution of images in the target domain, given a set of unpaired images in the source and target domains. An image in the…

Computer Vision and Pattern Recognition · Computer Science 2018-11-30 Hadi Kazemi , Sobhan Soleymani , Fariborz Taherkhani , Seyed Mehdi Iranmanesh , Nasser M. Nasrabadi

Generative models have made significant progress in the tasks of modeling complex data distributions such as natural images. The introduction of Generative Adversarial Networks (GANs) and auto-encoders lead to the possibility of training on…

Computer Vision and Pattern Recognition · Computer Science 2018-03-29 Tobias Hinz , Stefan Wermter

Current image-to-image translation methods formulate the task with conditional generation models, leading to learning only the recolorization or regional changes as being constrained by the rich structural information provided by the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-28 Yu-Jie Chen , Shin-I Cheng , Wei-Chen Chiu , Hung-Yu Tseng , Hsin-Ying Lee

Image-to-image translation tasks have been widely investigated with Generative Adversarial Networks (GANs) and dual learning. However, existing models lack the ability to control the translated results in the target domain and their results…

Computer Vision and Pattern Recognition · Computer Science 2018-05-02 Jianxin Lin , Yingce Xia , Tao Qin , Zhibo Chen , Tie-Yan Liu

Image translation is a burgeoning field in computer vision where the goal is to learn the mapping between an input image and an output image. However, most recent methods require multiple generators for modeling different domain mappings,…

Computer Vision and Pattern Recognition · Computer Science 2020-04-20 Xiaoming Yu , Xing Cai , Zhenqiang Ying , Thomas Li , Ge Li

Image-to-image translation is a class of vision and graphics problems where the goal is to learn the mapping between an input image and an output image using a training set of aligned image pairs. However, for many tasks, paired training…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Jun-Yan Zhu , Taesung Park , Phillip Isola , Alexei A. Efros
‹ Prev 1 2 3 10 Next ›