English
Related papers

Related papers: Multimodal Unsupervised Image-to-Image Translation

200 papers

Image-to-Image Translation is a vital area of computer vision that focuses on transforming images from one visual domain to another while preserving their core content and structure. However, this field faces two major challenges: first,…

Image and Video Processing · Electrical Eng. & Systems 2024-09-27 Wanchen Zhao

Unpaired image-to-image translation is a class of vision problems whose goal is to find the mapping between different image domains using unpaired training data. Cycle-consistency loss is a widely used constraint for such problems. However,…

Computer Vision and Pattern Recognition · Computer Science 2021-01-19 Yihao Zhao , Ruihai Wu , Hao Dong

In this work, we address the problem of multi-domain image-to-image translation with particular attention paid to computational cost. In particular, current state of the art models require a large and deep model in order to handle the…

Computer Vision and Pattern Recognition · Computer Science 2021-01-12 The-Phuc Nguyen , Stéphane Lathuilière , Elisa Ricci

It's useful to automatically transform an image from its original form to some synthetic form (style, partial contents, etc.), while keeping the original structure or semantics. We define this requirement as the "image-to-image translation"…

Computer Vision and Pattern Recognition · Computer Science 2017-01-11 Hao Dong , Paarth Neekhara , Chao Wu , Yike Guo

Unsupervised Domain Adaptation (UDA) aims to adapt models trained on a source domain to a new target domain where no labelled data is available. In this work, we investigate the problem of UDA from a synthetic computer-generated domain to a…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Stephan Brehm , Sebastian Scherer , Rainer Lienhart

Multi-domain image-to-image translation is a problem where the goal is to learn mappings among multiple domains. This problem is challenging in terms of scalability because it requires the learning of numerous mappings, the number of which…

Computer Vision and Pattern Recognition · Computer Science 2019-05-07 Takuhiro Kaneko , Tatsuya Harada

Unsupervised domain adaptation enables to alleviate the need for pixel-wise annotation in the semantic segmentation. One of the most common strategies is to translate images from the source domain to the target domain and then align their…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Jinyu Yang , Weizhi An , Sheng Wang , Xinliang Zhu , Chaochao Yan , Junzhou Huang

Current unsupervised image-to-image translation techniques struggle to focus their attention on individual objects without altering the background or the way multiple objects interact within a scene. Motivated by the important role of…

Computer Vision and Pattern Recognition · Computer Science 2018-11-15 Youssef A. Mejjati , Christian Richardt , James Tompkin , Darren Cosker , Kwang In Kim

Image-to-image translation aims to learn the mapping between two visual domains. There are two main challenges for this task: 1) lack of aligned training pairs and 2) multiple possible outputs from a single input image. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2019-12-19 Hsin-Ying Lee , Hung-Yu Tseng , Qi Mao , Jia-Bin Huang , Yu-Ding Lu , Maneesh Singh , Ming-Hsuan Yang

In the last few years, unpaired image-to-image translation has witnessed remarkable progress. Although the latest methods are able to generate realistic images, they crucially rely on a large number of labeled images. Recently, some methods…

Computer Vision and Pattern Recognition · Computer Science 2020-04-03 Yaxing Wang , Salman Khan , Abel Gonzalez-Garcia , Joost van de Weijer , Fahad Shahbaz Khan

Unsupervised image-to-image translation consists of learning a pair of mappings between two domains without known pairwise correspondences between points. The current convention is to approach this task with cycle-consistent GANs: using a…

Computer Vision and Pattern Recognition · Computer Science 2020-06-25 Matthew Amodio , Rim Assouel , Victor Schmidt , Tristan Sylvain , Smita Krishnaswamy , Yoshua Bengio

While unsupervised domain translation (UDT) has seen a lot of success recently, we argue that mediating its translation via categorical semantic features could broaden its applicability. In particular, we demonstrate that categorical…

Machine Learning · Computer Science 2021-03-18 Samuel Lavoie , Faruk Ahmed , Aaron Courville

Unpaired multimodal image-to-image translation is a task of translating a given image in a source domain into diverse images in the target domain, overcoming the limitation of one-to-one mapping. Existing multimodal translation models are…

Computer Vision and Pattern Recognition · Computer Science 2019-02-12 Sanghyeon Na , Seungjoo Yoo , Jaegul Choo

Recent advances of image-to-image translation focus on learning the one-to-many mapping from two aspects: multi-modal translation and multi-domain translation. However, the existing methods only consider one of the two perspectives, which…

Computer Vision and Pattern Recognition · Computer Science 2019-12-30 Xiaoming Yu , Yuanqi Chen , Thomas Li , Shan Liu , Ge Li

Style transfer of polyphonic music recordings is a challenging task when considering the modeling of diverse, imaginative, and reasonable music pieces in the style different from their original one. To achieve this, learning stable…

Sound · Computer Science 2018-11-30 Chien-Yu Lu , Min-Xin Xue , Chia-Che Chang , Che-Rung Lee , Li Su

Unpaired image-to-image translation (UNIT) aims to map images between two visual domains without paired training data. However, given a UNIT model trained on certain domains, it is difficult for current methods to incorporate new domains…

Computer Vision and Pattern Recognition · Computer Science 2023-06-27 Siyu Huang , Jie An , Donglai Wei , Zudi Lin , Jiebo Luo , Hanspeter Pfister

Unsupervised domain transfer is the task of transferring or translating samples from a source distribution to a different target distribution. Current solutions unsupervised domain transfer often operate on data on which the modes of the…

Machine Learning · Computer Science 2019-05-31 Mikołaj Bińkowski , R Devon Hjelm , Aaron Courville

Person re-identification (re-ID) models trained on one domain often fail to generalize well to another. In our attempt, we present a "learning via translation" framework. In the baseline, we translate the labeled images from source to…

Computer Vision and Pattern Recognition · Computer Science 2018-05-16 Weijian Deng , Liang Zheng , Qixiang Ye , Guoliang Kang , Yi Yang , Jianbin Jiao

This paper addresses the problem of inferring unseen cross-modal image-to-image translations between multiple modalities. We assume that only some of the pairwise translations have been seen (i.e. trained) and infer the remaining unseen…

Computer Vision and Pattern Recognition · Computer Science 2020-05-18 Yaxing Wang , Luis Herranz , Joost van de Weijer

State-of-the-art image-to-image translation methods tend to struggle in an imbalanced domain setting, where one image domain lacks richness and diversity. We introduce a new unsupervised translation network, BalaGAN, specifically designed…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Or Patashnik , Dov Danon , Hao Zhang , Daniel Cohen-Or