English
Related papers

Related papers: Separating Content and Style for Unsupervised Imag…

200 papers

Unpaired image-to-image translation is the problem of mapping an image in the source domain to one in the target domain, without requiring corresponding image pairs. To ensure the translated images are realistically plausible, recent works,…

Computer Vision and Pattern Recognition · Computer Science 2018-07-13 Anoop Cherian , Alan Sullivan

Image-to-image translation architectures may have limited effectiveness in some circumstances. For example, while generating rainy scenarios, they may fail to model typical traits of rain as water drops, and this ultimately impacts the…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Fabio Pizzati , Raoul de Charette , Michela Zaccaria , Pietro Cerri

We consider the problem of translating, in an unsupervised manner, between two domains where one contains some additional information compared to the other. The proposed method disentangles the common and separate parts of these domains…

Computer Vision and Pattern Recognition · Computer Science 2020-01-14 Ron Mokady , Sagie Benaim , Lior Wolf , Amit Bermano

Image-to-Image Translation is a vital area of computer vision that focuses on transforming images from one visual domain to another while preserving their core content and structure. However, this field faces two major challenges: first,…

Image and Video Processing · Electrical Eng. & Systems 2024-09-27 Wanchen Zhao

Style transfer usually refers to the task of applying color and texture information from a specific style image to a given content image while preserving the structure of the latter. Here we tackle the more generic problem of semantic style…

Computer Vision and Pattern Recognition · Computer Science 2018-07-11 Amélie Royer , Konstantinos Bousmalis , Stephan Gouws , Fred Bertsch , Inbar Mosseri , Forrester Cole , Kevin Murphy

Image-to-image translation aims to learn the mapping between two visual domains. There are two main challenges for this task: 1) lack of aligned training pairs and 2) multiple possible outputs from a single input image. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2019-12-19 Hsin-Ying Lee , Hung-Yu Tseng , Qi Mao , Jia-Bin Huang , Yu-Ding Lu , Maneesh Singh , Ming-Hsuan Yang

Semantic Image Synthesis (SIS) is a subclass of image-to-image translation where a photorealistic image is synthesized from a segmentation mask. SIS has mostly been addressed as a supervised problem. However, state-of-the-art methods depend…

Computer Vision and Pattern Recognition · Computer Science 2021-10-01 George Eskandar , Mohamed Abdelsamad , Karim Armanious , Bin Yang

Style transfer generates an image whose content comes from one image and style from the other. Image-to-image translation approaches with disentangled representations have been shown effective for style transfer between two image…

Computer Vision and Pattern Recognition · Computer Science 2020-08-06 Hsin-Yu Chang , Zhixiang Wang , Yung-Yu Chuang

Image-to-image translation is a class of vision and graphics problems where the goal is to learn the mapping between an input image and an output image using a training set of aligned image pairs. However, for many tasks, paired training…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Jun-Yan Zhu , Taesung Park , Phillip Isola , Alexei A. Efros

Understanding images without explicit supervision has become an important problem in computer vision. In this paper, we address image captioning by generating language descriptions of scenes without learning from annotated pairs of images…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Iro Laina , Christian Rupprecht , Nassir Navab

We introduce a simple and versatile framework for image-to-image translation. We unearth the importance of normalization layers, and provide a carefully designed two-stream generative model with newly proposed feature transformations in a…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Liming Jiang , Changxu Zhang , Mingyang Huang , Chunxiao Liu , Jianping Shi , Chen Change Loy

Image-to-image translation is a subset of computer vision and pattern recognition problems where our goal is to learn a mapping between input images of domain $\mathbf{X}_1$ and output images of domain $\mathbf{X}_2$. Current methods use…

Computer Vision and Pattern Recognition · Computer Science 2020-06-23 Safalya Pal

Unpaired Image-to-Image Translation (UIT) focuses on translating images among different domains by using unpaired data, which has received increasing research focus due to its practical usage. However, existing UIT schemes defect in the…

Computer Vision and Pattern Recognition · Computer Science 2019-04-30 Xinyang Li , Jie Hu , Shengchuan Zhang , Xiaopeng Hong , Qixiang Ye , Chenglin Wu , Rongrong Ji

State-of-the-art image-to-image translation methods tend to struggle in an imbalanced domain setting, where one image domain lacks richness and diversity. We introduce a new unsupervised translation network, BalaGAN, specifically designed…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Or Patashnik , Dov Danon , Hao Zhang , Daniel Cohen-Or

Unsupervised cross-modality domain adaptation is a challenging task in medical image analysis, and it becomes more challenging when source and target domain data are collected from multiple institutions. In this paper, we present our…

Computer Vision and Pattern Recognition · Computer Science 2023-11-23 Han Liu , Yubo Fan , Zhoubing Xu , Benoit M. Dawant , Ipek Oguz

We present a mutual information-based framework for unsupervised image-to-image translation. Our MCMI approach treats single-cycle image translation models as modules that can be used recurrently in a multi-cycle translation setting where…

Computer Vision and Pattern Recognition · Computer Science 2020-07-07 Xiang Xu , Megha Nawhal , Greg Mori , Manolis Savva

The task of unpaired image-to-image translation is highly challenging due to the lack of explicit cross-domain pairs of instances. We consider here diverse image translation (DIT), an even more challenging setting in which an image can have…

Computer Vision and Pattern Recognition · Computer Science 2019-07-24 Yaxing Wang , Abel Gonzalez-Garcia , Joost van de Weijer , Luis Herranz

We present a novel and unified deep learning framework which is capable of learning domain-invariant representation from data across multiple domains. Realized by adversarial training with additional ability to exploit domain-specific…

Computer Vision and Pattern Recognition · Computer Science 2018-10-30 Alexander H. Liu , Yen-Cheng Liu , Yu-Ying Yeh , Yu-Chiang Frank Wang

Unsupervised Multiple Domain Translation is the task of transforming data from one domain to other domains without having paired data to train the systems. Typically, methods based on Generative Adversarial Networks (GANs) are used to…

Machine Learning · Computer Science 2024-01-19 Antonio Almudévar , Théo Mariotte , Alfonso Ortega , Marie Tahon

Unsupervised domain adaptation enables to alleviate the need for pixel-wise annotation in the semantic segmentation. One of the most common strategies is to translate images from the source domain to the target domain and then align their…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Jinyu Yang , Weizhi An , Sheng Wang , Xinliang Zhu , Chaochao Yan , Junzhou Huang