English
Related papers

Related papers: Semantics-Aware Image to Image Translation and Dom…

200 papers

Most image-to-image translation methods focus on learning mappings across domains with the assumption that images share content (e.g., pose) but have their own domain-specific information known as style. When conditioned on a target image,…

Computer Vision and Pattern Recognition · Computer Science 2021-07-26 Mohamed Abderrahmen Abid , Ihsen Hedhli , Jean-François Lalonde , Christian Gagne

The goal of this paper is to embed controllable factors, i.e., natural language descriptions, into image-to-image translation with generative adversarial networks, which allows text descriptions to determine the visual attributes of…

Computer Vision and Pattern Recognition · Computer Science 2020-02-14 Bowen Li , Xiaojuan Qi , Philip H. S. Torr , Thomas Lukasiewicz

Deep learning has raised hopes and expectations as a general solution for many applications; indeed it has proven effective, but it also showed a strong dependence on large quantities of data. Luckily, it has been shown that, even when data…

Computer Vision and Pattern Recognition · Computer Science 2019-02-14 Fabio Maria Carlucci

The Swapping Autoencoder achieved state-of-the-art performance in deep image manipulation and image-to-image translation. We improve this work by introducing a simple yet effective auxiliary module based on gradient reversal layers. The…

Computer Vision and Pattern Recognition · Computer Science 2022-08-25 Shima Shahfar , Charalambos Poullis

Visual Domain Adaptation is a problem of immense importance in computer vision. Previous approaches showcase the inability of even deep neural networks to learn informative representations across domain shift. This problem is more severe…

Computer Vision and Pattern Recognition · Computer Science 2018-04-03 Swami Sankaranarayanan , Yogesh Balaji , Arpit Jain , Ser Nam Lim , Rama Chellappa

Current image-to-image translation methods formulate the task with conditional generation models, leading to learning only the recolorization or regional changes as being constrained by the rich structural information provided by the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-28 Yu-Jie Chen , Shin-I Cheng , Wei-Chen Chiu , Hung-Yu Tseng , Hsin-Ying Lee

While unsupervised domain translation (UDT) has seen a lot of success recently, we argue that mediating its translation via categorical semantic features could broaden its applicability. In particular, we demonstrate that categorical…

Machine Learning · Computer Science 2021-03-18 Samuel Lavoie , Faruk Ahmed , Aaron Courville

Cross-domain mapping has been a very active topic in recent years. Given one image, its main purpose is to translate it to the desired target domain, or multiple domains in the case of multiple labels. This problem is highly challenging due…

Computer Vision and Pattern Recognition · Computer Science 2019-09-06 Andrés Romero , Pablo Arbeláez , Luc Van Gool , Radu Timofte

One task that is often discussed in a computer vision is the mapping of an image from one domain to a corresponding image in another domain known as image-to-image translation. Currently there are several approaches solving this task. In…

Machine Learning · Computer Science 2020-03-23 Magda Friedjungová , Daniel Vašata , Tomáš Chobola , Marcel Jiřina

This paper studies a novel energy-based cooperative learning framework for multi-domain image-to-image translation. The framework consists of four components: descriptor, translator, style encoder, and style generator. The descriptor is a…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Weinan Song , Yaxuan Zhu , Lei He , Yingnian Wu , Jianwen Xie

Urban material recognition in remote sensing imagery is a highly relevant, yet extremely challenging problem due to the difficulty of obtaining human annotations, especially on low resolution satellite images. To this end, we propose an…

Computer Vision and Pattern Recognition · Computer Science 2021-05-18 Arthita Ghosh , Max Ehrlich , Larry Davis , Rama Chellappa

For semantic-guided cross-view image translation, it is crucial to learn where to sample pixels from the source view image and where to reallocate them guided by the target view semantic map, especially when there is little overlap or…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Bin Ren , Hao Tang , Yiming Wang , Xia Li , Wei Wang , Nicu Sebe

Learning deep neural networks that are generalizable across different domains remains a challenge due to the problem of domain shift. Unsupervised domain adaptation is a promising avenue which transfers knowledge from a source domain to a…

Machine Learning · Computer Science 2020-08-20 Qingjie Meng , Daniel Rueckert , Bernhard Kainz

Many image-to-image (I2I) translation problems are in nature of high diversity that a single input may have various counterparts. Prior works proposed the multi-modal network that can build a many-to-many mapping between two visual domains.…

Computer Vision and Pattern Recognition · Computer Science 2019-10-07 Jialu Huang , Jing Liao , Tak Wu Sam Kwong

Image-to-image (i2i) networks struggle to capture local changes because they do not affect the global scene structure. For example, translating from highway scenes to offroad, i2i networks easily focus on global color features but ignore…

Computer Vision and Pattern Recognition · Computer Science 2022-02-15 Anthony Dell'Eva , Fabio Pizzati , Massimo Bertozzi , Raoul de Charette

Neural networks have proven their capabilities by outperforming many other approaches on regression or classification tasks on various kinds of data. Other astonishing results have been achieved using neural nets as data generators,…

Computer Vision and Pattern Recognition · Computer Science 2018-10-16 Andrej Junginger , Markus Hanselmann , Thilo Strauss , Sebastian Boblest , Jens Buchner , Holger Ulmer

Despite remarkable progress in image translation, the complex scene with multiple discrepant objects remains a challenging problem. The translated images have low fidelity and tiny objects in fewer details causing unsatisfactory performance…

Computer Vision and Pattern Recognition · Computer Science 2022-12-26 Liyun Zhang , Photchara Ratsamee , Bowen Wang , Zhaojie Luo , Yuki Uranishi , Manabu Higashida , Haruo Takemura

Recent image-to-image translation works have been transferred from supervised to unsupervised settings due to the expensive cost of capturing or labeling large amounts of paired data. However, current unsupervised methods using the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Pan Zhang , Jianmin Bao , Ting Zhang , Dong Chen , Fang Wen

Unpaired Image-to-Image translation aims to convert the image from one domain (input domain A) to another domain (target domain B), without providing paired examples for the training. The state-of-the-art, Cycle-GAN demonstrated the power…

Computer Vision and Pattern Recognition · Computer Science 2018-02-14 Mohan Nikam

Recently, cross domain transfer has been applied for unsupervised image restoration tasks. However, directly applying existing frameworks would lead to domain-shift problems in translated images due to lack of effective supervision.…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Wenchao Du , Hu Chen , Hongyu Yang