English
Related papers

Related papers: Multimodal Image-to-Image Translation via Mutual I…

200 papers

Translating information between text and image is a fundamental problem in artificial intelligence that connects natural language processing and computer vision. In the past few years, performance in image caption generation has seen…

Computer Vision and Pattern Recognition · Computer Science 2017-06-06 Hao Dong , Jingqing Zhang , Douglas McIlwraith , Yike Guo

Over the past few years deep learning-based techniques such as Generative Adversarial Networks (GANs) have significantly improved solutions to image super-resolution and image-to-image translation problems. In this paper, we propose a…

Image and Video Processing · Electrical Eng. & Systems 2022-06-23 Aref Abedjooy , Mehran Ebrahimi

Many image-to-image (I2I) translation problems are in nature of high diversity that a single input may have various counterparts. Prior works proposed the multi-modal network that can build a many-to-many mapping between two visual domains.…

Computer Vision and Pattern Recognition · Computer Science 2019-10-07 Jialu Huang , Jing Liao , Tak Wu Sam Kwong

Image-to-image translation has recently achieved remarkable results. But despite current success, it suffers from inferior performance when translations between classes require large shape changes. We attribute this to the high-resolution…

Computer Vision and Pattern Recognition · Computer Science 2020-11-12 Yaxing Wang , Lu Yu , Joost van de Weijer

Medical image-to-image (I2I) translation enables virtual scanning, i.e. the synthesis of a target imaging modality from a source one without additional acquisitions. Despite growing interest, most proposed methods operate on 2D slices, are…

We propose MAD-GAN, an intuitive generalization to the Generative Adversarial Networks (GANs) and its conditional variants to address the well known problem of mode collapse. First, MAD-GAN is a multi-agent GAN architecture incorporating…

Computer Vision and Pattern Recognition · Computer Science 2018-07-17 Arnab Ghosh , Viveka Kulharia , Vinay Namboodiri , Philip H. S. Torr , Puneet K. Dokania

We propose a unified Generative Adversarial Network (GAN) for controllable image-to-image translation, i.e., transferring an image from a source to a target domain guided by controllable structures. In addition to conditioning on a…

Computer Vision and Pattern Recognition · Computer Science 2020-10-28 Hao Tang , Hong Liu , Nicu Sebe

Image-to-image (i2i) networks struggle to capture local changes because they do not affect the global scene structure. For example, translating from highway scenes to offroad, i2i networks easily focus on global color features but ignore…

Computer Vision and Pattern Recognition · Computer Science 2022-02-15 Anthony Dell'Eva , Fabio Pizzati , Massimo Bertozzi , Raoul de Charette

Unsupervised image-to-image translation consists of learning a pair of mappings between two domains without known pairwise correspondences between points. The current convention is to approach this task with cycle-consistent GANs: using a…

Computer Vision and Pattern Recognition · Computer Science 2020-06-25 Matthew Amodio , Rim Assouel , Victor Schmidt , Tristan Sylvain , Smita Krishnaswamy , Yoshua Bengio

Recently, several methods based on generative adversarial network (GAN) have been proposed for the task of aligning cross-domain images or learning a joint distribution of cross-domain images. One of the methods is to use conditional GAN…

Computer Vision and Pattern Recognition · Computer Science 2017-07-06 Xudong Mao , Qing Li , Haoran Xie

Generative Adversarial Networks (GANs) can generate near photo realistic images in narrow domains such as human faces. Yet, modeling complex distributions of datasets such as ImageNet and COCO-Stuff remains challenging in unconditional…

Computer Vision and Pattern Recognition · Computer Science 2021-11-05 Arantxa Casanova , Marlène Careil , Jakob Verbeek , Michal Drozdzal , Adriana Romero-Soriano

Deep generative models have been applied to multiple applications in image-to-image translation. Generative Adversarial Networks and Diffusion Models have presented impressive results, setting new state-of-the-art results on these tasks.…

Computer Vision and Pattern Recognition · Computer Science 2024-02-26 Sagar Saxena , Mohammad Nayeem Teli

Text-to-image synthesis (T2I) aims to generate photo-realistic images which are semantically consistent with the text descriptions. Existing methods are usually built upon conditional generative adversarial networks (GANs) and initialize an…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Kai Hu , Wentong Liao , Michael Ying Yang , Bodo Rosenhahn

Generative adversarial networks (GANs) offer an effective solution to the image-to-image translation problem, thereby allowing for new possibilities in medical imaging. They can translate images from one imaging modality to another at a low…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Agnieszka Tomczak , Aarushi Gupta , Slobodan Ilic , Nassir Navab , Shadi Albarqouni

Unsupervised image-to-image translation has gained considerable attention due to the recent impressive progress based on generative adversarial networks (GANs). However, previous methods often fail in challenging cases, in particular, when…

Machine Learning · Computer Science 2019-01-03 Sangwoo Mo , Minsu Cho , Jinwoo Shin

Image-to-image translation is an ill-posed problem as unique one-to-one mapping may not exist between the source and target images. Learning-based methods proposed in this context often evaluate the performance on test data that is similar…

Image and Video Processing · Electrical Eng. & Systems 2021-10-08 Uddeshya Upadhyay , Viswanath P. Sudarshan , Suyash P. Awate

Image-to-image translation (I2I) aims at transferring the content representation from an input domain to an output one, bouncing along different target domains. Recent I2I generative models, which gain outstanding results in this task,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Eleonora Grassucci , Luigi Sigillo , Aurelio Uncini , Danilo Comminiello

Unpaired image-to-image translation is a challenging task due to the absence of paired examples, which complicates learning the complex mappings between the distinct distributions of the source and target domains. One of the most commonly…

Image and Video Processing · Electrical Eng. & Systems 2024-09-20 Yilmaz Korkmaz , Vishal M. Patel

An unsupervised image-to-image translation (UI2I) task deals with learning a mapping between two domains without paired images. While existing UI2I methods usually require numerous unpaired images from different domains for training, there…

Computer Vision and Pattern Recognition · Computer Science 2020-08-11 Jianxin Lin , Yingxue Pang , Yingce Xia , Zhibo Chen , Jiebo Luo

Deep generative models such as GANs have driven impressive advances in conditional image synthesis in recent years. A persistent challenge has been to generate diverse versions of output images from the same input image, due to the problem…

Computer Vision and Pattern Recognition · Computer Science 2021-06-18 Shichong Peng , Alireza Moazeni , Ke Li