English
Related papers

Related papers: Sound-to-Imagination: An Exploratory Study on Unsu…

200 papers

Image-to-image translation has recently achieved remarkable results. But despite current success, it suffers from inferior performance when translations between classes require large shape changes. We attribute this to the high-resolution…

Computer Vision and Pattern Recognition · Computer Science 2020-11-12 Yaxing Wang , Lu Yu , Joost van de Weijer

We propose a novel spatially-correlative loss that is simple, efficient and yet effective for preserving scene structure consistency while supporting large appearance changes during unpaired image-to-image (I2I) translation. Previous…

Computer Vision and Pattern Recognition · Computer Science 2021-04-05 Chuanxia Zheng , Tat-Jen Cham , Jianfei Cai

The goal of unsupervised image-to-image translation is to map images from one domain to another without the ground truth correspondence between the two domains. State-of-art methods learn the correspondence using large numbers of unpaired…

Computer Vision and Pattern Recognition · Computer Science 2019-08-06 Dina Bashkirova , Ben Usman , Kate Saenko

How does audio describe the world around us? In this paper, we propose a method for generating an image of a scene from sound. Our method addresses the challenges of dealing with the large gaps that often exist between sight and sound. We…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Kim Sung-Bin , Arda Senocak , Hyunwoo Ha , Andrew Owens , Tae-Hyun Oh

Image-to-image translation with Deep Learning neural networks, particularly with Generative Adversarial Networks (GANs), is one of the most powerful methods for simulating astronomical images. However, current work is limited to utilizing…

Computer Vision and Pattern Recognition · Computer Science 2022-02-16 Qiufan Lin , Dominique Fouchez , Jérôme Pasquet

Cross-modal representation learning allows to integrate information from different modalities into one representation. At the same time, research on generative models tends to focus on the visual domain with less emphasis on other domains,…

Multimedia · Computer Science 2022-08-16 Maciej Żelaszczyk , Jacek Mańdziuk

Typical methods for text-to-image synthesis seek to design effective generative architecture to model the text-to-image mapping directly. It is fairly arduous due to the cross-modality translation. In this paper we circumvent this problem…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Jiadong Liang , Wenjie Pei , Feng Lu

Unsupervised image-to-image translation aims to learn the translation between two visual domains without paired data. Despite the recent progress in image translation models, it remains challenging to build mappings between complex domains…

Computer Vision and Pattern Recognition · Computer Science 2022-04-08 Shuai Yang , Liming Jiang , Ziwei Liu , Chen Change Loy

Recent studies have shown remarkable success in the unsupervised image to image (I2I) translation. However, due to the imbalance in the data, learning joint distribution for various domains is still very challenging. Although existing…

Computer Vision and Pattern Recognition · Computer Science 2021-06-24 Jihye Back

In surgical computer vision applications, obtaining labeled training data is challenging due to data-privacy concerns and the need for expert annotation. Unpaired image-to-image translation techniques have been explored to automatically…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Danush Kumar Venkatesh , Dominik Rivoir , Micha Pfeiffer , Fiona Kolbinger , Marius Distler , Jürgen Weitz , Stefanie Speidel

The goal of this paper is to embed controllable factors, i.e., natural language descriptions, into image-to-image translation with generative adversarial networks, which allows text descriptions to determine the visual attributes of…

Computer Vision and Pattern Recognition · Computer Science 2020-02-14 Bowen Li , Xiaojuan Qi , Philip H. S. Torr , Thomas Lukasiewicz

Image-to-image translation (I2I) transforms an image from a source domain to a target domain while preserving source content. Most computer vision applications are in the field of image-to-image translation, such as style transfer, image…

Image and Video Processing · Electrical Eng. & Systems 2025-02-18 Mehran Safayani , Behnaz Mirzapour , Hanieh aghaebrahimiyan , Nasrin Salehi , Hamid Ravaee

Unsupervised image-to-image translation consists of learning a pair of mappings between two domains without known pairwise correspondences between points. The current convention is to approach this task with cycle-consistent GANs: using a…

Computer Vision and Pattern Recognition · Computer Science 2020-06-25 Matthew Amodio , Rim Assouel , Victor Schmidt , Tristan Sylvain , Smita Krishnaswamy , Yoshua Bengio

State-of-the-art techniques in Generative Adversarial Networks (GANs) have shown remarkable success in image-to-image translation from peer domain X to domain Y using paired image data. However, obtaining abundant paired data is a…

Computer Vision and Pattern Recognition · Computer Science 2020-08-28 Xuewen Yang , Dongliang Xie , Xin Wang

Image to image translation is the problem of transferring an image from a source domain to a different (but related) target domain. We present a new unsupervised image to image translation technique that leverages the underlying semantic…

Computer Vision and Pattern Recognition · Computer Science 2021-03-02 Pravakar Roy , Nicolai Häni , Jun-Jee Chao , Volkan Isler

Image to image translation is an active area of research in the field of computer vision, enabling the generation of new images with different styles, textures, or resolutions while preserving their characteristic properties. Recent…

Computer Vision and Pattern Recognition · Computer Science 2025-05-23 Gaurav Kumar , Soham Satyadharma , Harpreet Singh

Recently, a unified model for image-to-image translation tasks within adversarial learning framework has aroused widespread research interests in computer vision practitioners. Their reported empirical success however lacks solid…

Machine Learning · Statistics 2018-06-20 Xudong Pan , Mi Zhang , Daizong Ding

Image-to-image translation (I2IT) refers to the process of transforming images from a source domain to a target domain while maintaining a fundamental connection in terms of image content. In the past few years, remarkable advancements in…

Computer Vision and Pattern Recognition · Computer Science 2023-12-04 Or Greenberg , Eran Kishon , Dani Lischinski

Text-to-image (T2I) generation aims at producing realistic images corresponding to text descriptions. Generative Adversarial Network (GAN) has proven to be successful in this task. Typical T2I GANs are 2 phase methods that first pretrain an…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Yibin Liu , Jianyu Zhang , Li Zhang , Shijian Li , Gang Pan

Despite remarkable progress in image translation, the complex scene with multiple discrepant objects remains a challenging problem. The translated images have low fidelity and tiny objects in fewer details causing unsatisfactory performance…

Computer Vision and Pattern Recognition · Computer Science 2022-12-26 Liyun Zhang , Photchara Ratsamee , Bowen Wang , Zhaojie Luo , Yuki Uranishi , Manabu Higashida , Haruo Takemura