English
Related papers

Related papers: CycleGAN with Better Cycles

200 papers

This year alone has seen unprecedented leaps in the area of learning-based image translation, namely CycleGAN, by Zhu et al. But experiments so far have been tailored to merely two domains at a time, and scaling them to more would require…

Computer Vision and Pattern Recognition · Computer Science 2017-12-20 Asha Anoosheh , Eirikur Agustsson , Radu Timofte , Luc Van Gool

Existing approaches for restoring weather-degraded images follow a fully-supervised paradigm and they require paired data for training. However, collecting paired data for weather degradations is extremely challenging, and existing methods…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Rajeev Yasarla , Vishwanath A. Sindagi , Vishal M. Patel

Diffusion models (DMs) have enabled breakthroughs in image synthesis tasks but lack an intuitive interface for consistent image-to-image (I2I) translation. Various methods have been explored to address this issue, including mask-based…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Sihan Xu , Ziqiao Ma , Yidong Huang , Honglak Lee , Joyce Chai

The cycleGAN is becoming an influential method in medical image synthesis. However, due to a lack of direct constraints between input and synthetic images, the cycleGAN cannot guarantee structural consistency between these two images, and…

Computer Vision and Pattern Recognition · Computer Science 2018-09-13 Heran Yang , Jian Sun , Aaron Carass , Can Zhao , Junghoon Lee , Zongben Xu , Jerry Prince

Recently image-to-image translation has attracted significant interests in the literature, starting from the successful use of the generative adversarial network (GAN), to the introduction of cyclic constraint, to extensions to multiple…

Computer Vision and Pattern Recognition · Computer Science 2020-01-16 Zengming Shen , S. Kevin Zhou , Yifan Chen , Bogdan Georgescu , Xuqi Liu , Thomas S. Huang

Image-to-image translation is a class of vision and graphics problems where the goal is to learn the mapping between an input image and an output image using a training set of aligned image pairs. However, for many tasks, paired training…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Jun-Yan Zhu , Taesung Park , Phillip Isola , Alexei A. Efros

Generative adversarial networks using a cycle-consistency loss facilitate unpaired training of image-translation models and thereby exhibit a very high potential in manifold medical applications. However, the fact that images in one domain…

Image and Video Processing · Electrical Eng. & Systems 2021-01-12 Michael Gadermayr , Maximilian Tschuchnig , Laxmi Gupta , Dorit Merhof , Nils Krämer , Daniel Truhn , Burkhard Gess

Infrared (IR) images are essential to improve the visibility of dark or camouflaged objects. Object recognition and segmentation based on a neural network using IR images provide more accuracy and insight than color visible images. But the…

Image and Video Processing · Electrical Eng. & Systems 2019-04-29 Kyongsik Yun , Kevin Yu , Joseph Osborne , Sarah Eldin , Luan Nguyen , Alexander Huyen , Thomas Lu

We propose a simple architecture to address unpaired image-to-image translation tasks: style or class transfer, denoising, deblurring, deblocking, etc. We start from an image autoencoder architecture with fixed weights. For each task we…

Computer Vision and Pattern Recognition · Computer Science 2020-08-14 Hugo Touvron , Matthijs Douze , Matthieu Cord , Hervé Jégou

Recently, CycleGAN was shown to provide high-performance, ultra-fast denoising for low-dose X-ray computed tomography (CT) without the need for a paired training dataset. Although this was possible thanks to cycle consistency, CycleGAN…

Image and Video Processing · Electrical Eng. & Systems 2021-04-20 Taesung Kwon , Jong Chul Ye

The CycleGAN framework allows for unsupervised image-to-image translation of unpaired data. In a scenario of surgical training on a physical surgical simulator, this method can be used to transform endoscopic images of phantoms into images…

Computer Vision and Pattern Recognition · Computer Science 2021-09-01 Lalith Sharan , Gabriele Romano , Sven Koehler , Halvar Kelm , Matthias Karck , Raffaele De Simone , Sandy Engelhardt

The primary motivation of Image-to-Image Transformation is to convert an image of one domain to another domain. Most of the research has been focused on the task of image transformation for a set of pre-defined domains. Very few works are…

Computer Vision and Pattern Recognition · Computer Science 2019-01-14 Kishan Babu Kancharagunta , Shiv Ram Dubey

This paper investigates an open research task of text-to-image synthesis for automatically generating or manipulating images from text descriptions. Prevailing methods mainly use the text as conditions for GAN generation, and train…

Computer Vision and Pattern Recognition · Computer Science 2021-09-14 Hao Wang , Guosheng Lin , Steven C. H. Hoi , Chunyan Miao

Unsupervised image-to-image translation is the task of translating an image from one domain to another in the absence of any paired training examples and tends to be more applicable to practical applications. Nevertheless, the extension of…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Yang Chen , Yingwei Pan , Ting Yao , Xinmei Tian , Tao Mei

Cross-domain image-to-image translation should satisfy two requirements: (1) preserve the information that is common to both domains, and (2) generate convincing images covering variations that appear in the target domain. This is…

Computer Vision and Pattern Recognition · Computer Science 2019-10-22 Adam W. Harley , Shih-En Wei , Jason Saragih , Katerina Fragkiadaki

Unpaired image-to-image translation problem aims to model the mapping from one domain to another with unpaired training data. Current works like the well-acknowledged Cycle GAN provide a general solution for any two domains through modeling…

Computer Vision and Pattern Recognition · Computer Science 2019-12-30 Yu Li , Sheng Tang , Rui Zhang , Yongdong Zhang , Jintao Li , Shuicheng Yan

Recent studies on unsupervised image-to-image translation have made a remarkable progress by training a pair of generative adversarial networks with a cycle-consistent loss. However, such unsupervised methods may generate inferior results…

Computer Vision and Pattern Recognition · Computer Science 2018-07-31 Minjun Li , Haozhi Huang , Lin Ma , Wei Liu , Tong Zhang , Yu-Gang Jiang

Recently, the cycle-consistent generative adversarial networks (CycleGAN) has been widely used for synthesis of multi-domain medical images. The domain-specific nonlinear deformations captured by CycleGAN make the synthesized images…

Computer Vision and Pattern Recognition · Computer Science 2018-08-14 Chengjia Wang , Gillian Macnaught , Giorgos Papanastasiou , Tom MacGillivray , David Newby

Medical image synthesis is a challenging task due to the scarcity of paired data. Several methods have applied CycleGAN to leverage unpaired data, but they often generate inaccurate mappings that shift the anatomy. This problem is further…

Image and Video Processing · Electrical Eng. & Systems 2023-08-02 Minh Hieu Phan , Zhibin Liao , Johan W. Verjans , Minh-Son To

This paper presents a new problem of unpaired face translation between images and videos, which can be applied to facial video prediction and enhancement. In this problem there exist two major technical challenges: 1) designing a robust…

Computer Vision and Pattern Recognition · Computer Science 2017-12-05 Zhiwu Huang , Bernhard Kratzwald , Danda Pani Paudel , Jiqing Wu , Luc Van Gool