English
Related papers

Related papers: Reversible GANs for Memory-efficient Image-to-Imag…

200 papers

We propose a novel model named Multi-Channel Attention Selection Generative Adversarial Network (SelectionGAN) for guided image-to-image translation, where we translate an input image into another while respecting an external semantic…

Computer Vision and Pattern Recognition · Computer Science 2022-10-07 Hao Tang , Philip H. S. Torr , Nicu Sebe

Deep generative models like StyleGAN hold the promise of semantic image editing: modifying images by their content, rather than their pixel values. Unfortunately, working with arbitrary images requires inverting the StyleGAN generator,…

Computer Vision and Pattern Recognition · Computer Science 2022-05-16 Yohan Poirier-Ginter , Alexandre Lessard , Ryan Smith , Jean-François Lalonde

Many applications of unpaired image-to-image translation require the input contents to be preserved semantically during translations. Unaware of the inherently unmatched semantics distributions between source and target domains, existing…

Computer Vision and Pattern Recognition · Computer Science 2021-10-07 Zhiwei Jia , Bodi Yuan , Kangkang Wang , Hong Wu , David Clifford , Zhiqiang Yuan , Hao Su

Generative adversarial networks using a cycle-consistency loss facilitate unpaired training of image-translation models and thereby exhibit a very high potential in manifold medical applications. However, the fact that images in one domain…

Image and Video Processing · Electrical Eng. & Systems 2021-01-12 Michael Gadermayr , Maximilian Tschuchnig , Laxmi Gupta , Dorit Merhof , Nils Krämer , Daniel Truhn , Burkhard Gess

Differentiable rendering has paved the way to training neural networks to perform "inverse graphics" tasks such as predicting 3D geometry from monocular photographs. To train high performing models, most of the current approaches rely on…

Computer Vision and Pattern Recognition · Computer Science 2021-04-22 Yuxuan Zhang , Wenzheng Chen , Huan Ling , Jun Gao , Yinan Zhang , Antonio Torralba , Sanja Fidler

In this work, we propose a novel Cycle In Cycle Generative Adversarial Network (C$^2$GAN) for the task of keypoint-guided image generation. The proposed C$^2$GAN is a cross-modal framework exploring a joint exploitation of the keypoint and…

Computer Vision and Pattern Recognition · Computer Science 2020-04-17 Hao Tang , Dan Xu , Gaowen Liu , Wei Wang , Nicu Sebe , Yan Yan

Generative adversarial networks (GANs) are currently rarely applied on 3D medical images of large size, due to their immense computational demand. The present work proposes a multi-scale patch-based GAN approach for establishing unpaired…

Image and Video Processing · Electrical Eng. & Systems 2020-10-13 Hristina Uzunova , Jan Ehrhardt , Heinz Handels

Recent advances in generative adversarial networks (GANs) have opened up the possibility of generating high-resolution photo-realistic images that were impossible to produce previously. The ability of GANs to sample from high-dimensional…

Computer Vision and Pattern Recognition · Computer Science 2021-10-11 Arthur Conmy , Subhadip Mukherjee , Carola-Bibiane Schönlieb

Image-to-image translation is to learn a mapping between images from a source domain and images from a target domain. In this paper, we introduce the attention mechanism directly to the generative adversarial network (GAN) architecture and…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Hajar Emami , Majid Moradi Aliabadi , Ming Dong , Ratna Babu Chinnam

GAN inversion aims to invert a given image back into the latent space of a pretrained GAN model, for the image to be faithfully reconstructed from the inverted code by the generator. As an emerging technique to bridge the real and fake…

Computer Vision and Pattern Recognition · Computer Science 2022-03-24 Weihao Xia , Yulun Zhang , Yujiu Yang , Jing-Hao Xue , Bolei Zhou , Ming-Hsuan Yang

Many image-to-image translation problems are ambiguous, as a single input image may correspond to multiple possible outputs. In this work, we aim to model a \emph{distribution} of possible outputs in a conditional generative modeling…

Computer Vision and Pattern Recognition · Computer Science 2018-10-25 Jun-Yan Zhu , Richard Zhang , Deepak Pathak , Trevor Darrell , Alexei A. Efros , Oliver Wang , Eli Shechtman

Generative Adversarial Networks (GANs) have significantly advanced image synthesis through mapping randomly sampled latent codes to high-fidelity synthesized images. However, applying well-trained GANs to real image editing remains…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Jiapeng Zhu , Yujun Shen , Yinghao Xu , Deli Zhao , Qifeng Chen , Bolei Zhou

Inverting a Generative Adversarial Network (GAN) facilitates a wide range of image editing tasks using pre-trained generators. Existing methods typically employ the latent space of GANs as the inversion space yet observe the insufficient…

Computer Vision and Pattern Recognition · Computer Science 2022-07-28 Qingyan Bai , Yinghao Xu , Jiapeng Zhu , Weihao Xia , Yujiu Yang , Yujun Shen

Image-to-image translation is considered a new frontier in the field of medical image analysis, with numerous potential applications. However, a large portion of recent approaches offers individualized solutions based on specialized…

Computer Vision and Pattern Recognition · Computer Science 2019-11-26 Karim Armanious , Chenming Jiang , Marc Fischer , Thomas Küstner , Konstantin Nikolaou , Sergios Gatidis , Bin Yang

Unpaired image-to-image translation of retinal images can efficiently increase the training dataset for deep-learning-based multi-modal retinal registration methods. Our method integrates a vessel segmentation network into the…

Image and Video Processing · Electrical Eng. & Systems 2023-06-06 Aline Sindel , Andreas Maier , Vincent Christlein

Real-world image manipulation has achieved fantastic progress in recent years as a result of the exploration and utilization of GAN latent spaces. GAN inversion is the first step in this pipeline, which aims to map the real image to the…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Tan M. Dinh , Anh Tuan Tran , Rang Nguyen , Binh-Son Hua

We present a Deep Convolutional Neural Network architecture which serves as a generic image-to-image regressor that can be trained end-to-end without any further machinery. Our proposed architecture: the Recursively Branched Deconvolutional…

Computer Vision and Pattern Recognition · Computer Science 2016-12-13 Venkataraman Santhanam , Vlad I. Morariu , Larry S. Davis

In this paper, we propose a principled Perceptual Adversarial Networks (PAN) for image-to-image transformation tasks. Unlike existing application-specific algorithms, PAN provides a generic framework of learning mapping relationship between…

Computer Vision and Pattern Recognition · Computer Science 2019-04-04 Chaoyue Wang , Chang Xu , Chaohui Wang , Dacheng Tao

Humans accumulate knowledge in a lifelong fashion. Modern deep neural networks, on the other hand, are susceptible to catastrophic forgetting: when adapted to perform new tasks, they often fail to preserve their performance on previously…

Computer Vision and Pattern Recognition · Computer Science 2021-04-27 Mengyao Zhai , Lei Chen , Jiawei He , Megha Nawhal , Frederick Tung , Greg Mori

Image-to-Image (I2I) translation is a heated topic in academia, and it also has been applied in real-world industry for tasks like image synthesis, super-resolution, and colorization. However, traditional I2I translation methods train data…

Computer Vision and Pattern Recognition · Computer Science 2020-10-28 Jialu Huang , Jing Liao , Sam Kwong