English
Related papers

Related papers: Reconstructing Natural Scenes from fMRI Patterns u…

200 papers

Generative adversarial networks (GANs) have attained photo-realistic quality in image generation. However, how to best control the image content remains an open challenge. We introduce LatentKeypointGAN, a two-stage GAN which is trained…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Xingzhe He , Bastian Wandt , Helge Rhodin

Image reconstruction including image restoration and denoising is a challenging problem in the field of image computing. We present a new method, called X-GANs, for reconstruction of arbitrary corrupted resource based on a variant of…

Computer Vision and Pattern Recognition · Computer Science 2018-08-15 Longfei Liu , Sheng Li , Yisong Chen , Guoping Wang

Machine learning models are commonly trained end-to-end and in a supervised setting, using paired (input, output) data. Examples include recent super-resolution methods that train on pairs of (low-resolution, high-resolution) images.…

Computer Vision and Pattern Recognition · Computer Science 2021-12-10 Razvan V Marinescu , Daniel Moyer , Polina Golland

Image inpainting techniques have shown promising improvement with the assistance of generative adversarial networks (GANs) recently. However, most of them often suffered from completed results with unreasonable structure or blurriness. To…

Computer Vision and Pattern Recognition · Computer Science 2020-10-06 Zheng Hui , Jie Li , Xiumei Wang , Xinbo Gao

We present the first generative adversarial network (GAN) for natural image matting. Our novel generator network is trained to predict visually appealing alphas with the addition of the adversarial loss from the discriminator that is…

Computer Vision and Pattern Recognition · Computer Science 2018-07-27 Sebastian Lutz , Konstantinos Amplianitis , Aljosa Smolic

A class of recent approaches for generating images, called Generative Adversarial Networks (GAN), have been used to generate impressively realistic images of objects, bedrooms, handwritten digits and a variety of other image modalities.…

Computer Vision and Pattern Recognition · Computer Science 2017-06-08 Swaminathan Gurumurthy , Ravi Kiran Sarvadevabhatla , Venkatesh Babu Radhakrishnan

Generative adversarial networks (GANs) have shown remarkable success in generating realistic images and are increasingly used in medical imaging for image-to-image translation tasks. However, GANs tend to suffer from a frequency bias…

Image and Video Processing · Electrical Eng. & Systems 2023-10-18 Ivo M. Baltruschat , Felix Kreis , Alexander Hoelscher , Melanie Dohmen , Matthias Lenga

We combine generative adversarial network (GAN) with light microscopy to achieve deep learning super-resolution under a large field of view (FOV). By appropriately adopting prior microscopy data in an adversarial training, the neural…

Image and Video Processing · Electrical Eng. & Systems 2018-10-04 Hao Zhang , Xinlin Xie , Chunyu Fang , Yicong Yang , Di Jin , Peng Fei

For realistic and vivid colorization, generative priors have recently been exploited. However, such generative priors often fail for in-the-wild complex images due to their limited representation space. In this paper, we propose BigColor, a…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Geonung Kim , Kyoungkook Kang , Seongtae Kim , Hwayoon Lee , Sehoon Kim , Jonghyun Kim , Seung-Hwan Baek , Sunghyun Cho

Addressing the question of visualising human mind could help us to find regions that are associated with observed cognition and responsible for expressing the elusive mental image, leading to a better understanding of cognitive function.…

Neurons and Cognition · Quantitative Biology 2021-02-11 Pan Wang , Rui Zhou , Shuo Wang , Ling Li , Wenjia Bai , Jialu Fan , Chunlin Li , Peter Childs , Yike Guo

We show that pre-trained Generative Adversarial Networks (GANs) such as StyleGAN and BigGAN can be used as a latent bank to improve the performance of image super-resolution. While most existing perceptual-oriented approaches attempt to…

Computer Vision and Pattern Recognition · Computer Science 2022-08-01 Kelvin C. K. Chan , Xiangyu Xu , Xintao Wang , Jinwei Gu , Chen Change Loy

Recent advancements in real image editing have been attributed to the exploration of Generative Adversarial Networks (GANs) latent space. However, the main challenge of this procedure is GAN inversion, which aims to map the image to the…

Computer Vision and Pattern Recognition · Computer Science 2023-09-01 Egor Sevriugov , Ivan Oseledets

Decoding visual stimuli from neural responses recorded by functional Magnetic Resonance Imaging (fMRI) presents an intriguing intersection between cognitive neuroscience and machine learning, promising advancements in understanding human…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Jingyuan Sun , Mingxiao Li , Zijiao Chen , Yunhao Zhang , Shaonan Wang , Marie-Francine Moens

Deep generative models provide powerful tools for distributions over complicated manifolds, such as those of natural images. But many of these methods, including generative adversarial networks (GANs), can be difficult to train, in part…

Machine Learning · Statistics 2017-11-08 Akash Srivastava , Lazar Valkov , Chris Russell , Michael U. Gutmann , Charles Sutton

With the development of deep learning, the single super-resolution image reconstruction network models are becoming more and more complex. Small changes in hyperparameters of the models have a greater impact on model performance. In the…

Computer Vision and Pattern Recognition · Computer Science 2021-06-14 Yibo Guo , Haidi Wang , Yiming Fan , Shunyao Li , Mingliang Xu

Generative Adversarial Networks (GANs) have achieved state-of-the-art performance for several image generation and manipulation tasks. Different works have improved the limited understanding of the latent space of GANs by embedding images…

Computer Vision and Pattern Recognition · Computer Science 2020-10-22 Christian Bartz , Joseph Bethge , Haojin Yang , Christoph Meinel

Reconstructing images using brain signals of imagined visuals may provide an augmented vision to the disabled, leading to the advancement of Brain-Computer Interface (BCI) technology. The recent progress in deep learning has boosted the…

Human-Computer Interaction · Computer Science 2023-03-21 Prajwal Singh , Pankaj Pandey , Krishna Miyapuram , Shanmuganathan Raman

Generative adversarial networks (GANs) are unsupervised Deep Learning approach in the computer vision community which has gained significant attention from the last few years in identifying the internal structure of multimodal medical…

Image and Video Processing · Electrical Eng. & Systems 2020-05-22 Nripendra Kumar Singh , Khalid Raza

This literature review will discuss the use of deep learning methods for image reconstruction using fMRI data. More specifically, the quality of image reconstruction will be determined by the choice in decoding and reconstruction…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Madison Van Horn

Generative adversarial networks (GANs) can now generate photo-realistic images. However, how to best control the image content remains an open challenge. We introduce LatentKeypointGAN, a two-stage GAN internally conditioned on a set of…

Computer Vision and Pattern Recognition · Computer Science 2023-06-10 Xingzhe He , Bastian Wandt , Helge Rhodin