English
Related papers

Related papers: Reconstructing Natural Scenes from fMRI Patterns u…

200 papers

We present a new approach for representing and reconstructing multidimensional magnetic resonance imaging (MRI) data. Our method builds on a novel, learned feature-based image representation that disentangles different types of features,…

Image and Video Processing · Electrical Eng. & Systems 2026-01-01 Ruiyang Zhao , Fan Lam

Deep learning approaches heavily rely on high-quality human supervision which is nonetheless expensive, time-consuming, and error-prone, especially for image segmentation task. In this paper, we propose a method to automatically synthesize…

Computer Vision and Pattern Recognition · Computer Science 2021-12-06 Yu Yang , Hakan Bilen , Qiran Zou , Wing Yin Cheung , Xiangyang Ji

An important task in image processing and neuroimaging is to extract quantitative information from the acquired images in order to make observations about the presence of disease or markers of development in populations. Having a…

Computer Vision and Pattern Recognition · Computer Science 2018-11-27 Camilo Bermudez , Andrew J. Plassard , Larry T. Davis , Allen T. Newton , Susan M Resnick , Bennett A. Landman

Generative Adversarial Networks (GAN) have demonstrated the potential to recover realistic details for single image super-resolution (SISR). To further improve the visual quality of super-resolved results, PIRM2018-SR Challenge employed…

Computer Vision and Pattern Recognition · Computer Science 2021-07-21 Wenlong Zhang , Yihao Liu , Chao Dong , Yu Qiao

Recent advances in brain-vision decoding have driven significant progress, reconstructing with high fidelity perceived visual stimuli from neural activity, e.g., functional magnetic resonance imaging (fMRI), in the human visual cortex. Most…

Computer Vision and Pattern Recognition · Computer Science 2025-07-04 Le Xu , Qi Zhang , Qixian Zhang , Hongyun Zhang , Duoqian Miao , Cairong Zhao

Recent attempts at Super-Resolution for medical images used deep learning techniques such as Generative Adversarial Networks (GANs) to achieve perceptually realistic single image Super-Resolution. Yet, they are constrained by their…

Image and Video Processing · Electrical Eng. & Systems 2020-06-05 Chuan Tan , Jin Zhu , Pietro Lio'

This tutorial covers biomedical image reconstruction, from the foundational concepts of system modeling and direct reconstruction to modern sparsity and learning-based approaches. Imaging is a critical tool in biological research and…

Image and Video Processing · Electrical Eng. & Systems 2021-03-12 Michael T. McCann , Michael Unser

In this paper, an image recognition algorithm based on the combination of deep learning and generative adversarial network (GAN) is studied, and compared with traditional image recognition methods. The purpose of this study is to evaluate…

Computer Vision and Pattern Recognition · Computer Science 2024-08-08 Yihao Zhong , Yijing Wei , Yingbin Liang , Xiqing Liu , Rongwei Ji , Yiru Cang

It is well-known that GANs are difficult to train, and several different techniques have been proposed in order to stabilize their training. In this paper, we propose a novel training method called manifold-matching, and a new GAN model…

In this paper, we propose a novel application of Generative Adversarial Networks (GAN) to the synthesis of cells imaged by fluorescence microscopy. Compared to natural images, cells tend to have a simpler and more geometric global structure…

Computer Vision and Pattern Recognition · Computer Science 2017-09-13 Anton Osokin , Anatole Chessel , Rafael E. Carazo Salas , Federico Vaggi

State-of-the-art models for high-resolution image generation, such as BigGAN and VQVAE-2, require an incredible amount of compute resources and/or time (512 TPU-v3 cores) to train, putting them out of reach for the larger research…

Image and Video Processing · Electrical Eng. & Systems 2020-10-27 Seungwook Han , Akash Srivastava , Cole Hurwitz , Prasanna Sattigeri , David D. Cox

Despite remarkable recent progress on both unconditional and conditional image synthesis, it remains a long-standing problem to learn generative models that are capable of synthesizing realistic and sharp images from reconfigurable spatial…

Computer Vision and Pattern Recognition · Computer Science 2019-08-21 Wei Sun , Tianfu Wu

Image composition is a complex task which requires a lot of information about the scene for an accurate and realistic composition, such as perspective, lighting, shadows, occlusions, and object interactions. Previous methods have…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Amr Ghoneim , Jiju Poovvancheri , Yasushi Akiyama , Dong Chen

Functional magnetic resonance imaging (fMRI) based image reconstruction plays a pivotal role in decoding human perception, with applications in neuroscience and brain-computer interfaces. While recent advancements in deep learning and…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Weiyu Guo , Guoying Sun , JianXiang He , Tong Shao , Shaoguang Wang , Ziyang Chen , Meisheng Hong , Ying Sun , Hui Xiong

StyleGAN is a state-of-art generative adversarial network architecture that generates random 2D high-quality synthetic facial data samples. In this paper, we recap the StyleGAN architecture and training methodology and present our…

Neural and Evolutionary Computing · Computer Science 2020-03-25 Viktor Varkarakis , Shabab Bazrafkan , Peter Corcoran

Generative adversarial networks achieve great performance in photorealistic image synthesis in various domains, including human images. However, they usually employ latent vectors that encode the sampled outputs globally. This does not…

Computer Vision and Pattern Recognition · Computer Science 2021-03-15 Kripasindhu Sarkar , Lingjie Liu , Vladislav Golyanik , Christian Theobalt

Most deep learning models are data-driven and the excellent performance is highly dependent on the abundant and diverse datasets. However, it is very hard to obtain and label the datasets of some specific scenes or applications. If we train…

Computer Vision and Pattern Recognition · Computer Science 2022-03-09 Tianxiao Zhang , Wenchi Ma , Guanghui Wang

Blind face restoration (BFR) from severely degraded face images in the wild is a very challenging problem. Due to the high illness of the problem and the complex unknown degradation, directly training a deep neural network (DNN) usually…

Computer Vision and Pattern Recognition · Computer Science 2021-05-14 Tao Yang , Peiran Ren , Xuansong Xie , Lei Zhang

We propose a training and evaluation approach for autoencoder Generative Adversarial Networks (GANs), specifically the Boundary Equilibrium Generative Adversarial Network (BEGAN), based on methods from the image quality assessment…

Computer Vision and Pattern Recognition · Computer Science 2017-08-09 Michael O. Vertolli , Jim Davies

Multimodal functional neuroimaging enables systematic analysis of brain mechanisms and provides discriminative representations for brain-computer interface (BCI) decoding. However, its acquisition is constrained by high costs and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Weiheng Yao , Xuhang Chen , Shuqiang Wang