English
Related papers

Related papers: Progress Towards Decoding Visual Imagery via fNIRS

200 papers

Reconstructing visual stimuli from measured functional magnetic resonance imaging (fMRI) has been a meaningful and challenging task. Previous studies have successfully achieved reconstructions with structures similar to the original images,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Yizhuo Lu , Changde Du , Dianpeng Wang , Huiguang He

We propose neural network layers that explicitly combine frequency and image feature representations and show that they can be used as a versatile building block for reconstruction from frequency space data. Our work is motivated by the…

Computer Vision and Pattern Recognition · Computer Science 2023-06-29 Nalini M. Singh , Juan Eugenio Iglesias , Elfar Adalsteinsson , Adrian V. Dalca , Polina Golland

High resolution diffusion MRI (dMRI) data is often constrained by limited scanning time in clinical settings, thus restricting the use of downstream analysis techniques that would otherwise be available. In this work we develop a 3D…

Image and Video Processing · Electrical Eng. & Systems 2022-03-30 Matthew Lyon , Paul Armitage , Mauricio A. Álvarez

Functional MRI (fMRI) is a powerful technique that has allowed us to characterize visual cortex responses to stimuli, yet such experiments are by nature constructed based on a priori hypotheses, limited to the set of images presented to the…

Neurons and Cognition · Quantitative Biology 2021-05-18 Zijin Gu , Keith W. Jamison , Meenakshi Khosla , Emily J. Allen , Yihan Wu , Thomas Naselaris , Kendrick Kay , Mert R. Sabuncu , Amy Kuceyeski

AI-based neural decoding reconstructs visual perception by leveraging generative models to map brain activity, measured through functional MRI (fMRI), into latent hierarchical representations. Traditionally, ridge linear models transform…

Image and Video Processing · Electrical Eng. & Systems 2025-09-04 Lorenzo Veronese , Andrea Moglia , Luca Mainardi , Pietro Cerveri

Accelerated MRI reconstructs images of clinical anatomies from sparsely sampled signal data to reduce patient scan times. While recent works have leveraged deep learning to accomplish this task, such approaches have often only been explored…

Image and Video Processing · Electrical Eng. & Systems 2022-12-01 Michael S. Yao , Michael S. Hansen

Decoding visual-semantic information from brain signals, such as functional MRI (fMRI), across different subjects poses significant challenges, including low signal-to-noise ratio, limited data availability, and cross-subject variability.…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Ruizhe Zheng , Lichao Sun

Functional near-infrared spectroscopy (fNIRS) is a valuable non-invasive tool for monitoring brain activity. The classification of fNIRS data in relation to conscious activity holds significance for advancing our understanding of the brain…

Machine Learning · Computer Science 2024-11-25 Zhihao Cao , Zizhou Luo

As a successful deep model applied in image super-resolution (SR), the Super-Resolution Convolutional Neural Network (SRCNN) has demonstrated superior performance to the previous hand-crafted models either in speed and restoration quality.…

Computer Vision and Pattern Recognition · Computer Science 2016-08-02 Chao Dong , Chen Change Loy , Xiaoou Tang

We present a method for fast resting-state fMRI spatial decomposi-tions of very large datasets, based on the reduction of the temporal dimension before applying dictionary learning on concatenated individual records from groups of subjects.…

Machine Learning · Statistics 2019-05-16 Arthur Mensch , Gaël Varoquaux , Bertrand Thirion

High-resolution whole-brain in vivo MR imaging at mesoscale resolutions remains challenging due to long scan durations, motion artifacts, and limited signal-to-noise ratio (SNR). This study proposes Rotating-view super-resolution…

Image and Video Processing · Electrical Eng. & Systems 2025-05-26 Jun Lyu , Lipeng Ning , William Consagra , Qiang Liu , Richard J. Rushmore , Berkin Bilgic , Yogesh Rathi

This paper presents a method for estimating the resolution of a digital holographic microscope using neural network analysis of reconstructed images. The spectral bandwidth of the source ($\Delta \lambda$) is used as a controlled image…

Optics · Physics 2026-05-12 A. G. Fedorov

Can we scale 4D pretraining to learn general space-time representations that reconstruct an object from a few views at some times to any view at any time? We provide an affirmative answer with 4D-LRM, the first large-scale 4D reconstruction…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Ziqiao Ma , Xuweiyi Chen , Shoubin Yu , Sai Bi , Kai Zhang , Chen Ziwen , Sihan Xu , Jianing Yang , Zexiang Xu , Kalyan Sunkavalli , Mohit Bansal , Joyce Chai , Hao Tan

While objects from different categories can be reliably decoded from fMRI brain response patterns, it has proved more difficult to distinguish visually similar inputs, such as different instances of the same category. Here, we apply a…

Human-Computer Interaction · Computer Science 2021-02-23 Rufin VanRullen , Leila Reddy

The volume estimation of brain regions from MRI data is a key problem in many clinical applications, where the acquisition of data at high spatial resolution is desirable. While parallel MRI and constrained image reconstruction algorithms…

Image and Video Processing · Electrical Eng. & Systems 2021-05-20 Aniket Pramanik , Xiaodong Wu , Mathews Jacob

We went below the MRI acceleration factors (a.k.a., k-space undersampling) reported by all published papers that reference the original fastMRI challenge, and then considered powerful deep learning based image enhancement methods to…

Computer Vision and Pattern Recognition · Computer Science 2021-10-01 Aleksandr Belov , Joel Stadelmann , Sergey Kastryulin , Dmitry V. Dylov

The computational imaging technique of Fourier Ptychographic Microscopy (FPM) enables high-resolution imaging with a wide field of view and can serve as an extremely valuable tool, e.g. in the classification of cells in medical…

Image and Video Processing · Electrical Eng. & Systems 2025-08-25 Navya Sonal Agarwal , Jan Philipp Schneider , Kanchana Vaishnavi Gandikota , Syed Muhammad Kazim , John Meshreki , Ivo Ihrke , Michael Moeller

In order to address the issue that medical image would suffer from severe blurring caused by the lack of high-frequency details in the process of image super-resolution reconstruction, a novel medical image super-resolution method based on…

Computer Vision and Pattern Recognition · Computer Science 2019-05-14 Kewen Liu , Yuan Ma , Hongxia Xiong , Zejun Yan , Zhijun Zhou , Panpan Fang , Chaoyang Liu

High-resolution (HR) magnetic resonance imaging (MRI) provides detailed anatomical information that is critical for diagnosis in the clinical application. However, HR MRI typically comes at the cost of long scan time, small spatial…

Computer Vision and Pattern Recognition · Computer Science 2020-03-10 Yuhua Chen , Anthony G. Christodoulou , Zhengwei Zhou , Feng Shi , Yibin Xie , Debiao Li

In neuroscience, all kinds of computation models were designed to answer the open question of how sensory stimuli are encoded by neurons and conversely, how sensory stimuli can be decoded from neuronal activities. Especially, functional…

Computer Vision and Pattern Recognition · Computer Science 2018-01-03 Kai Qiao , Chi Zhang , Linyuan Wang , Bin Yan , Jian Chen , Lei Zeng , Li Tong