English
Related papers

Related papers: NSD-Imagery: A benchmark dataset for extending fMR…

200 papers

Reconstructing visual stimuli from brain recordings has been a meaningful and challenging task. Especially, the achievement of precise and controllable image reconstruction bears great significance in propelling the progress and utilization…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Yizhuo Lu , Changde Du , Qiongyi zhou , Dianpeng Wang , Huiguang He

Neural rendering techniques promise efficient photo-realistic image synthesis while at the same time providing rich control over scene parameters by learning the physical image formation process. While several supervised methods have been…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Hassan Abu Alhaija , Siva Karthik Mustikovela , Justus Thies , Varun Jampani , Matthias Nießner , Andreas Geiger , Carsten Rother

Decoding of seen visual contents with non-invasive brain recordings has important scientific and practical values. Efforts have been made to recover the seen images from brain signals. However, most existing approaches cannot faithfully…

Computer Vision and Pattern Recognition · Computer Science 2023-09-28 Jiaxuan Chen , Yu Qi , Yueming Wang , Gang Pan

Recent work has demonstrated that large-scale, multi-animal models are powerful tools for characterizing the relationship between neural activity and behavior. Current large-scale approaches, however, focus exclusively on either predicting…

Decoding brain signals accurately and efficiently is crucial for intra-cortical brain-computer interfaces. Traditional decoding approaches based on neural activity vector features suffer from low accuracy, whereas deep learning based…

Human-Computer Interaction · Computer Science 2025-04-15 Song Yang , Haotian Fu , Herui Zhang , Peng Zhang , Wei Li , Dongrui Wu

Multimodal neuroimaging modeling has becomes a widely used approach but confronts considerable challenges due to heterogeneity, which encompasses variability in data types, scales, and formats across modalities. This variability…

Neurons and Cognition · Quantitative Biology 2025-04-15 Gang Qu , Ziyu Zhou , Vince D. Calhoun , Aiying Zhang , Yu-Ping Wang

Medical image super-resolution (MedSR) is essential for improving diagnostic precision across diverse imaging modalities such as MRI, CT, X-ray, Ultrasound, and Fundus imaging. Despite rapid advances in deep learning, challenges remain in…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Subhash Gurappa , Trivikram Satharasi , Yashas Hariprasad , Sundararaj Sitharama Iyengar

Decoding behavior, perception, or cognitive state directly from neural signals has applications in brain-computer interface research as well as implications for systems neuroscience. In the last decade, deep learning has become the…

Neurons and Cognition · Quantitative Biology 2020-05-21 Jesse A. Livezey , Joshua I. Glaser

We introduce a novel cross-reference image quality assessment method that effectively fills the gap in the image assessment landscape, complementing the array of established evaluation schemes -- ranging from full-reference metrics like…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Zirui Wang , Wenjing Bian , Victor Adrian Prisacariu

Multimodal medical image fusion helps in combining contrasting features from two or more input imaging modalities to represent fused information in a single image. One of the pivotal clinical applications of medical image fusion is the…

Image and Video Processing · Electrical Eng. & Systems 2019-09-20 Nishant Kumar , Nico Hoffmann , Martin Oelschlägel , Edmund Koch , Matthias Kirsch , Stefan Gumhold

Objective: Acquiring fully sampled training data is challenging for many MRI applications. We present a self-supervised image reconstruction method, termed ReSiDe, capable of recovering images solely from undersampled data. Materials and…

Image and Video Processing · Electrical Eng. & Systems 2024-11-26 Muhammad Shafique , Sizhuo Liu , Philip Schniter , Rizwan Ahmad

In this article we use the Natural Scenes Dataset (NSD) to train a family of feature-weighted receptive field neural encoding models. These models use a pre-trained vision or text backbone and map extracted features to the voxel space via…

Neurons and Cognition · Quantitative Biology 2025-01-28 Uzair Hussain , Kamil Uludag

Retinal blood vessel segmentation can extract clinically relevant information from fundus images. As manual tracing is cumbersome, algorithms based on Convolution Neural Networks have been developed. Such studies have used small publicly…

Image and Video Processing · Electrical Eng. & Systems 2024-06-24 Jeremiah Fadugba , Patrick Köhler , Lisa Koch , Petru Manescu , Philipp Berens

Sophisticated visualization tools are essential for the presentation and exploration of human neuroimaging data. While two-dimensional orthogonal views of neuroimaging data are conventionally used to display activity and statistical…

This literature review will discuss the use of deep learning methods for image reconstruction using fMRI data. More specifically, the quality of image reconstruction will be determined by the choice in decoding and reconstruction…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Madison Van Horn

We present a cross-modality generation framework that learns to generate translated modalities from given modalities in MR images without real acquisition. Our proposed method performs NeuroImage-to-NeuroImage translation (abbreviated as…

Computer Vision and Pattern Recognition · Computer Science 2018-09-12 Qianye Yang , Nannan Li , Zixu Zhao , Xingyu Fan , Eric I-Chao Chang , Yan Xu

Functional magnetic resonance imaging (fMRI) is a powerful tool for investigating human brain function. However, the high cost of data acquisition and the inherent subjectivity of psychiatric rating scales often lead to datasets with small…

Machine Learning · Computer Science 2026-05-29 Jiyao Wang , Peiyu Duan , Nicha C. Dvornek , Lawrence H. Staib , Denis Sukhodolsky , Pamela Ventola , James S. Duncan

Recent advancements in Neural Surface Reconstruction (NSR) have significantly improved multi-view reconstruction when coupled with volume rendering. However, relying solely on photometric consistency in image space falls short of addressing…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Xinlin Ren , Chenjie Cao , Yanwei Fu , Xiangyang Xue

Human's perception of the visual world is shaped by the stereo processing of 3D information. Understanding how the brain perceives and processes 3D visual stimuli in the real world has been a longstanding endeavor in neuroscience. Towards…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Zhanqiang Guo , Jiamin Wu , Yonghao Song , Jiahui Bu , Weijian Mai , Qihao Zheng , Wanli Ouyang , Chunfeng Song