English
Related papers

Related papers: Psychometry: An Omnifit Model for Image Reconstruc…

200 papers

Deciphering visual content from functional Magnetic Resonance Imaging (fMRI) helps illuminate the human vision system. However, the scarcity of fMRI data and noise hamper brain decoding model performance. Previous approaches primarily…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Yulong Liu , Yongqiang Ma , Guibo Zhu , Haodong Jing , Nanning Zheng

Reconstructing perceived images from human brain activity monitored by functional magnetic resonance imaging (fMRI) is hard, especially for natural images. Existing methods often result in blurry and unintelligible reconstructions with low…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Mali Halac , Murat Isik , Hasan Ayaz , Anup Das

Multimodal physiological signals, such as EEG, ECG, EOG, and EMG, are crucial for healthcare and brain-computer interfaces. While existing methods rely on specialized architectures and dataset-specific fusion strategies, they struggle to…

Signal Processing · Electrical Eng. & Systems 2026-03-18 Wei-Bang Jiang , Xi Fu , Yi Ding , Cuntai Guan

Deep neural networks have been extensively studied for undersampled MRI reconstruction. While achieving state-of-the-art performance, they are trained and deployed specifically for one anatomy with limited generalization ability to another…

Computer Vision and Pattern Recognition · Computer Science 2021-03-10 Xinwen Liu , Jing Wang , Feng Liu , S. Kevin Zhou

Current AI frameworks for brain decoding and encoding, typically train and test models within the same datasets. This limits their utility for brain computer interfaces (BCI) or neurofeedback, for which it would be useful to pool…

Localizing neuronal activity in the brain, both in time and in space, is a central challenge to advance the understanding of brain function. Because of the inability of any single neuroimaging techniques to cover all aspects at once, there…

Neurons and Cognition · Quantitative Biology 2013-07-09 Yaroslav O. Halchenko , Michael Hanke , James V. Haxby , Stephen Jose Hanson , Christoph S. Herrmann

Brain decoding aims to reconstruct original stimuli from fMRI signals, providing insights into interpreting mental content. Current approaches rely heavily on subject-specific models due to the complex brain processing mechanisms and the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Zicheng Wang , Zhen Zhao , Luping Zhou , Parashkev Nachev

Every day, the human brain processes an immense volume of visual information, relying on intricate neural mechanisms to perceive and interpret these stimuli. Recent breakthroughs in functional magnetic resonance imaging (fMRI) have enabled…

Computer Vision and Pattern Recognition · Computer Science 2023-05-22 Matteo Ferrante , Furkan Ozcelik , Tommaso Boccato , Rufin VanRullen , Nicola Toschi

A core goal of functional neuroimaging is to study how the environment is processed in the brain. The mainstream paradigm involves concurrently measuring a broad spectrum of brain responses to a small set of environmental features…

Neurons and Cognition · Quantitative Biology 2021-06-14 Pedro F. da Costa , Rianne Haartsen , Elena Throm , Luke Mason , Anna Gui , Robert Leech , Emily J. H. Jones

Functional magnetic resonance imaging (fMRI) is widely used for studying and diagnosing brain disorders, with functional connectivity (FC) matrices providing powerful representations of large-scale neural interactions. However, existing…

Tissues and Organs · Quantitative Biology 2026-04-17 Qianyu Chen , Shujian Yu

Whole-body biometric recognition is a challenging multimodal task that integrates various biometric modalities, including face, gait, and body. This integration is essential for overcoming the limitations of unimodal systems. Traditionally,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Jie Zhu , Yiyang Su , Minchul Kim , Anil Jain , Xiaoming Liu

With the wide adoption of functional magnetic resonance imaging (fMRI) by cognitive neuroscience researchers, large volumes of brain imaging data have been accumulated in recent years. Aggregating these data to derive scientific insights…

Applications · Statistics 2020-06-01 Ming Bo Cai , Michael Shvartsman , Anqi Wu , Hejia Zhang , Xia Zhu

Reconstructing human vision from brain activities has been an appealing task that helps to understand our cognitive process. Even though recent research has seen great success in reconstructing static images from non-invasive brain…

Computer Vision and Pattern Recognition · Computer Science 2023-05-22 Zijiao Chen , Jiaxin Qing , Juan Helen Zhou

Recent fMRI-to-image approaches mainly focused on associating fMRI signals with specific conditions of pre-trained diffusion models. These approaches, while producing high-quality images, capture only a limited aspect of the complex…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Jingyang Huo , Yikai Wang , Xuelin Qian , Yun Wang , Chong Li , Jianfeng Feng , Yanwei Fu

A fundamental challenge in neuroscience is to decode mental states from brain activity. While functional magnetic resonance imaging (fMRI) offers a non-invasive approach to capture brain-wide neural dynamics with high spatial precision,…

Image and Video Processing · Electrical Eng. & Systems 2025-07-31 Yueh-Po Peng , Vincent K. M. Cheung , Li Su

In neuroimaging, extensive post-processing of resting-state functional MRI (rfMRI) data is necessary for its application and investigation in relation to brain-behavior associations. Such post-processing is used to derive brain…

Computational Geometry · Computer Science 2025-09-11 Ty Easley , Kevin Freese , Elizabeth Munch , Janine Bijsterbosch

Mental and cognitive representations are believed to reside on low-dimensional, non-linear manifolds embedded within high-dimensional brain activity. Uncovering these manifolds is key to understanding individual differences in brain…

Machine Learning · Computer Science 2025-05-02 Eloy Geenjaar , Vince Calhoun

Brain decoding is a field of computational neuroscience that uses measurable brain activity to infer mental states or internal representations of perceptual inputs. Therefore, we propose a novel approach to brain decoding that also relies…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Matteo Ferrante , Tommaso Boccato , Nicola Toschi

Functional magnetic resonance imaging (fMRI) has provided invaluable insight into our understanding of human behavior. However, large inter-individual differences in both brain anatomy and functional localization after anatomical alignment…

Applications · Statistics 2021-11-03 Guoqing Wang , Abhirup Datta , Martin A. Lindquist

The exploration of brain activity and its decoding from fMRI data has been a longstanding pursuit, driven by its potential applications in brain-computer interfaces, medical diagnostics, and virtual reality. Previous approaches have…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Xuelin Qian , Yun Wang , Jingyang Huo , Jianfeng Feng , Yanwei Fu