English
Related papers

Related papers: Through their eyes: multi-subject Brain Decoding w…

200 papers

Generative AI has recently propelled the decoding of images from brain activity. How do these approaches scale with the amount and type of neural recordings? Here, we systematically compare image decoding from four types of non-invasive…

Image and Video Processing · Electrical Eng. & Systems 2025-01-29 Hubert Banville , Yohann Benchetrit , Stéphane d'Ascoli , Jérémy Rapin , Jean-Rémi King

Brain encoding with neuroimaging data is an established analysis aimed at predicting human brain activity directly from complex stimuli features such as movie frames. Typically, these features are the latent space representation from an…

Machine Learning · Computer Science 2024-03-29 Sana Ahmadi , Pierre Bellec , Tristan Glatard

Inferring the functional specificity of brain regions from functional Magnetic Resonance Images (fMRI) data is a challenging statistical problem. While the General Linear Model (GLM) remains the standard approach for brain mapping,…

Machine Learning · Computer Science 2012-07-17 Fabian Pedregosa , Alexandre Gramfort , Gaël Varoquaux , Bertrand Thirion , Christophe Pallier , Elodie Cauvet

Cross-subject visual decoding aims to reconstruct visual experiences from brain activity across individuals, enabling more scalable and practical brain-computer interfaces. However, existing methods often suffer from degraded performance…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Shumeng Li , Jintao Guo , Jian Zhang , Yulin Zhou , Luyang Cao , Yinghuan Shi

Recent major milestones have successfully reconstructed natural language from non-invasive brain signals (e.g. functional Magnetic Resonance Imaging (fMRI) and Electroencephalogram (EEG)) across subjects. However, we find current dataset…

Computation and Language · Computer Science 2025-08-26 Congchi Yin , Qian Yu , Zhiwei Fang , Changping Peng , Piji Li

Brain decoding that classifies cognitive states using the functional fluctuations of the brain can provide insightful information for understanding the brain mechanisms of cognitive functions. Among the common procedures of decoding the…

Human-Computer Interaction · Computer Science 2024-07-12 Jianfei Zhu , Baichun Wei , Jiaru Tian , Feng Jiang , Chunzhi Yi

Brain decoding, understood as the process of mapping brain activities to the stimuli that generated them, has been an active research area in the last years. In the case of language stimuli, recent studies have shown that it is possible to…

Computation and Language · Computer Science 2020-11-12 Nicolas Affolter , Beni Egressy , Damian Pascual , Roger Wattenhofer

Reconstructing visual stimuli from human brain activity (e.g., fMRI) bridges neuroscience and computer vision by decoding neural representations. However, existing methods often overlook critical brain structure-function relationships,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Sijin Yu , Zijiao Chen , Wenxuan Wu , Shengxian Chen , Zhongliang Liu , Jingxin Nie , Xiaofen Xing , Xiangmin Xu , Xin Zhang

A fundamental challenge in neuroscience is to decode mental states from brain activity. While functional magnetic resonance imaging (fMRI) offers a non-invasive approach to capture brain-wide neural dynamics with high spatial precision,…

Image and Video Processing · Electrical Eng. & Systems 2025-07-31 Yueh-Po Peng , Vincent K. M. Cheung , Li Su

Decoding visual representations from brain signals has attracted significant attention in both neuroscience and artificial intelligence. However, the degree to which brain signals truly encode visual information remains unclear. Current…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Jiawen Zheng , Haonan Jia , Ming Li , Yuhui Zheng , Yufeng Zeng , Yang Gao , Chen Liang

Recent advances in neural decoding have enabled the reconstruction of visual experiences from brain activity, positioning fMRI-to-image reconstruction as a promising bridge between neuroscience and computer vision. However, current methods…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Haonan Wang , Jingyu Lu , Hongrui Li , Xiaomeng Li

Decoding approaches are widely used in neuroscience and machine learning to compare stimulus representations across neural systems, such as different brain regions, organisms, and deep learning models. Popular methods include decoding…

Neurons and Cognition · Quantitative Biology 2026-05-08 Johannes Bertram , Luciano Dyballa , T. Anderson Keller , Savik Kinger , Steven W. Zucker

Brain imaging classification is commonly approached from two perspectives: modeling the full image volume to capture global anatomical context, or constructing ROI-based graphs to encode localized and topological interactions. Although both…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Wei Liang , Lifang He

Decoding stimulus images from fMRI signals has advanced with pre-trained generative models. However, existing methods struggle with cross-subject mappings due to cognitive variability and subject-specific differences. This challenge arises…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Yangyang Xu , Bangzhen Liu , Wenqi Shao , Yong Du , Shengfeng He , Tingting Zhu

Previous studies have shown that it is possible to map brain activation data of subjects viewing images onto the feature representation space of not only vision models (modality-specific decoding) but also language models (cross-modal…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Mitja Nikolaus , Milad Mozafari , Nicholas Asher , Leila Reddy , Rufin VanRullen

Brain decoding involves the determination of a subject's cognitive state or an associated stimulus from functional neuroimaging data measuring brain activity. In this setting the cognitive state is typically characterized by an element of a…

Machine Learning · Statistics 2015-04-14 Nicole Croteau , Farouk S. Nathoo , Jiguo Cao , Ryan Budney

This work introduces a novel approach to fMRI-based visual image reconstruction using a subject-agnostic common representation space. We show that the brain signals of the subjects can be aligned in this common space during training to form…

Image and Video Processing · Electrical Eng. & Systems 2025-10-10 Christos Zangos , Danish Ebadulla , Thomas Christopher Sprague , Ambuj Singh

Brain decoding is a key neuroscience field that reconstructs the visual stimuli from brain activity with fMRI, which helps illuminate how the brain represents the world. fMRI-to-image reconstruction has achieved impressive progress by…

Neurons and Cognition · Quantitative Biology 2025-10-27 Guoying Sun , Weiyu Guo , Tong Shao , Yang Yang , Haijin Zeng , Jie Liu , Jingyong Su

Decoding brain functional states underlying different cognitive processes using multivariate pattern recognition techniques has attracted increasing interests in brain imaging studies. Promising performance has been achieved using brain…

Computer Vision and Pattern Recognition · Computer Science 2018-09-18 Hongming Li , Yong Fan

Every day, the human brain processes an immense volume of visual information, relying on intricate neural mechanisms to perceive and interpret these stimuli. Recent breakthroughs in functional magnetic resonance imaging (fMRI) have enabled…

Computer Vision and Pattern Recognition · Computer Science 2023-05-22 Matteo Ferrante , Furkan Ozcelik , Tommaso Boccato , Rufin VanRullen , Nicola Toschi