English
Related papers

Related papers: MindTuner: Cross-Subject Visual Decoding with Visu…

200 papers

Visual decoding from brain signals is a key challenge at the intersection of computer vision and neuroscience, requiring methods that bridge neural representations and computational models of vision. A field-wide goal is to achieve…

Brain decoding aims to reconstruct visual perception of human subject from fMRI signals, which is crucial for understanding brain's perception mechanisms. Existing methods are confined to the single-subject paradigm due to substantial brain…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Yuqin Dai , Zhouheng Yao , Chunfeng Song , Qihao Zheng , Weijian Mai , Kunyu Peng , Shuai Lu , Wanli Ouyang , Jian Yang , Jiamin Wu

Research efforts for visual decoding from fMRI signals have attracted considerable attention in research community. Still multi-subject fMRI decoding with one model has been considered intractable due to the drastic variations in fMRI…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Inhwa Han , Jaayeon Lee , Jong Chul Ye

Previous brain decoding research primarily involves single-subject studies, reconstructing stimuli via fMRI activity from the same subject. Our study aims to introduce a generalization technique for cross-subject brain decoding, facilitated…

Neurons and Cognition · Quantitative Biology 2023-09-06 Matteo Ferrante , Tommaso Boccato , Nicola Toschi

Brain decoding is a field of computational neuroscience that uses measurable brain activity to infer mental states or internal representations of perceptual inputs. Therefore, we propose a novel approach to brain decoding that also relies…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Matteo Ferrante , Tommaso Boccato , Nicola Toschi

Brain decoding, a pivotal field in neuroscience, aims to reconstruct stimuli from acquired brain signals, primarily utilizing functional magnetic resonance imaging (fMRI). Currently, brain decoding is confined to a per-subject-per-model…

Computer Vision and Pattern Recognition · Computer Science 2024-04-12 Shizun Wang , Songhua Liu , Zhenxiong Tan , Xinchao Wang

Reconstructing video from brain signals is an important brain decoding task. Existing brain decoding frameworks are primarily built on a subject-dependent paradigm, which requires large amounts of brain data for each subject. However, the…

Multimedia · Computer Science 2025-11-19 Xuan-Hao Liu , Yan-Kai Liu , Tianyi Zhou , Bao-Liang Lu , Wei-Long Zheng

Deciphering visual content from functional Magnetic Resonance Imaging (fMRI) helps illuminate the human vision system. However, the scarcity of fMRI data and noise hamper brain decoding model performance. Previous approaches primarily…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Yulong Liu , Yongqiang Ma , Guibo Zhu , Haodong Jing , Nanning Zheng

Aiming to reconstruct visual stimuli from brain signals, brain decoding has recently made significant progress using functional magnetic resonance imaging (fMRI). However, it still has challenging issues such as substantial individual…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Shuai Jiang , Zhu Meng , Haiwen Li , Delong Liu , Fei Su , Zhicheng Zhao

Deep learning is leading to major advances in the realm of brain decoding from functional Magnetic Resonance Imaging (fMRI). However, the large inter-subject variability in brain characteristics has limited most studies to train models on…

Machine Learning · Computer Science 2023-12-12 Alexis Thual , Yohann Benchetrit , Felix Geilert , Jérémy Rapin , Iurii Makarov , Hubert Banville , Jean-Rémi King

Cross-subject brain-to-visual decoding remains a core challenge in brain-computer interfaces due to severe inter-individual variability that induces systematic subject-specific functional misalignment. To address this issue, we propose…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Jiaxiang Liu , Jiawei Du , Xupeng Chen , Guoqi Li , Jiang Cai , Simon Fong , Mingkun Xu

Reconstructing visual information from brain activity via computer vision technology provides an intuitive understanding of visual neural mechanisms. Despite progress in decoding fMRI data with generative models, achieving accurate…

Computer Vision and Pattern Recognition · Computer Science 2025-10-23 Shiyi Zhang , Dong Liang , Yihang Zhou

Decoding stimulus images from fMRI signals has advanced with pre-trained generative models. However, existing methods struggle with cross-subject mappings due to cognitive variability and subject-specific differences. This challenge arises…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Yangyang Xu , Bangzhen Liu , Wenqi Shao , Yong Du , Shengfeng He , Tingting Zhu

Reconstructing dynamic videos from fMRI is important for understanding visual cognition and enabling vivid brain-computer interfaces. However, current methods are critically limited to single-shot clips, failing to address the multi-shot…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Wenwen Zeng , Yonghuang Wu , Yifan Chen , Xuan Xie , Chengqian Zhao , Feiyu Yin , Guoqing Wu , Jinhua Yu

Decoding visual stimuli from neural activity is essential for understanding the human brain. While fMRI methods have successfully reconstructed static images, fMRI-to-video reconstruction faces challenges due to the need for capturing…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 Haonan Wang , Qixiang Zhang , Lehan Wang , Xuanqi Huang , Xiaomeng Li

Cross-subject visual decoding aims to reconstruct visual experiences from brain activity across individuals, enabling more scalable and practical brain-computer interfaces. However, existing methods often suffer from degraded performance…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Shumeng Li , Jintao Guo , Jian Zhang , Yulin Zhou , Luyang Cao , Yinghuan Shi

The development of algorithms to accurately decode neural information has long been a research focus in the field of neuroscience. Brain decoding typically involves training machine learning models to map neural data onto a preestablished…

Understanding how the brain encodes visual information is a central challenge in neuroscience and machine learning. A promising approach is to reconstruct visual stimuli, essentially images, from functional Magnetic Resonance Imaging (fMRI)…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Zheng Huang , Enpei Zhang , Weikang Qiu , Yinghao Cai , Carl Yang , Elynn Chen , Xiang Zhang , Rex Ying , Dawei Zhou , Yujun Yan

Reconstructions of visual perception from brain activity have improved tremendously, but the practical utility of such methods has been limited. This is because such models are trained independently per subject where each subject requires…

Understanding how the brain encodes external stimuli and how these stimuli can be decoded from the measured brain activities are long-standing and challenging questions in neuroscience. In this paper, we focus on reconstructing the complex…

Neurons and Cognition · Quantitative Biology 2022-10-05 Sikun Lin , Thomas Sprague , Ambuj K Singh
‹ Prev 1 2 3 10 Next ›