English
Related papers

Related papers: Towards Unified Neural Decoding with Brain Functio…

200 papers

Reconstructing perceived images from human brain activity forms a crucial link between human and machine learning through Brain-Computer Interfaces. Early methods primarily focused on training separate models for each individual to account…

Computer Vision and Pattern Recognition · Computer Science 2025-01-27 Zhibo Tian , Ruijie Quan , Fan Ma , Kun Zhan , Yi Yang

Decoding visual signals holds the tantalizing potential to unravel the complexities of cognition and perception. While recent studies have focused on reconstructing visual stimuli from neural recordings to bridge brain activity with visual…

Computational Engineering, Finance, and Science · Computer Science 2025-09-23 Zixiang Yin , Jiarui Li , Zhengming Ding

Brain decoding is a hot spot in cognitive science, which focuses on reconstructing perceptual images from brain activities. Analyzing the correlations of collected data from human brain activities and representing activity patterns are two…

Computer Vision and Pattern Recognition · Computer Science 2017-12-06 Siyu Yu , Nanning Zheng , Yongqiang Ma , Hao Wu , Badong Chen

Intracranial recordings have opened a unique opportunity to simultaneously measure activity across multiregional networks in the human brain. Recent works have focused on developing transformer-based neurofoundation models of such…

Machine Learning · Computer Science 2025-12-16 Lucine L. Oganesian , Saba Hashemi , Maryam M. Shanechi

Deciphering visual content from functional Magnetic Resonance Imaging (fMRI) helps illuminate the human vision system. However, the scarcity of fMRI data and noise hamper brain decoding model performance. Previous approaches primarily…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Yulong Liu , Yongqiang Ma , Guibo Zhu , Haodong Jing , Nanning Zheng

Registration of brain MRI images requires to solve a deformation field, which is extremely difficult in aligning intricate brain tissues, e.g., subcortical nuclei, etc. Existing efforts resort to decomposing the target deformation field…

Image and Video Processing · Electrical Eng. & Systems 2022-04-27 Jinxin Lv , Zhiwei Wang , Hongkuan Shi , Haobo Zhang , Sheng Wang , Yilang Wang , Qiang Li

We present a foundation model for brain MRI that can work with different combinations of imaging sequences. The model uses one encoder with learnable modality embeddings, conditional layer normalization, and a masked autoencoding objective…

Computer Vision and Pattern Recognition · Computer Science 2025-11-06 Minh Sao Khue Luu , Bair N. Tuchinov

In the past five years, the use of generative and foundational AI systems has greatly improved the decoding of brain activity. Visual perception, in particular, can now be decoded from functional Magnetic Resonance Imaging (fMRI) with…

Image and Video Processing · Electrical Eng. & Systems 2024-03-15 Yohann Benchetrit , Hubert Banville , Jean-Rémi King

Similar to how differences in the proficiency of the cardiovascular and musculoskeletal system predict an individual's athletic ability, differences in how the same brain region encodes information across individuals may explain their…

Neurons and Cognition · Quantitative Biology 2021-12-14 Jennifer Williams , Leila Wehbe

Aggregating multi-subject functional magnetic resonance imaging (fMRI) data is indispensable for generating valid and general inferences from patterns distributed across human brains. The disparities in anatomical structures and functional…

Machine Learning · Computer Science 2019-11-20 Weida Li , Mingxia Liu , Fang Chen , Daoqiang Zhang

Brain decoding is a popular multivariate approach for hypothesis testing in neuroimaging. It is well known that the brain maps derived from weights of linear classifiers are hard to interpret because of high correlations between predictors,…

Machine Learning · Statistics 2016-03-30 Seyed Mostafa Kia

The connection between brain activity and corresponding visual stimuli is crucial in comprehending the human brain. While deep generative models have exhibited advancement in recovering brain recordings by generating images conditioned on…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Xuelin Qian , Yikai Wang , Yanwei Fu , Xinwei Sun , Xiangyang Xue , Jianfeng Feng

Decoding human brain activity from electroencephalography (EEG) signals is a central challenge at the intersection of neuroscience and artificial intelligence, enabling diverse applications in mental state assessment, clinical monitoring,…

Human-Computer Interaction · Computer Science 2026-05-12 Weiheng Lu , Zhouheng Yao , Jiamin Wu , Pengyu Zhu , Yuchen Zhou , Weijian Mai , Qihao Zheng , Wanli Ouyang , Chunfeng Song

We introduce a method that takes advantage of high-quality pretrained multimodal representations to explore fine-grained semantic networks in the human brain. Previous studies have documented evidence of functional localization in the…

Artificial Intelligence · Computer Science 2023-06-07 Cory Efird , Alex Murphy , Joel Zylberberg , Alona Fyshe

Decoding visual information from human brain activity has seen remarkable advancements in recent research. However, the diversity in cortical parcellation and fMRI patterns across individuals has prompted the development of deep learning…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Guangyin Bao , Qi Zhang , Zixuan Gong , Jialei Zhou , Wei Fan , Kun Yi , Usman Naseem , Liang Hu , Duoqian Miao

Decoding cognitive states from functional magnetic resonance imaging is central to understanding the functional organization of the brain. Within-subject decoding avoids between-subject correspondence problems but requires large sample…

Image and Video Processing · Electrical Eng. & Systems 2025-01-28 Himanshu Aggarwal , Liza Al-Shikhley , Bertrand Thirion

Decoding brain signals accurately and efficiently is crucial for intra-cortical brain-computer interfaces. Traditional decoding approaches based on neural activity vector features suffer from low accuracy, whereas deep learning based…

Human-Computer Interaction · Computer Science 2025-04-15 Song Yang , Haotian Fu , Herui Zhang , Peng Zhang , Wei Li , Dongrui Wu

In neuroscience, understanding inter-individual differences has recently emerged as a major challenge, for which functional magnetic resonance imaging (fMRI) has proven invaluable. For this, neuroscientists rely on basic methods such as…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Akrem Sellami , François-Xavier Dupé , Bastien Cagna , Hachem Kadri , Stéphane Ayache , Thierry Artières , Sylvain Takerkart

In this work, we study the problem of cross-subject motor imagery (MI) decoding from electroencephalography (EEG) data. Multi-subject EEG datasets present several kinds of domain shifts due to various inter-individual differences (e.g.…

Signal Processing · Electrical Eng. & Systems 2024-02-22 Georgios Zoumpourlis , Ioannis Patras

Decoding visual representations from brain signals has attracted significant attention in both neuroscience and artificial intelligence. However, the degree to which brain signals truly encode visual information remains unclear. Current…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Jiawen Zheng , Haonan Jia , Ming Li , Yuhui Zheng , Yufeng Zeng , Yang Gao , Chen Liang