English
Related papers

Related papers: BrainMAE: A Region-aware Self-supervised Learning …

200 papers

Brain decoding is a key neuroscience field that reconstructs the visual stimuli from brain activity with fMRI, which helps illuminate how the brain represents the world. fMRI-to-image reconstruction has achieved impressive progress by…

Neurons and Cognition · Quantitative Biology 2025-10-27 Guoying Sun , Weiyu Guo , Tong Shao , Yang Yang , Haijin Zeng , Jie Liu , Jingyong Su

Diffusion MRI is a powerful tool that serves as a bridge between brain microstructure and cognition. Recent advancements in cognitive neuroscience have highlighted the persistent challenge of understanding how individual differences in…

Neurons and Cognition · Quantitative Biology 2024-09-25 Gabriela Gómez Jiménez , Demian Wassermann

The scarcity of annotated data in LiDAR point cloud understanding hinders effective representation learning. Consequently, scholars have been actively investigating efficacious self-supervised pre-training paradigms. Nevertheless, temporal…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Weijie Wei , Fatemeh Karimi Nejadasl , Theo Gevers , Martin R. Oswald

Functional Magnetic Resonance Imaging (fMRI) is a primary modality for studying brain activity. Modeling spatial dependence of imaging data at different scales is one of the main challenges of contemporary neuroimaging, and it could allow…

Applications · Statistics 2016-06-16 Stefano Castruccio , Hernando Ombao , Marc G. Genton

Neuroradiologists and neurosurgeons increasingly opt to use functional magnetic resonance imaging (fMRI) to map functionally relevant brain regions for noninvasive presurgical planning and intraoperative neuronavigation. This application…

Methodology · Statistics 2023-06-07 Andrew S. Whiteman , Andreas J. Bartsch , Jian Kang , Timothy D. Johnson

The goal of emotional brain state classification on functional MRI (fMRI) data is to recognize brain activity patterns related to specific emotion tasks performed by subjects during an experiment. Distinguishing emotional brain states from…

Image and Video Processing · Electrical Eng. & Systems 2022-11-01 Maxime Tchibozo , Donggeun Kim , Zijing Wang , Xiaofu He

Understanding how the brain responds to sensory inputs is challenging: brain recordings are partial, noisy, and high dimensional; they vary across sessions and subjects and they capture highly nonlinear dynamics. These challenges have led…

Neurons and Cognition · Quantitative Biology 2022-10-03 Omar Chehab , Alexandre Defossez , Jean-Christophe Loiseau , Alexandre Gramfort , Jean-Remi King

Brain decoding is a field of computational neuroscience that uses measurable brain activity to infer mental states or internal representations of perceptual inputs. Therefore, we propose a novel approach to brain decoding that also relies…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Matteo Ferrante , Tommaso Boccato , Nicola Toschi

We propose a new framework, called Hierarchical Multi-resolution Mesh Networks (HMMNs), which establishes a set of brain networks at multiple time resolutions of fMRI signal to represent the underlying cognitive process. The suggested…

Neural and Evolutionary Computing · Computer Science 2017-01-13 Itir Onal Ertugrul , Mete Ozay , Fatos Tunay Yarman Vural

Masked Autoencoders (MAE) have been popular paradigms for large-scale vision representation pre-training. However, MAE solely reconstructs the low-level RGB signals after the decoder and lacks supervision upon high-level semantics for the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Peng Gao , Renrui Zhang , Rongyao Fang , Ziyi Lin , Hongyang Li , Hongsheng Li , Qiao Yu

Intracranial recordings have opened a unique opportunity to simultaneously measure activity across multiregional networks in the human brain. Recent works have focused on developing transformer-based neurofoundation models of such…

Machine Learning · Computer Science 2025-12-16 Lucine L. Oganesian , Saba Hashemi , Maryam M. Shanechi

We study the problem of training self-supervised foundation models for functional MRI. Our main contributions are: (1) we introduce a new model family (CortexMAE) trained using the masked autoencoder framework on 2.1K hours of open fMRI…

An unprecedented amount of existing functional Magnetic Resonance Imaging (fMRI) data provides a new opportunity to understand the relationship between functional fluctuation and human cognition/behavior using a data-driven approach. To…

Machine Learning · Computer Science 2024-09-18 Jiaqi Ding , Tingting Dan , Ziquan Wei , Hyuna Cho , Paul J. Laurienti , Won Hwa Kim , Guorong Wu

Resting-state functional MRI (rs-fMRI) is a rich imaging modality that captures spontaneous brain activity patterns, revealing clues about the connectomic organization of the human brain. While many rs-fMRI studies have focused on static…

Machine Learning · Computer Science 2019-08-20 Meenakshi Khosla , Keith Jamison , Amy Kuceyeski , Mert R. Sabuncu

Existing deep learning models for functional MRI-based classification have limitations in network architecture determination (relying on experience) and feature space fusion (mostly simple concatenation, lacking mutual learning). Inspired…

Machine Learning · Computer Science 2025-08-19 Xiangxiang Cui , Min Zhao , Dongmei Zhi , Shile Qi , Vince D Calhoun , Jing Sui

Understanding the functional architecture of the brain in terms of networks is becoming increasingly common. In most fMRI applications functional networks are assumed to be stationary, resulting in a single network estimated for the entire…

Self-supervised pretraining is promising for large-scale neuroimaging, yet the impact of region-aware masking and hybrid sequence modeling remains underexplored. In this work, we introduce Rhamba, a region-aware pretraining framework that…

Recent learning-based approaches have made astonishing advances in calibrated medical imaging like computerized tomography (CT), yet they struggle to generalize in uncalibrated modalities -- notably magnetic resonance (MR) imaging, where…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Peirong Liu , Oula Puonti , Xiaoling Hu , Daniel C. Alexander , Juan E. Iglesias

Recent advances in deep learning have had a methodological and practical impact on brain-computer interface research. Among the various deep network architectures, convolutional neural networks have been well suited for…

Signal Processing · Electrical Eng. & Systems 2020-03-06 Wonjun Ko , Eunjin Jeon , Seungwoo Jeong , Heung-Il Suk

While functional magnetic resonance imaging (fMRI) offers valuable insights into brain activity, it is limited by high operational costs and significant infrastructural demands. In contrast, electroencephalography (EEG) provides…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Kristofer Grover Roos , Atsushi Fukuda , Quan Huu Cap