English
Related papers

Related papers: BrainMAE: A Region-aware Self-supervised Learning …

200 papers

Visual image reconstruction from functional Magnetic Resonance Imaging (fMRI) is a fundamental task in brain decoding, providing a crucial pathway for understanding human perceptual mechanisms and developing advanced brain-computer…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Yudan Ren , Pengcheng Shi , Zihan Ma , Xiaowei He , Xiao Li

Decoding visual stimuli from neural responses recorded by functional Magnetic Resonance Imaging (fMRI) presents an intriguing intersection between cognitive neuroscience and machine learning, promising advancements in understanding human…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Jingyuan Sun , Mingxiao Li , Zijiao Chen , Yunhao Zhang , Shaonan Wang , Marie-Francine Moens

Functional magnetic resonance imaging (fMRI) data is characterized by its complexity and high--dimensionality, encompassing signals from various regions of interests (ROIs) that exhibit intricate correlations. Analyzing fMRI data directly…

Applications · Statistics 2024-01-18 Yeseul Jeon , Jeong-Jae Kim , SuMin Yu , Junggu Choi , Sanghoon Han

Human perception plays a vital role in forming beliefs and understanding reality. A deeper understanding of brain functionality will lead to the development of novel deep neural networks. In this work, we introduce a novel framework named…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Xuan-Bac Nguyen , Xin Li , Pawan Sinha , Samee U. Khan , Khoa Luu

Masked AutoEncoders (MAE) have emerged as a robust self-supervised framework, offering remarkable performance across a wide range of downstream tasks. To increase the difficulty of the pretext task and learn richer visual representations,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Carlos Hinojosa , Shuming Liu , Bernard Ghanem

In modern neuroscience, functional magnetic resonance imaging (fMRI) has been a crucial and irreplaceable tool that provides a non-invasive window into the dynamics of whole-brain activity. Nevertheless, fMRI is limited by hemodynamic…

Signal Processing · Electrical Eng. & Systems 2024-01-26 Yamin Li , Ange Lou , Ziyuan Xu , Shiyu Wang , Catie Chang

The development of foundation models for functional magnetic resonance imaging (fMRI) time series holds significant promise for predicting phenotypes related to disease and cognition. Current models, however, are often trained using a…

Machine Learning · Computer Science 2026-03-03 Sam Gijsen , Marc-Andre Schulz , Kerstin Ritter

The human brain can be conceptualized as a dynamical system. Utilizing resting state fMRI time series imaging, we can study the underlying dynamics at ear-marked Regions of Interest (ROIs) to understand structure or lack thereof. This…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Ninad Aithal , Chakka Sai Pradeep , Neelam Sinha

Brain functional connectivity (FC) reveals biomarkers for identification of various neuropsychiatric disorders. Recent application of deep neural networks (DNNs) to connectome-based classification mostly relies on traditional convolutional…

Neurons and Cognition · Quantitative Biology 2024-01-31 Fuad Noman , Chee-Ming Ting , Hakmook Kang , Raphael C. -W. Phan , Brian D. Boyd , Warren D. Taylor , Hernando Ombao

Using deep learning models to recognize functional brain networks (FBNs) in functional magnetic resonance imaging (fMRI) has been attracting increasing interest recently. However, most existing work focuses on detecting static FBNs from…

Computer Vision and Pattern Recognition · Computer Science 2022-06-01 Yiheng Liu , Enjie Ge , Mengshen He , Zhengliang Liu , Shijie Zhao , Xintao Hu , Dajiang Zhu , Tianming Liu , Bao Ge

We present a foundation model for brain MRI that can work with different combinations of imaging sequences. The model uses one encoder with learnable modality embeddings, conditional layer normalization, and a masked autoencoding objective…

Computer Vision and Pattern Recognition · Computer Science 2025-11-06 Minh Sao Khue Luu , Bair N. Tuchinov

In recent years,the application of deep learning in task functional Magnetic Resonance Imaging (tfMRI) decoding has led to significant advancements. However,most studies remain constrained by assumption of temporal stationarity in neural…

Machine Learning · Computer Science 2025-03-05 Yueyang Wu , Sinan Yang , Yanming Wang , Jiajie He , Muhammad Mohsin Pathan , Bensheng Qiu , Xiaoxiao Wang

We address prevailing challenges of the brain-powered research, departing from the observation that the literature hardly recover accurate spatial information and require subject-specific models. To address these challenges, we propose…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Weihao Xia , Raoul de Charette , Cengiz Öztireli , Jing-Hao Xue

Data reconstruction is a widely used pre-training task to learn the generalized features for many downstream tasks. Although reconstruction tasks have been applied to neural signal completion and denoising, neural signal reconstruction is…

Neurons and Cognition · Quantitative Biology 2024-07-02 Youzhi Qu , Junfeng Xia , Xinyao Jian , Wendu Li , Kaining Peng , Zhichao Liang , Haiyan Wu , Quanying Liu

Recent studies in neuroscience highlight the significant potential of brain connectivity networks, which are commonly constructed from functional magnetic resonance imaging (fMRI) data for brain disorder diagnosis. Traditional brain…

We present a deep neural network method for learning a personal representation for individuals that are performing a self neuromodulation task, guided by functional MRI (fMRI). This neurofeedback task (watch vs. regulate) provides the…

Brain MRI underpins a wide range of neuroscientific and clinical applications, yet most learning-based methods remain task-specific and require substantial labeled data. Here we show that a single self-supervised representation can…

Machine Learning · Computer Science 2026-05-27 Yizhou Wu , Shansong Wang , Yuheng Li , Mojtaba Safari , Mingzhe Hu , Chih-Wei Chang , Harini Veeraraghavan , Xiaofeng Yang

Multimodal magnetic resonance imaging (MRI) constitutes the first line of investigation for clinicians in the care of brain tumors, providing crucial insights for surgery planning, treatment monitoring, and biomarker identification.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Lucas Robinet , Ahmad Berjaoui , Elizabeth Cohen-Jonathan Moyal

Historically, neuroscience has progressed by fragmenting into specialized domains, each focusing on isolated modalities, tasks, or brain regions. While fruitful, this approach hinders the development of a unified model of cognition. Here,…

Machine Learning · Computer Science 2025-07-31 Stéphane d'Ascoli , Jérémy Rapin , Yohann Benchetrit , Hubert Banville , Jean-Rémi King

In this work, we explore regions as a potential visual analogue of words for self-supervised image representation learning. Inspired by Masked Autoencoding (MAE), a generative pre-training baseline, we propose masked region autoencoding to…

Computer Vision and Pattern Recognition · Computer Science 2024-01-08 Duy-Kien Nguyen , Vaibhav Aggarwal , Yanghao Li , Martin R. Oswald , Alexander Kirillov , Cees G. M. Snoek , Xinlei Chen