English
Related papers

Related papers: Brain Harmony: A Multimodal Foundation Model Unify…

200 papers

Foundation models are transforming neuroscience but are often prohibitively large, data-hungry, and difficult to deploy. Here, we introduce BrainSymphony, a lightweight and parameter-efficient foundation model with plug-and-play integration…

Quantitative Methods · Quantitative Biology 2026-02-13 Moein Khajehnejad , Forough Habibollahi , Devon Stoliker , Adeel Razi

We present a keypoint-based foundation model for general purpose brain MRI registration, based on the recently-proposed KeyMorph framework. Our model, called BrainMorph, serves as a tool that supports multi-modal, pairwise, and scalable…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Alan Q. Wang , Rachit Saluja , Heejong Kim , Xinzi He , Adrian Dalca , Mert R. Sabuncu

Multimodal learning, especially large-scale multimodal pre-training, has developed rapidly over the past few years and led to the greatest advances in artificial intelligence (AI). Despite its effectiveness, understanding the underlying…

Neural and Evolutionary Computing · Computer Science 2022-08-18 Haoyu Lu , Qiongyi Zhou , Nanyi Fei , Zhiwu Lu , Mingyu Ding , Jingyuan Wen , Changde Du , Xin Zhao , Hao Sun , Huiguang He , Ji-Rong Wen

Magnetic resonance imaging~(MRI) have played a crucial role in brain disease diagnosis, with which a range of computer-aided artificial intelligence methods have been proposed. However, the early explorations usually focus on the limited…

Computer Vision and Pattern Recognition · Computer Science 2023-09-14 Jiayu Lei , Lisong Dai , Haoyun Jiang , Chaoyi Wu , Xiaoman Zhang , Yao Zhang , Jiangchao Yao , Weidi Xie , Yanyong Zhang , Yuehua Li , Ya Zhang , Yanfeng Wang

Electroencephalography (EEG) and magnetoencephalography (MEG) measure neural activity non-invasively by capturing electromagnetic fields generated by dendritic currents. Although rooted in the same biophysics, EEG and MEG exhibit distinct…

Signal Processing · Electrical Eng. & Systems 2025-10-16 Qinfan Xiao , Ziyun Cui , Chi Zhang , Siqi Chen , Wen Wu , Andrew Thwaites , Alexandra Woolgar , Bowen Zhou , Chao Zhang

The burgeoning field of brain health research increasingly leverages artificial intelligence (AI) to interpret and analyze neurological data. This study introduces a novel approach towards the creation of medical foundation models by…

Image and Video Processing · Electrical Eng. & Systems 2024-11-08 Joseph Cox , Peng Liu , Skylar E. Stolte , Yunchao Yang , Kang Liu , Kyle B. See , Huiwen Ju , Ruogu Fang

Neuroscience and artificial intelligence represent distinct yet complementary pathways to general intelligence. However, amid the ongoing boom in AI research and applications, the translational synergy between these two fields has grown…

Neural and Evolutionary Computing · Computer Science 2026-01-30 Baiyu Chen , Yujie Wu , Siyuan Xu , Peng Qu , Dehua Wu , Xu Chu , Haodong Bian , Shuo Zhang , Bo Xu , Youhui Zhang , Zhengyu Ma , Guoqi Li

In clinical practice, medical segmentation datasets are often limited and heterogeneous, with variations in modalities, protocols, and anatomical targets across institutions. Existing deep learning models struggle to jointly learn from such…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Weiwei Ma , Xiaobing Yu , Peijie Qiu , Jin Yang , Pan Xiao , Xiaoqi Zhao , Xiaofeng Liu , Tomo Miyazaki , Shinichiro Omachi , Yongsong Huang

Brain foundation models have achieved remarkable advances across a wide range of neuroscience tasks. However, most existing models are limited to a single functional modality, restricting their ability to exploit complementary…

Machine Learning · Computer Science 2026-05-18 Hanning Guo , Hanwen Bi , Farah Abdellatif , Andrei Galbenus , Jon. N. Shah , Abigail Morrison , Jürgen Dammers

We present a foundation model for brain MRI that can work with different combinations of imaging sequences. The model uses one encoder with learnable modality embeddings, conditional layer normalization, and a masked autoencoding objective…

Computer Vision and Pattern Recognition · Computer Science 2025-11-06 Minh Sao Khue Luu , Bair N. Tuchinov

Clinical diagnostic workups typically follow a modality escalation pathway: after initial clinical evaluation, clinicians begin with routine structural imaging (e.g., MRI), selectively add sequences such as FLAIR or T2 to refine the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Guangqian Yang , Tong Ding , Wenlong Hou , Yue Xun , Ye Du , Qian Niu , Shujun Wang

Foundation models in artificial intelligence (AI) are transforming medical imaging by enabling general-purpose feature learning from large-scale, unlabeled datasets. In this work, we introduce BrainFound, a self-supervised foundation model…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Moona Mazher , Geoff J. M. Parker , Daniel C. Alexander

Aggregating multi-site brain MRI data can enhance deep learning model training, but also introduces non-biological heterogeneity caused by site-specific variations (e.g., differences in scanner vendors, acquisition parameters, and imaging…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Mengqi Wu , Yongheng Sun , Qianqian Wang , Pew-Thian Yap , Mingxia Liu

Modeling the interplay between external stimuli and internal neural representations is a pivotal research area for Brain-Computer Interfaces (BCIs). A major limitation of prior work is the prevailing paradigm of specialized, single-task…

Artificial Intelligence · Computer Science 2026-05-29 Yizhuo Lu , Changde Du , Qingyu Shi , Hang Chen , Jie Peng , Liuyun Jiang , Shuangchen Zhao , Huiguang He

Foundation models pretrained on large-scale datasets via self-supervised learning demonstrate exceptional versatility across various tasks. Due to the heterogeneity and hard-to-collect medical data, this approach is especially beneficial…

Computational Engineering, Finance, and Science · Computer Science 2024-03-05 Yanwu Yang , Chenfei Ye , Guinan Su , Ziyao Zhang , Zhikai Chang , Hairui Chen , Piu Chan , Yue Yu , Ting Ma

Foundation models (FMs), large neural networks pretrained on extensive and diverse datasets, have revolutionized artificial intelligence and shown significant promise in medical imaging by enabling robust performance with limited labeled…

Image and Video Processing · Electrical Eng. & Systems 2025-06-17 Salah Ghamizi , Georgia Kanli , Yu Deng , Magali Perquin , Olivier Keunen

In neuroimaging analysis, fMRI can well assess the function changes for brain diseases with no obvious structural lesions. To date, most deep-learning-based fMRI studies have employed functional connectivity (FC) as the basic feature for…

Image and Video Processing · Electrical Eng. & Systems 2023-03-03 Wei Dai , Ziyao Zhang , Lixia Tian , Shengyuan Yu , Shuhui Wang , Zhao Dong , Hairong Zheng

Brain Foundation Models (BFMs) are transforming neuroscience by enabling scalable and transferable learning from neural signals, advancing both clinical diagnostics and cutting-edge neuroscience exploration. Their emergence is powered by…

Machine Learning · Computer Science 2026-02-13 Fanqi Shen , Enhong Yang , Jiahe Li , Junru Hong , Xiaoran Pan , Zhizhang Yuan , Meng Li , Yang Yang

Multimodal MRI offers complementary multi-scale information to characterize the brain structure. However, it remains challenging to effectively integrate multimodal MRI while achieving neuroscience interpretability. Here we propose to use…

Neurons and Cognition · Quantitative Biology 2025-12-15 Chengzhi Xia , Jianwei Chen , Yixuan Jiang , Qi Yan , Chao Li

Contemporary computational neuroscience features two prominent modeling traditions. Bottom-up whole-brain modeling (WBM) builds biophysically detailed simulations of brain structure and dynamics, whereas top-down neuroconnectionism…

Neurons and Cognition · Quantitative Biology 2026-05-19 Mario Senden , Leonardo Dalla Porta , Jan Fousek , Jorge F. Mejias , Gorka Zamora-López
‹ Prev 1 2 3 10 Next ›