English
Related papers

Related papers: A Foundation Model for Brain MRI with Dynamic Moda…

200 papers

Data-driven approaches recently achieved remarkable success in magnetic resonance imaging (MRI) reconstruction, but integration into clinical routine remains challenging due to a lack of generalizability and interpretability. In this paper,…

Image and Video Processing · Electrical Eng. & Systems 2023-10-20 Martin Zach , Florian Knoll , Thomas Pock

Multimodal MR images can provide complementary information for accurate brain tumor segmentation. However, it's common to have missing imaging modalities in clinical practice. Since there exists a strong correlation between multi…

Image and Video Processing · Electrical Eng. & Systems 2021-04-21 Tongxue Zhou , Stéphane Canu , Pierre Vera , Su Ruan

Electroencephalography (EEG) foundation models hold significant promise for universal Brain-Computer Interfaces (BCIs). However, existing approaches often rely on end-to-end fine-tuning and exhibit limited efficacy under frozen-probing…

Machine Learning · Computer Science 2026-03-20 Jiquan Wang , Sha Zhao , Yangxuan Zhou , Yiming Kang , Shijian Li , Gang Pan

Magnetic Resonance Imaging (MRI) of the brain can come in the form of different modalities such as T1-weighted and Fluid Attenuated Inversion Recovery (FLAIR) which has been used to investigate a wide range of neurological disorders.…

Machine Learning · Computer Science 2019-12-11 Harrison Nguyen , Simon Luo , Fabio Ramos

In this work, we propose a multi-modal Convolutional Neural Network (CNN) approach for brain tumor segmentation. We investigate how to combine different modalities efficiently in the CNN framework.We adapt various fusion methods, which are…

Computer Vision and Pattern Recognition · Computer Science 2018-09-21 Mehmet Aygün , Yusuf Hüseyin Şahin , Gözde Ünal

The successful adaptation of foundation models to multi-modal medical imaging is a critical yet unresolved challenge. Existing models often struggle to effectively fuse information from multiple sources and adapt to the heterogeneous nature…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Shadi Alijani , Fereshteh Aghaee Meibodi , Homayoun Najjaran

Combining images from multi-modalities is beneficial to explore various information in computer vision, especially in the medical domain. As an essential part of clinical diagnosis, multi-modal brain tumor segmentation aims to delineate the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Zhongzhen Huang , Linda Wei , Shaoting Zhang , Xiaofan Zhang

Segmentation models for brain lesions in MRI are typically developed for a specific disease and trained on data with a predefined set of MRI modalities. Such models cannot segment the disease using data with a different set of MRI…

Image and Video Processing · Electrical Eng. & Systems 2024-11-20 Felix Wagner , Wentian Xu , Pramit Saha , Ziyun Liang , Daniel Whitehouse , David Menon , Virginia Newcombe , Natalie Voets , J. Alison Noble , Konstantinos Kamnitsas

Deformable image registration plays a fundamental role in medical image analysis by enabling spatial alignment of anatomical structures across subjects. While recent deep learning-based approaches have significantly improved computational…

Image and Video Processing · Electrical Eng. & Systems 2026-03-24 Jiaqi Shang , Haojin Wu , Yinyi Lai , Zongyu Li , Chenghao Zhang , Jia Guo

When it comes to clinical images, automatic segmentation has a wide variety of applications and a considerable diversity of input domains, such as different types of Magnetic Resonance Images (MRIs) and Computerized Tomography (CT) scans.…

Image and Video Processing · Electrical Eng. & Systems 2024-02-28 Matteo Bastico , David Ryckelynck , Laurent Corté , Yannick Tillier , Etienne Decencière

Functional magnetic resonance imaging (fMRI) is widely used for studying and diagnosing brain disorders, with functional connectivity (FC) matrices providing powerful representations of large-scale neural interactions. However, existing…

Tissues and Organs · Quantitative Biology 2026-04-17 Qianyu Chen , Shujian Yu

Functional connectivity (FC) derived from resting-state fMRI plays a critical role in personalized predictions such as age and cognitive performance. However, applying foundation models(FM) to fMRI data remains challenging due to its high…

Neurons and Cognition · Quantitative Biology 2025-08-26 Yanwen Wang , Xinglin Zhao , Yijin Song , Xiaobo Liu , Yanrong Hao , Rui Cao , Xin Wen

Deep learning has emerged as a promising approach for learning the nonlinear mapping between diffusion-weighted MR images and tissue parameters, which enables automatic and deep understanding of the brain microstructures. However, the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Wenxin Fan , Jian Cheng , Qiyuan Tian , Ruoyou Wu , Juan Zou , Zan Chen , Shanshan Wang

We present a keypoint-based foundation model for general purpose brain MRI registration, based on the recently-proposed KeyMorph framework. Our model, called BrainMorph, serves as a tool that supports multi-modal, pairwise, and scalable…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Alan Q. Wang , Rachit Saluja , Heejong Kim , Xinzi He , Adrian Dalca , Mert R. Sabuncu

Accurate brain tumor segmentation is essential for preoperative evaluation and personalized treatment. Multi-modal MRI is widely used due to its ability to capture complementary tumor features across different sequences. However, in…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Shenghao Zhu , Yifei Chen , Weihong Chen , Shuo Jiang , Guanyu Zhou , Yuanhan Wang , Feiwei Qin , Changmiao Wang , Qiyuan Tian

Multi-modality magnetic resonance imaging (MRI) is essential for the diagnosis and treatment of brain tumors. However, missing modalities are commonly observed due to limitations in scan time, scan corruption, artifacts, motion, and…

Image and Video Processing · Electrical Eng. & Systems 2025-01-08 Xiaojiao Xiao , Qinmin Vivian Hu , Guanghui Wang

Clinical diagnostic workups typically follow a modality escalation pathway: after initial clinical evaluation, clinicians begin with routine structural imaging (e.g., MRI), selectively add sequences such as FLAIR or T2 to refine the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Guangqian Yang , Tong Ding , Wenlong Hou , Yue Xun , Ye Du , Qian Niu , Shujun Wang

Image registration is a fundamental task that aligns anatomical structures between images. While CNNs perform well, they lack rotation equivariance - a rotated input does not produce a correspondingly rotated output. This hinders…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Arghavan Rezvani , Kun Han , Anthony T. Wu , Pooya Khosravi , Xiaohui Xie

The widespread use of Magnetic Resonance Imaging (MRI) in combination with deep learning shows promise for many high-impact automated diagnostic and prognostic tools. However, training new models requires large amounts of labeled data, a…

Image and Video Processing · Electrical Eng. & Systems 2025-07-24 Haoyu Dong , Yuwen Chen , Hanxue Gu , Nicholas Konz , Yaqian Chen , Qihang Li , Maciej A. Mazurowski

Normative modelling is an emerging method for understanding the underlying heterogeneity within brain disorders like Alzheimer Disease (AD) by quantifying how each patient deviates from the expected normative pattern that has been learned…

Image and Video Processing · Electrical Eng. & Systems 2026-02-06 Sayantan Kumar , Philip Payne , Aristeidis Sotiras