English
Related papers

Related papers: BrainDINO: A Brain MRI Foundation Model for Genera…

200 papers

Foundation models have transformed vision and language by learning general-purpose representations from large-scale unlabeled data, yet 3D medical imaging lacks analogous approaches. Existing self-supervised methods rely on low-level…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Yunhe Gao , Yabin Zhang , Chong Wang , Jiaming Liu , Maya Varma , Jean-Benoit Delbrouck , Akshay Chaudhari , Curtis Langlotz

Cognitive neuroscience is enjoying rapid increase in extensive public brain-imaging datasets. It opens the door to large-scale statistical models. Finding a unified perspective for all available data calls for scalable and automated…

Machine Learning · Statistics 2019-05-16 Arthur Mensch , Julien Mairal , Danilo Bzdok , Bertrand Thirion , Gaël Varoquaux

Deep learning-based models in medical imaging often struggle to generalize effectively to new scans due to data heterogeneity arising from differences in hardware, acquisition parameters, population, and artifacts. This limitation presents…

Image and Video Processing · Electrical Eng. & Systems 2023-08-09 Sebastian Nørgaard Llambias , Mads Nielsen , Mostafa Mehdipour Ghazi

Real-life medical data is often multimodal and incomplete, fueling the growing need for advanced deep learning models capable of integrating them efficiently. The use of diverse modalities, including histopathology slides, MRI, and genetic…

Artificial Intelligence · Computer Science 2024-10-02 Lucas Robinet , Ahmad Berjaoui , Ziad Kheil , Elizabeth Cohen-Jonathan Moyal

The development of foundation models for functional magnetic resonance imaging (fMRI) time series holds significant promise for predicting phenotypes related to disease and cognition. Current models, however, are often trained using a…

Machine Learning · Computer Science 2026-03-03 Sam Gijsen , Marc-Andre Schulz , Kerstin Ritter

Anomaly detection in MRI is of high clinical value in imaging and diagnosis. Unsupervised methods for anomaly detection provide interesting formulations based on reconstruction or latent embedding, offering a way to observe properties…

Image and Video Processing · Electrical Eng. & Systems 2022-11-29 Ayantika Das , Arun Palla , Keerthi Ram , Mohanasankar Sivaprakasam

The DINO family of self-supervised vision models has shown remarkable transferability, yet effectively adapting their representations for segmentation remains challenging. Existing approaches often rely on heavy decoders with multi-scale…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Sicheng Yang , Hongqiu Wang , Zhaohu Xing , Sixiang Chen , Lei Zhu

Brain imaging classification is commonly approached from two perspectives: modeling the full image volume to capture global anatomical context, or constructing ROI-based graphs to encode localized and topological interactions. Although both…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Wei Liang , Lifang He

In neuroimaging analysis, fMRI can well assess the function changes for brain diseases with no obvious structural lesions. To date, most deep-learning-based fMRI studies have employed functional connectivity (FC) as the basic feature for…

Image and Video Processing · Electrical Eng. & Systems 2023-03-03 Wei Dai , Ziyao Zhang , Lixia Tian , Shengyuan Yu , Shuhui Wang , Zhao Dong , Hairong Zheng

The burgeoning field of brain health research increasingly leverages artificial intelligence (AI) to interpret and analyze neurological data. This study introduces a novel approach towards the creation of medical foundation models by…

Image and Video Processing · Electrical Eng. & Systems 2024-11-08 Joseph Cox , Peng Liu , Skylar E. Stolte , Yunchao Yang , Kang Liu , Kyle B. See , Huiwen Ju , Ruogu Fang

Foundation models are transforming neuroscience but are often prohibitively large, data-hungry, and difficult to deploy. Here, we introduce BrainSymphony, a lightweight and parameter-efficient foundation model with plug-and-play integration…

Quantitative Methods · Quantitative Biology 2026-02-13 Moein Khajehnejad , Forough Habibollahi , Devon Stoliker , Adeel Razi

A fundamental challenge in neuroscience is to decode mental states from brain activity. While functional magnetic resonance imaging (fMRI) offers a non-invasive approach to capture brain-wide neural dynamics with high spatial precision,…

Image and Video Processing · Electrical Eng. & Systems 2025-07-31 Yueh-Po Peng , Vincent K. M. Cheung , Li Su

The segmentation of brain tumors in multimodal MRIs is one of the most challenging tasks in medical image analysis. The recent state of the art algorithms solving this task is based on machine learning approaches and deep learning in…

Image and Video Processing · Electrical Eng. & Systems 2020-02-11 Dmitrii Lachinov , Elena Shipunova , Vadim Turlapov

We present Brain Harmony (BrainHarmonix), the first multimodal brain foundation model that unifies structural morphology and functional dynamics into compact 1D token representations. The model was pretrained on two of the largest…

Deep learning models usually require sufficient training data to achieve high accuracy, but obtaining labeled data can be time-consuming and labor-intensive. Here we introduce a template-based training method to train a 3D U-Net model from…

Image and Video Processing · Electrical Eng. & Systems 2023-08-07 Fang-Cheng Yeh

Detection of various lesions in brain MRI is clinically critical, but challenging due to the diversity of lesions and variability in imaging conditions. Current unsupervised learning methods detect anomalies mainly through reconstructing…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Tao Yang , Xiuying Wang , Hao Liu , Guanzhong Gong , Lian-Ming Wu , Yu-Ping Wang , Lisheng Wang

Fetal brain MRI is useful for diagnosing brain abnormalities but is challenged by fetal motion. The current protocol for T2-weighted fetal brain MRI is not robust to motion so image volumes are degraded by inter- and intra- slice motion…

Image and Video Processing · Electrical Eng. & Systems 2020-06-24 Junshen Xu , Sayeri Lala , Borjan Gagoski , Esra Abaci Turk , P. Ellen Grant , Polina Golland , Elfar Adalsteinsson

Functional magnetic resonance imaging (fMRI) is widely used for studying and diagnosing brain disorders, with functional connectivity (FC) matrices providing powerful representations of large-scale neural interactions. However, existing…

Tissues and Organs · Quantitative Biology 2026-04-17 Qianyu Chen , Shujian Yu

Predicting future brain state from a baseline magnetic resonance image (MRI) is a central challenge in neuroimaging and has important implications for studying neurodegenerative diseases such as Alzheimer's disease (AD). Most existing…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Ali Farki , Elaheh Moradi , Deepika Koundal , Jussi Tohka

Self-supervised pretraining has become the mainstream approach for learning MRI representations from unlabeled scans. However, most existing objectives still treat each scan primarily as static aggregations of slices, patches or volumes. We…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Yu Wang , Qingchao Chen