English
Related papers

Related papers: BrainAnytime: Anatomy-Aware Cross-Modal Pretrainin…

200 papers

Brain network analysis provides an interpretable framework for characterizing brain organization and has been widely used for neurological disorder identification. Recent advances in self-supervised learning have motivated the development…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Jiaxing Xu , Jingying Ma , Xin Lin , Yuxiao Liu , Kai He , Qika Lin , Yiping Ke , Yang Li , Dinggang Shen , Mengling Feng

Foundation models pretrained on large-scale datasets via self-supervised learning demonstrate exceptional versatility across various tasks. Due to the heterogeneity and hard-to-collect medical data, this approach is especially beneficial…

Computational Engineering, Finance, and Science · Computer Science 2024-03-05 Yanwu Yang , Chenfei Ye , Guinan Su , Ziyao Zhang , Zhikai Chang , Hairui Chen , Piu Chan , Yue Yu , Ting Ma

Brain age gap estimation (BrainAGE) is a promising imaging-derived biomarker of neurobiological aging and disease risk, yet current approaches rely predominantly on T1-weighted structural MRI (T1w), overlooking functional vascular changes…

Image and Video Processing · Electrical Eng. & Systems 2025-12-10 Jordan Jomsky , Kay C. Igwe , Zongyu Li , Yiren Zhang , Max Lashley , Tal Nuriel , Andrew Laine , Jia Guo

Brain imaging plays a crucial role in the diagnosis and treatment of various neurological disorders, providing valuable insights into the structure and function of the brain. Techniques such as magnetic resonance imaging (MRI) and computed…

Image and Video Processing · Electrical Eng. & Systems 2025-01-23 Fatima Haimour , Rizik Al-Sayyed , Waleed Mahafza , Omar S. Al-Kadi

Transfer learning represents a recent paradigm shift in the way we build artificial intelligence (AI) systems. In contrast to training task-specific models, transfer learning involves pre-training deep learning models on a large corpus of…

The burgeoning field of brain health research increasingly leverages artificial intelligence (AI) to interpret and analyze neurological data. This study introduces a novel approach towards the creation of medical foundation models by…

Image and Video Processing · Electrical Eng. & Systems 2024-11-08 Joseph Cox , Peng Liu , Skylar E. Stolte , Yunchao Yang , Kang Liu , Kyle B. See , Huiwen Ju , Ruogu Fang

The emergence of foundation models in neuroimaging is driven by the increasing availability of large-scale and heterogeneous brain imaging datasets. Recent advances in self-supervised learning, particularly reconstruction-based objectives,…

Machine Learning · Computer Science 2025-11-04 Ruthwik Reddy Doodipala , Pankaj Pandey , Carolina Torres Rojas , Manob Jyoti Saikia , Ranganatha Sitaram

Brain structural MRI has been widely used to assess the future progression of cognitive impairment (CI). Previous learning-based studies usually suffer from the issue of small-sized labeled training data, while there exist a huge amount of…

Image and Video Processing · Electrical Eng. & Systems 2023-06-27 Lintao Zhang , Jinjian Wu , Lihong Wang , Li Wang , David C. Steffens , Shijun Qiu , Guy G. Potter , Mingxia Liu

Recent advancements in the acquisition of various brain data sources have created new opportunities for integrating multimodal brain data to assist in early detection of complex brain disorders. However, current data integration approaches…

Image and Video Processing · Electrical Eng. & Systems 2023-05-26 Reza Shirkavand , Liang Zhan , Heng Huang , Li Shen , Paul M. Thompson

Deep unsupervised representation learning has recently led to new approaches in the field of Unsupervised Anomaly Detection (UAD) in brain MRI. The main principle behind these works is to learn a model of normal anatomy by learning to…

Image and Video Processing · Electrical Eng. & Systems 2020-04-09 Christoph Baur , Stefan Denner , Benedikt Wiestler , Shadi Albarqouni , Nassir Navab

Brain tumor segmentation remains a significant challenge, particularly in the context of multi-modal magnetic resonance imaging (MRI) where missing modality images are common in clinical settings, leading to reduced segmentation accuracy.…

Image and Video Processing · Electrical Eng. & Systems 2024-06-14 Zhongao Sun , Jiameng Li , Yuhan Wang , Jiarong Cheng , Qing Zhou , Chun Li

We propose a unified deep meta-learning framework for accelerated magnetic resonance imaging (MRI) that jointly addresses multi-coil reconstruction and cross-modality synthesis. Motivated by the limitations of conventional methods in…

Optimization and Control · Mathematics 2026-03-10 Merham Fouladvand , Peuroly Batra

Current fMRI foundation models primarily rely on a limited range of brain states and mismatched pretraining tasks, restricting their ability to learn generalized representations across diverse brain states. We present \textit{Brain-DiT}, a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Junfeng Xia , Wenhao Ye , Xuanye Pan , Xinke Shen , Mo Wang , Quanying Liu

Deep learning models have demonstrated great potential in medical 3D imaging, but their development is limited by the expensive, large volume of annotated data required. Active learning (AL) addresses this by training a model on a subset of…

Multi-modality images have been widely used and provide comprehensive information for medical image analysis. However, acquiring all modalities among all institutes is costly and often impossible in clinical settings. To leverage more…

Image and Video Processing · Electrical Eng. & Systems 2022-09-13 Qi Chang , Hui Qu , Zhennan Yan , Yunhe Gao , Lohendran Baskaran , Dimitris Metaxas

Structural magnetic resonance imaging (sMRI) provides accurate estimates of the brain's structural organization and learning invariant brain representations from sMRI is an enduring issue in neuroscience. Previous deep representation…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Ning Jiang , Gongshu Wang , Tianyi Yan

Despite the successes of deep neural networks on many challenging vision tasks, they often fail to generalize to new test domains that are not distributed identically to the training data. The domain adaptation becomes more challenging for…

Computer Vision and Pattern Recognition · Computer Science 2021-03-08 Devavrat Tomar , Manana Lortkipanidze , Guillaume Vray , Behzad Bozorgtabar , Jean-Philippe Thiran

Lesion detection in brain Magnetic Resonance Images (MRIs) remains a challenging task. MRIs are typically read and interpreted by domain experts, which is a tedious and time-consuming process. Recently, unsupervised anomaly detection (UAD)…

Image and Video Processing · Electrical Eng. & Systems 2022-02-01 Marcel Bengs , Finn Behrendt , Max-Heinrich Laves , Julia Krüger , Roland Opfer , Alexander Schlaefer

Brain encoding models aim to predict brain voxel-wise responses to stimuli images, replicating brain signals captured by neuroimaging techniques. There is a large volume of publicly available data, but training a comprehensive brain…

Computer Vision and Pattern Recognition · Computer Science 2023-07-27 Huzheng Yang , Jianbo Shi , James Gee

We propose a pre-training strategy called Multi-modal Multi-task Masked Autoencoders (MultiMAE). It differs from standard Masked Autoencoding in two key aspects: I) it can optionally accept additional modalities of information in the input…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Roman Bachmann , David Mizrahi , Andrei Atanov , Amir Zamir