中文

面向心脏 MRI 综合评估的视觉基础模型

图像与视频处理 2025-12-03 v2 人工智能 计算机视觉与模式识别

摘要

心脏磁共振成像 (CMR) 被视为无创心脏评估的金标准,是一种多样且复杂的模态, requiring various image processing tasks for comprehensive assessment of cardiac morphology and function。 Advances in deep learning have enabled the development of state-of-the-art (SoTA) models for these tasks。 However, model training is challenging due to data and label scarcity, especially in the less common imaging sequences. Moreover, each model is often trained for a specific task, with no connection between related tasks. In this work, we introduce a vision foundation model trained for CMR assessment, that is trained in a self-supervised fashion on 36 million CMR images. We then finetune the model in supervised way for 9 clinical tasks typical to a CMR workflow, across classification, segmentation, landmark localization, and pathology detection. We demonstrate improved accuracy and robustness across all tasks, over a range of available labeled dataset sizes. We also demonstrate improved few-shot learning with fewer labeled samples, a common challenge in medical image analyses. We achieve an out-of-box performance comparable to SoTA for most clinical tasks. The proposed method thus presents a resource-efficient, unified framework for CMR assessment, with the potential to accelerate the development of deep learning-based solutions for image analysis tasks, even with few annotated data available.

关键词

引用

@article{arxiv.2410.01665,
  title  = {Towards a vision foundation model for comprehensive assessment of Cardiac MRI},
  author = {Athira J Jacob and Indraneel Borgohain and Teodora Chitiboi and Puneet Sharma and Dorin Comaniciu and Daniel Rueckert},
  journal= {arXiv preprint arXiv:2410.01665},
  year   = {2025}
}

备注

11 pages, 3 figures, 4 tables