English

Health AI Developer Foundations

Machine Learning 2024-11-27 v2 Artificial Intelligence Computer Vision and Pattern Recognition Multimedia Image and Video Processing

Abstract

Robust medical Machine Learning (ML) models have the potential to revolutionize healthcare by accelerating clinical research, improving workflows and outcomes, and producing novel insights or capabilities. Developing such ML models from scratch is cost prohibitive and requires substantial compute, data, and time (e.g., expert labeling). To address these challenges, we introduce Health AI Developer Foundations (HAI-DEF), a suite of pre-trained, domain-specific foundation models, tools, and recipes to accelerate building ML for health applications. The models cover various modalities and domains, including radiology (X-rays and computed tomography), histopathology, dermatological imaging, and audio. These models provide domain specific embeddings that facilitate AI development with less labeled data, shorter training times, and reduced computational costs compared to traditional approaches. In addition, we utilize a common interface and style across these models, and prioritize usability to enable developers to integrate HAI-DEF efficiently. We present model evaluations across various tasks and conclude with a discussion of their application and evaluation, covering the importance of ensuring efficacy, fairness, and equity. Finally, while HAI-DEF and specifically the foundation models lower the barrier to entry for ML in healthcare, we emphasize the importance of validation with problem- and population-specific data for each desired usage setting. This technical report will be updated over time as more modalities and features are added.

Keywords

Cite

@article{arxiv.2411.15128,
  title  = {Health AI Developer Foundations},
  author = {Atilla P. Kiraly and Sebastien Baur and Kenneth Philbrick and Fereshteh Mahvar and Liron Yatziv and Tiffany Chen and Bram Sterling and Nick George and Fayaz Jamil and Jing Tang and Kai Bailey and Faruk Ahmed and Akshay Goel and Abbi Ward and Lin Yang and Andrew Sellergren and Yossi Matias and Avinatan Hassidim and Shravya Shetty and Daniel Golden and Shekoofeh Azizi and David F. Steiner and Yun Liu and Tim Thelin and Rory Pilgrim and Can Kirmizibayrak},
  journal= {arXiv preprint arXiv:2411.15128},
  year   = {2024}
}

Comments

16 pages, 8 figures

R2 v1 2026-06-28T20:09:18.776Z