Health AI Developer Foundations
Abstract
Robust medical Machine Learning (ML) models have the potential to revolutionize healthcare by accelerating clinical research, improving workflows and outcomes, and producing novel insights or capabilities. Developing such ML models from scratch is cost prohibitive and requires substantial compute, data, and time (e.g., expert labeling). To address these challenges, we introduce Health AI Developer Foundations (HAI-DEF), a suite of pre-trained, domain-specific foundation models, tools, and recipes to accelerate building ML for health applications. The models cover various modalities and domains, including radiology (X-rays and computed tomography), histopathology, dermatological imaging, and audio. These models provide domain specific embeddings that facilitate AI development with less labeled data, shorter training times, and reduced computational costs compared to traditional approaches. In addition, we utilize a common interface and style across these models, and prioritize usability to enable developers to integrate HAI-DEF efficiently. We present model evaluations across various tasks and conclude with a discussion of their application and evaluation, covering the importance of ensuring efficacy, fairness, and equity. Finally, while HAI-DEF and specifically the foundation models lower the barrier to entry for ML in healthcare, we emphasize the importance of validation with problem- and population-specific data for each desired usage setting. This technical report will be updated over time as more modalities and features are added.
Cite
@article{arxiv.2411.15128,
title = {Health AI Developer Foundations},
author = {Atilla P. Kiraly and Sebastien Baur and Kenneth Philbrick and Fereshteh Mahvar and Liron Yatziv and Tiffany Chen and Bram Sterling and Nick George and Fayaz Jamil and Jing Tang and Kai Bailey and Faruk Ahmed and Akshay Goel and Abbi Ward and Lin Yang and Andrew Sellergren and Yossi Matias and Avinatan Hassidim and Shravya Shetty and Daniel Golden and Shekoofeh Azizi and David F. Steiner and Yun Liu and Tim Thelin and Rory Pilgrim and Can Kirmizibayrak},
journal= {arXiv preprint arXiv:2411.15128},
year = {2024}
}
Comments
16 pages, 8 figures