English

Generative AI for Medical Imaging: extending the MONAI Framework

Image and Video Processing 2023-07-31 v1 Computer Vision and Pattern Recognition

Abstract

Recent advances in generative AI have brought incredible breakthroughs in several areas, including medical imaging. These generative models have tremendous potential not only to help safely share medical data via synthetic datasets but also to perform an array of diverse applications, such as anomaly detection, image-to-image translation, denoising, and MRI reconstruction. However, due to the complexity of these models, their implementation and reproducibility can be difficult. This complexity can hinder progress, act as a use barrier, and dissuade the comparison of new methods with existing works. In this study, we present MONAI Generative Models, a freely available open-source platform that allows researchers and developers to easily train, evaluate, and deploy generative models and related applications. Our platform reproduces state-of-art studies in a standardised way involving different architectures (such as diffusion models, autoregressive transformers, and GANs), and provides pre-trained models for the community. We have implemented these models in a generalisable fashion, illustrating that their results can be extended to 2D or 3D scenarios, including medical images with different modalities (like CT, MRI, and X-Ray data) and from different anatomical areas. Finally, we adopt a modular and extensible approach, ensuring long-term maintainability and the extension of current applications for future features.

Keywords

Cite

@article{arxiv.2307.15208,
  title  = {Generative AI for Medical Imaging: extending the MONAI Framework},
  author = {Walter H. L. Pinaya and Mark S. Graham and Eric Kerfoot and Petru-Daniel Tudosiu and Jessica Dafflon and Virginia Fernandez and Pedro Sanchez and Julia Wolleb and Pedro F. da Costa and Ashay Patel and Hyungjin Chung and Can Zhao and Wei Peng and Zelong Liu and Xueyan Mei and Oeslle Lucena and Jong Chul Ye and Sotirios A. Tsaftaris and Prerna Dogra and Andrew Feng and Marc Modat and Parashkev Nachev and Sebastien Ourselin and M. Jorge Cardoso},
  journal= {arXiv preprint arXiv:2307.15208},
  year   = {2023}
}
R2 v1 2026-06-28T11:42:24.129Z