English

R2Gen-Mamba: A Selective State Space Model for Radiology Report Generation

Computation and Language 2024-10-25 v1 Artificial Intelligence Computer Vision and Pattern Recognition Machine Learning

Abstract

Radiology report generation is crucial in medical imaging,but the manual annotation process by physicians is time-consuming and labor-intensive, necessitating the develop-ment of automatic report generation methods. Existingresearch predominantly utilizes Transformers to generateradiology reports, which can be computationally intensive,limiting their use in real applications. In this work, we presentR2Gen-Mamba, a novel automatic radiology report genera-tion method that leverages the efficient sequence processingof the Mamba with the contextual benefits of Transformerarchitectures. Due to lower computational complexity ofMamba, R2Gen-Mamba not only enhances training and in-ference efficiency but also produces high-quality reports.Experimental results on two benchmark datasets with morethan 210,000 X-ray image-report pairs demonstrate the ef-fectiveness of R2Gen-Mamba regarding report quality andcomputational efficiency compared with several state-of-the-art methods. The source code can be accessed online.

Keywords

Cite

@article{arxiv.2410.18135,
  title  = {R2Gen-Mamba: A Selective State Space Model for Radiology Report Generation},
  author = {Yongheng Sun and Yueh Z. Lee and Genevieve A. Woodard and Hongtu Zhu and Chunfeng Lian and Mingxia Liu},
  journal= {arXiv preprint arXiv:2410.18135},
  year   = {2024}
}

Comments

4 pages pages for ISBI2025

R2 v1 2026-06-28T19:33:17.635Z