English

MedXIAOHE: A Comprehensive Recipe for Building Medical MLLMs

Computation and Language 2026-04-08 v4 Artificial Intelligence Computer Vision and Pattern Recognition Image and Video Processing

Abstract

We present MedXIAOHE, a medical vision-language foundation model designed to advance general-purpose medical understanding and reasoning in real-world clinical applications. MedXIAOHE achieves state-of-the-art performance across diverse medical benchmarks and surpasses leading closed-source multimodal systems on multiple capabilities. To achieve this, we propose an entity-aware continual pretraining framework that organizes heterogeneous medical corpora to broaden knowledge coverage and reduce long-tail gaps (e.g., rare diseases). For medical expert-level reasoning and interaction, MedXIAOHE incorporates diverse medical reasoning patterns via reinforcement learning and tool-augmented agentic training, enabling multi-step diagnostic reasoning with verifiable decision traces. To improve reliability in real-world use, MedXIAOHE integrates user-preference rubrics, evidence-grounded reasoning, and low-hallucination long-form report generation, with improved adherence to medical instructions. We release this report to document our practical design choices, scaling insights, and evaluation framework, hoping to inspire further research.

Keywords

Cite

@article{arxiv.2602.12705,
  title  = {MedXIAOHE: A Comprehensive Recipe for Building Medical MLLMs},
  author = {Baorong Shi and Bo Cui and Boyuan Jiang and Deli Yu and Fang Qian and Haihua Yang and Huichao Wang and Jiale Chen and Jianfei Pan and Jieqiong Cao and Jinghao Lin and Kai Wu and Lin Yang and Shengsheng Yao and Tao Chen and Xiaojun Xiao and Xiaozhong Ji and Xu Wang and Yijun He and Zhixiong Yang},
  journal= {arXiv preprint arXiv:2602.12705},
  year   = {2026}
}

Comments

XIAOHE Medical AI team. See paper for full author list. Currently, the model is exclusively available on XIAOHE AI Doctor, accessible via both the App Store and the Douyin Mini Program. Updated to improve the layout