English

A Specialized Large Language Model for Clinical Reasoning and Diagnosis in Rare Diseases

Computation and Language 2025-11-19 v1

Abstract

Rare diseases affect hundreds of millions worldwide, yet diagnosis often spans years. Convectional pipelines decouple noisy evidence extraction from downstream inferential diagnosis, and general/medical large language models (LLMs) face scarce real world electronic health records (EHRs), stale domain knowledge, and hallucinations. We assemble a large, domain specialized clinical corpus and a clinician validated reasoning set, and develop RareSeek R1 via staged instruction tuning, chain of thought learning, and graph grounded retrieval. Across multicenter EHR narratives and public benchmarks, RareSeek R1 attains state of the art accuracy, robust generalization, and stability under noisy or overlapping phenotypes. Augmented retrieval yields the largest gains when narratives pair with prioritized variants by resolving ambiguity and aligning candidates to mechanisms. Human studies show performance on par with experienced physicians and consistent gains in assistive use. Notably, transparent reasoning highlights decisive non phenotypic evidence (median 23.1%, such as imaging, interventions, functional tests) underpinning many correct diagnoses. This work advances a narrative first, knowledge integrated reasoning paradigm that shortens the diagnostic odyssey and enables auditable, clinically translatable decision support.

Keywords

Cite

@article{arxiv.2511.14638,
  title  = {A Specialized Large Language Model for Clinical Reasoning and Diagnosis in Rare Diseases},
  author = {Tao Yang and Dandan Huang and Yunting Lin and Pengfei Wu and Zhikun Wu and Gangyuan Ma and Yulan Lu and Xinran Dong and Dingpeng Li and Junshuang Ge and Zhiyan Zhang and Xuanzhao Huang and Wenyan Nong and Yao Zhou and Hui Tang and Hongxi Yang and Shijie Zhang and Juan Li and Xiaojun Cao and Lin Yang and Xia Gao and Kaishou Xu and Xiaoqiong Gu and Wen Zhang and Huimin Xia and Li Liu and Wenhao Zhou and Mulin Jun Li},
  journal= {arXiv preprint arXiv:2511.14638},
  year   = {2025}
}

Comments

50 pages, 5 figures