English

SafeRx-Agent: A Knowledge-Grounded Multi-Agent Framework for Safe and Explainable Medication Recommendation

Computation and Language 2026-05-29 v1 Artificial Intelligence

Abstract

Medication recommendation predicts medications for patient visits, but existing methods still face two key challenges. At the model level, traditional drug recommendation methods only predict structured drug codes with limited evidence grounding, while LLM agents can use richer clinical context but may lack safety verification and traceability. At the task level, existing benchmarks often use broad medication categories, which ignore subgroup-level safety differences and can lead to risk overestimation. We introduce the first fine-grained medication recommendation setting based on fourth-level ATC code generation. We propose Safe Prescription Agent (SafeRx-Agent), a knowledge-grounded multi-agent framework that uses patient context, external clinical knowledge, and safety verification to recommend traceable medication sets. Experimental results on MIMIC-III and MIMIC-IV datasets show that SafeRx-Agent improves fine-grained medication prediction accuracy while controlling drug interactions, contraindications, and medication set size.

Keywords

Cite

@article{arxiv.2605.29146,
  title  = {SafeRx-Agent: A Knowledge-Grounded Multi-Agent Framework for Safe and Explainable Medication Recommendation},
  author = {Xinyu Wang and Hanwei Wu and Zhenghan Tai and Sicheng Lyu and Qincheng Lu and Ziyu Zhao and Jijun Chi and Jingrui Tian and Xiao-Wen Chang and Ziyang Song},
  journal= {arXiv preprint arXiv:2605.29146},
  year   = {2026}
}