Cancer patients often lack timely education and personalized support due to clinician workload. This quality improvement study develops and evaluates a Large Language Model (LLM) agent, MedEduChat, which is integrated with the clinic's electronic health records (EHR) and designed to enhance prostate cancer patient education. Fifteen non-metastatic prostate cancer patients and three clinicians recruited from the Mayo Clinic interacted with the agent between May 2024 and April 2025. Findings showed that MedEduChat has a high usability score (UMUX 83.7 out of 100) and improves patients' health confidence (Health Confidence Score rose from 9.9 to 13.9). Clinicians evaluated the patient-chat interaction history and rated MedEduChat as highly correct (2.9 out of 3), complete (2.7 out of 3), and safe (2.7 out of 3), with moderate personalization (2.3 out of 3). This study highlights the potential of LLM agents to improve patient engagement and health education.
Cite
@article{arxiv.2409.19100,
title = {Personalizing Prostate Cancer Education for Patients Using an EHR-Integrated LLM Agent},
author = {Yuexing Hao and Jason Holmes and Mark R. Waddle and Brian J. Davis and Nathan Y. Yu and Kristin Vickers and Heather Preston and Drew Margolin and Corinna E. Lockenhoff and Aditya Vashistha and Saleh Kalantari and Marzyeh Ghassemi and Wei Liu},
journal= {arXiv preprint arXiv:2409.19100},
year = {2025}
}