The increasing burden of responding to large volumes of patient messages has become a key factor contributing to physician burnout. Generative AI (GenAI) shows great promise to alleviate this burden by automatically drafting patient message replies. The ethical implications of this use have however not been fully explored. To address this knowledge gap, we conducted a semi-structured interview study with 21 physicians who participated in a GenAI pilot program. We found that notable ethical considerations expressed by the physician participants included human oversight as ethical safeguard, transparency and patient consent of AI use, patient misunderstanding of AI's role, and patient privacy and data security as prerequisites. Additionally, our findings suggest that the physicians believe the ethical responsibility of using GenAI in this context primarily lies with users, not with the technology. These findings may provide useful insights into guiding the future implementation of GenAI in clinical practice.
@article{arxiv.2508.13217,
title = {When AI Writes Back: Ethical Considerations by Physicians on AI-Drafted Patient Message Replies},
author = {Di Hu and Yawen Guo and Ha Na Cho and Emilie Chow and Dana B. Mukamel and Dara Sorkin and Andrew Reikes and Danielle Perret and Deepti Pandita and Kai Zheng},
journal= {arXiv preprint arXiv:2508.13217},
year = {2025}
}
Comments
Paper accepted for the proceedings of the 2025 American Medical Informatics Association Annual Symposium (AMIA)