English

NoteChat: A Dataset of Synthetic Doctor-Patient Conversations Conditioned on Clinical Notes

Computation and Language 2025-01-30 v3

Abstract

We introduce NoteChat, a novel cooperative multi-agent framework leveraging Large Language Models (LLMs) to generate patient-physician dialogues. NoteChat embodies the principle that an ensemble of role-specific LLMs, through structured role-play and strategic prompting, can perform their assigned roles more effectively. The synergy among these role-playing LLMs results in a cohesive and efficient dialogue generation. Evaluation on MTS-dialogue, a benchmark dataset for patient-physician dialogues-note pairs, shows that models trained with the augmented synthetic patient-physician dialogues by NoteChat outperforms other state-of-the-art models for generating clinical notes. Our comprehensive automatic and human evaluation demonstrates that NoteChat substantially surpasses state-of-the-art models like ChatGPT and GPT-4 up to 22.78% by domain experts in generating superior synthetic patient-physician dialogues based on clinical notes. NoteChat has the potential to engage patients directly and help clinical documentation, a leading cause of physician burnout.

Keywords

Cite

@article{arxiv.2310.15959,
  title  = {NoteChat: A Dataset of Synthetic Doctor-Patient Conversations Conditioned on Clinical Notes},
  author = {Junda Wang and Zonghai Yao and Zhichao Yang and Huixue Zhou and Rumeng Li and Xun Wang and Yucheng Xu and Hong Yu},
  journal= {arXiv preprint arXiv:2310.15959},
  year   = {2025}
}