Healthcare simulations help learners develop teamwork and clinical skills in a risk-free setting, promoting reflection on real-world practices through structured debriefs. However, despite video's potential, it is hard to use, leaving a gap in providing concise, data-driven summaries for supporting effective debriefing. Addressing this, we present TeamVision, an AI-powered multimodal learning analytics (MMLA) system that captures voice presence, automated transcriptions, body rotation, and positioning data, offering educators a dashboard to guide debriefs immediately after simulations. We conducted an in-the-wild study with 56 teams (221 students) and recorded debriefs led by six teachers using TeamVision. Follow-up interviews with 15 students and five teachers explored perceptions of its usefulness, accuracy, and trustworthiness. This paper examines: i) how TeamVision was used in debriefing, ii) what educators found valuable and challenging, and iii) perceptions of its effectiveness. Results suggest TeamVision enables flexible debriefing and highlights the challenges and implications of using AI-powered systems in healthcare simulation.
@article{arxiv.2501.09930,
title = {TeamVision: An AI-powered Learning Analytics System for Supporting Reflection in Team-based Healthcare Simulation},
author = {Vanessa Echeverria and Linxuan Zhao and Riordan Alfredo and Mikaela Milesi and Yuequiao Jin and Sophie Abel and Jie Fan and Lixiang Yan and Xinyu Li and Samantha Dix and Rosie Wotherspoon and Hollie Jaggard and Abra Osborne and Simon Buckingham Shum and Dragan Gasevic and Roberto Martinez-Maldonado},
journal= {arXiv preprint arXiv:2501.09930},
year = {2025}
}