English
Related papers

Related papers: Designing VR Simulation System for Clinical Commun…

200 papers

Embodied agents designed to assist users with tasks must engage in natural language interactions, interpret instructions, execute actions, and communicate effectively to resolve issues. However, collecting large-scale, diverse datasets of…

Computation and Language · Computer Science 2024-11-01 Daniel Philipov , Vardhan Dongre , Gokhan Tur , Dilek Hakkani-Tür

A Virtual Patient (VP) is a powerful tool for training medical students to take patient histories, where responding to a diverse set of spoken questions is essential to simulate natural conversations with a student. The performance of such…

Computation and Language · Computer Science 2022-07-04 Vishal Sunder , Prashant Serai , Eric Fosler-Lussier

The rapid advancement of Large Language Models (LLMs) has marked a significant breakthrough in Artificial Intelligence (AI), ushering in a new era of Human-centered Artificial Intelligence (HAI). HAI aims to better serve human welfare and…

Robotics · Computer Science 2025-10-29 Wenbin Ding , Jun Chen , Mingjia Chen , Fei Xie , Qi Mao , Philip Dames

Standardized patients (SPs) play a central role in clinical communication training but are costly, difficult to scale, and inconsistent. Large language model (LLM) based AI standardized patients (AI-SPs) promise flexible, on-demand…

Human-Computer Interaction · Computer Science 2026-04-07 Zhiqi Gao , Guo Zhu , Huarui Luo , Dongyijie Primo Pan , Haoming Tang , Bingquan Zhang , Jiahuan Pei , Jie Li , Benyou Wang

The rapid evolution of large language models (LLMs) has transformed human-computer interaction (HCI), but the interaction with LLMs is currently mainly focused on text-based interactions, while other multi-model approaches remain…

Human-Computer Interaction · Computer Science 2025-02-14 Eason Chen , Chenyu Lin , Xinyi Tang , Aprille Xi , Canwen Wang , Jionghao Lin , Kenneth R Koedinger

Conventional Voice Assistants (VAs) rely on traditional language models to discern user intent and respond to their queries, leading to interactions that often lack a broader contextual understanding, an area in which Large Language Models…

Human-Computer Interaction · Computer Science 2024-12-02 Amama Mahmood , Junxiang Wang , Bingsheng Yao , Dakuo Wang , Chien-Ming Huang

Immersive virtual reality (VR) offers affordances that may reduce cognitive complexity in binary reverse engineering (RE), enabling embodied and external cognition to augment the RE process through enhancing memory, hypothesis testing, and…

Human-Computer Interaction · Computer Science 2025-08-20 Dennis Brown , Samuel Mulder

As large language models (LLMs) continue to improve in reasoning and decision-making, there is a growing need for realistic and interactive environments where their abilities can be rigorously evaluated. We present VirtualEnv, a…

Artificial Intelligence · Computer Science 2026-02-10 Kabir Swain , Sijie Han , Ayush Raina , Jin Zhang , Shuang Li , Michael Stopa , Antonio Torralba

Recent advancements in virtual reality (VR) technology have enabled the creation of immersive learning environments that provide engineering students with hands-on, interactive experiences. This paper presents a novel framework for virtual…

Human-Computer Interaction · Computer Science 2026-03-30 Rafael Padilla , Özgür Keleş

Massage therapy training emphasizes hands-on techniques and effective therapist--patient communication. However, many educational programs struggle to provide realistic practice scenarios. To address this problem, we propose TheraQuest, a…

Computer Science and Game Theory · Computer Science 2025-05-01 Shengqian Wang

Modern process simulators enable detailed process design, simulation, and optimization; however, constructing and interpreting simulations is time-consuming and requires expert knowledge. This limits early exploration by inexperienced…

Chemical Physics · Physics 2026-05-22 Jingkang Liang , Niklas Groll , Gürkan Sin

Problem: Effective patient-centered communication is a core competency for physicians. However, both seasoned providers and medical trainees report decreased confidence in leading conversations on sensitive topics such as goals of care or…

Human-Computer Interaction · Computer Science 2024-05-31 Simon N. Chu , Alex J. Goodell

Modern medicine demands innovations in medical education, particularly in the learning of human anatomy, traditionally taught through textbooks, dissections, and lectures. Virtual Reality (VR) has emerged as a promising tool to address the…

Human-Computer Interaction · Computer Science 2024-11-11 Myint Zu Than , Kian Meng Yap

Advancements in large language models offer strong potential for enhancing virtual simulated patients (VSPs) in medical education by providing scalable alternatives to resource-intensive traditional methods. However, current VSPs often…

Computation and Language · Computer Science 2025-12-23 Victor De Marez , Jens Van Nooten , Luna De Bruyne , Walter Daelemans

Patient safety training is essential for preparing healthcare professionals to identify, investigate, and prevent adverse events. However, conventional simulation-based approaches often require substantial faculty time, physical resources,…

Human-Computer Interaction · Computer Science 2026-03-20 Yuqi Hu , Qiwen Xiong , Zhenzhen Qin , Brandon Watanabe , Yujing Wang , Mirjana Prpa , Ilmi Yoon

Pedagogical Agents (PAs) show significant potential for boosting student engagement and learning outcomes by providing adaptive, on-demand support in educational contexts. However, existing PA solutions are often hampered by pre-scripted…

Human-Computer Interaction · Computer Science 2025-05-13 Eason Chen , Chenyu Lin , Yu-Kai Huang , Xinyi Tang , Aprille Xi , Jionghao Lin , Kenneth Koedinger

Effective communication in serious illness and palliative care is essential but often under-taught due to limited access to training resources like standardized patients. We present PAL (Palliative Assisted Learning-bot), a conversational…

Human-Computer Interaction · Computer Science 2025-11-12 Neil K. R. Sehgal , Hita Kambhamettu , Allen Chang , Andrew Zhu , Lyle Ungar , Sharath Chandra Guntuku

Simulated training platforms offer a suitable avenue for surgical students and professionals to build and improve upon their skills, without the hassle of traditional training methods. To enhance the degree of realistic interaction…

Robotics · Computer Science 2023-08-16 Soroush Sadeghnejad , Mojtaba Esfandiari , Farshad Khadivar

Given that experience is a pivotal dimension of learning processes in the field of leadership, the ongoing and unresolved issue is how such experiential moments could be provided when developing leadership skills and competencies.…

Human-Computer Interaction · Computer Science 2024-03-18 Francesco Vona , Miladin Ćeranić , Irma Rybnikova , Jan-Niklas Voigt-Antons

The integration of Large Language Models (LLMs) into Virtual Reality (VR) games marks a paradigm shift in the design of immersive, adaptive, and intelligent digital experiences. This paper presents a comprehensive review of recent research…

Human-Computer Interaction · Computer Science 2025-11-24 Süeda Özkaya , Santiago Berrezueta-Guzman , Stefan Wagner