English

Voice control interface for surgical robot assistants

Robotics 2025-03-25 v1 Human-Computer Interaction

Abstract

Traditional control interfaces for robotic-assisted minimally invasive surgery impose a significant cognitive load on surgeons. To improve surgical efficiency, surgeon-robot collaboration capabilities, and reduce surgeon burden, we present a novel voice control interface for surgical robotic assistants. Our system integrates Whisper, state-of-the-art speech recognition, within the ROS framework to enable real-time interpretation and execution of voice commands for surgical manipulator control. The proposed system consists of a speech recognition module, an action mapping module, and a robot control module. Experimental results demonstrate the system's high accuracy and inference speed, and demonstrates its feasibility for surgical applications in a tissue triangulation task. Future work will focus on further improving its robustness and clinical applicability.

Keywords

Cite

@article{arxiv.2409.10225,
  title  = {Voice control interface for surgical robot assistants},
  author = {Ana Davila and Jacinto Colan and Yasuhisa Hasegawa},
  journal= {arXiv preprint arXiv:2409.10225},
  year   = {2025}
}

Comments

Accepted at 2024 IEEE International Symposium on Micro-NanoMechatronics and Human Science

R2 v1 2026-06-28T18:46:00.701Z