Voice control interface for surgical robot assistants
Abstract
Traditional control interfaces for robotic-assisted minimally invasive surgery impose a significant cognitive load on surgeons. To improve surgical efficiency, surgeon-robot collaboration capabilities, and reduce surgeon burden, we present a novel voice control interface for surgical robotic assistants. Our system integrates Whisper, state-of-the-art speech recognition, within the ROS framework to enable real-time interpretation and execution of voice commands for surgical manipulator control. The proposed system consists of a speech recognition module, an action mapping module, and a robot control module. Experimental results demonstrate the system's high accuracy and inference speed, and demonstrates its feasibility for surgical applications in a tissue triangulation task. Future work will focus on further improving its robustness and clinical applicability.
Keywords
Cite
@article{arxiv.2409.10225,
title = {Voice control interface for surgical robot assistants},
author = {Ana Davila and Jacinto Colan and Yasuhisa Hasegawa},
journal= {arXiv preprint arXiv:2409.10225},
year = {2025}
}
Comments
Accepted at 2024 IEEE International Symposium on Micro-NanoMechatronics and Human Science