English
Related papers

Related papers: SurgSync: Time-Synchronized Multi-Modal Data Colle…

200 papers

With introduction of new technologies in the operating room like the da Vinci Surgical System, training surgeons to use them effectively and efficiently is crucial in the delivery of better patient care. Coaching by an expert surgeon is…

Robotics · Computer Science 2020-04-08 Anand Malpani , S. Swaroop Vedula , Henry C. Lin , Gregory D. Hager , Russell H. Taylor

Multi-view capture systems have been an important tool in research for recording human motion under controlling conditions. Most existing systems are specified around video streams and provide little or no support for audio acquisition and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Xiangwei Shi , Gara Dorta , Ruud de Jong , Ojas Shirekar , Chirag Raman

Recently, robotics has advanced significantly through the integration of larger models and large-scale datasets. However, challenges remain in applying these models to 3D spatial interactions and managing data collection costs. To address…

Robotics · Computer Science 2025-11-05 Feng Yan , Fanfan Liu , Liming Zheng , Yufeng Zhong , Yiyang Huang , Zechao Guan , Chengjian Feng , Lin Ma

A major source of endoscopic tissue tracking errors during deformations stems from wrong data association between observed sensor measurements with previously tracked scene. To mitigate this issue, we present a surgical perception…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Shan Lin , Albert J. Miao , Ali Alabiad , Fei Liu , Kaiyuan Wang , Jingpei Lu , Florian Richter , Michael C. Yip

Large-scale robot datasets have facilitated the learning of a wide range of robot manipulation skills, but these datasets remain difficult to collect and scale further, owing to the intractable amount of human time, effort, and cost…

Robotics · Computer Science 2026-03-27 Masoud Moghani , Mahdi Azizian , Animesh Garg , Yuke Zhu , Sean Huver , Ajay Mandlekar

Purpose: Manual feedback in basic RMIS training can consume a significant amount of time from expert surgeons' schedule and is prone to subjectivity. While VR-based training tasks can generate automated score reports, there is no mechanism…

Computer Vision and Pattern Recognition · Computer Science 2017-12-25 Aneeq Zia , Irfan Essa

Objective: We aim to investigate long-term robotic surgical skill acquisition among surgical residents and the effects of training intervals and fatigue on performance. Methods: For six months, surgical residents participated in three…

Robotics · Computer Science 2025-03-28 Yarden Sharon , Alex Geftler , Hanna Kossowsky Lev , Ilana Nisky

Physiological signals are increasingly relevant to estimate the mental states of users in human-robot interaction (HRI), yet ROS 2-based HRI frameworks still lack reusable support to integrate such data streams in a standardized way.…

Human-Computer Interaction · Computer Science 2026-03-23 Manuel Scheibl , Julian Leichert , Sinem Görmez , Britta Wrede

This paper introduces a SSSUMO, semi-supervised deep learning approach for submovement decomposition that achieves state-of-the-art accuracy and speed. While submovement analysis offers valuable insights into motor control, existing methods…

Human-Computer Interaction · Computer Science 2025-07-14 Evgenii Rudakov , Jonathan Shock , Otto Lappi , Benjamin Ultan Cowley

Learning to produce contact-rich, dynamic behaviors from raw sensory data has been a longstanding challenge in robotics. Prominent approaches primarily focus on using visual or tactile sensing, where unfortunately one fails to capture…

Robotics · Computer Science 2022-10-04 Abitha Thankaraj , Lerrel Pinto

Recent advancements in sensor technology and deep learning have led to significant progress in 3D human body reconstruction. However, most existing approaches rely on data from a specific sensor, which can be unreliable due to the inherent…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Anjun Chen , Xiangyu Wang , Zhi Xu , Kun Shi , Yan Qin , Yuchi Huo , Jiming Chen , Qi Ye

In the last decade, researchers and medical device companies have made major advances towards transforming passive capsule endoscopes into active medical robots. One of the major challenges is to endow capsule robots with accurate…

Robotics · Computer Science 2017-09-25 Mehmet Turan , Yasin Almalioglu , Hunter Gilbert , Alp Eren Sari , Ufuk Soylu , Metin Sitti

The growing demand for accurate, continuous, and non-invasive health monitoring has propelled multi-sensor data fusion to the forefront of healthcare technology. This review aims to provide an overview of the development of fusion…

Signal Processing · Electrical Eng. & Systems 2024-12-10 Arlene John , Barry Cardiff , Deepu John

The dominant paradigm for end-to-end robot learning focuses on optimizing task-specific objectives that solve a single robotic problem such as picking up an object or reaching a target position. However, recent work on high-capacity models…

Robotics · Computer Science 2024-01-02 Samuel Schmidgall , Ji Woong Kim , Alan Kuntz , Ahmed Ezzat Ghazi , Axel Krieger

Future surgical care demands real-time, integrated data to drive informed decision-making and improve patient outcomes. The pressing need for seamless and efficient data capture in the OR motivates our development of a modular solution that…

This work introduces the first framework for reconstructing surgical dialogue from unstructured real-world recordings, which is crucial for characterizing teaching tasks. In surgical training, the formative verbal feedback that trainers…

Audio and Speech Processing · Electrical Eng. & Systems 2024-12-03 Firdavs Nasriddinov , Rafal Kocielnik , Arushi Gupta , Cherine Yang , Elyssa Wong , Anima Anandkumar , Andrew Hung

Collaborative robotic systems will be a key enabling technology for current and future industrial applications. The main aspect of such applications is to guarantee safety for humans. To detect hazardous situations, current commercially…

Robotics · Computer Science 2022-02-08 Lorena Gril , Philipp Wedenig , Chris Torkar , Ulrike Kleb

Recent advancements in retinal surgery have paved the way for a modern operating room equipped with a surgical robot, a microscope, and intraoperative optical coherence tomography (iOCT)- a depth sensor widely used in retinal surgery.…

As the world population gets older, the healthcare system must be adapted, among others by providing continuous health monitoring at home and in the city. The social activities have a significant role in everyone health status. Hence, this…

Computers and Society · Computer Science 2016-12-01 Loïc Sevrin , Bertrand Massot , Norbert Noury , Nacer Abouchi , Fabrice Jumel , Jacques Saraydaryan

Recent advances in machine learning models allowed robots to identify objects on a perceptual nonsymbolic level (e.g., through sensor fusion and natural language understanding). However, these primarily black-box learning models still lack…

Robotics · Computer Science 2023-07-11 Amr Gomaa , Bilal Mahdy , Niko Kleer , Michael Feld , Frank Kirchner , Antonio Krüger