English
Related papers

Related papers: Learning to See Forces: Surgical Force Prediction …

200 papers

Robotic-assisted surgery offers significant clinical advantages but largely eliminates direct haptic feedback, increasing the risk of excessive tool-tissue interaction forces. Although recent commercial systems have begun to introduce force…

Robotics · Computer Science 2026-05-01 Walid Shaker , Mustafa Suphi Erden

Reconstruction of the soft tissues in robotic surgery from endoscopic stereo videos is important for many applications such as intra-operative navigation and image-guided robotic surgery automation. Previous works on this task mainly rely…

Computer Vision and Pattern Recognition · Computer Science 2022-07-01 Yuehao Wang , Yonghao Long , Siu Hin Fan , Qi Dou

Some endoscopic surgeries require a surgeon to hold the endoscope with one hand and the surgical instruments with the other hand to perform the actual surgery with correct vision. Recent technical advances in deep learning as well as in…

Computer Vision and Pattern Recognition · Computer Science 2020-03-16 Sue Min Cho , Young-Gon Kim , Jinhoon Jeong , Ho-jin Lee , Namkug Kim

Haptic sensation is an important modality for interacting with the real world. This paper proposes a general framework of inferring haptic forces on the surface of a 3D structure from internal deformations using a small number of physical…

Robotics · Computer Science 2019-02-26 Huanbo Sun , Goerg Martius

Automatically recognizing surgical gestures is a crucial step towards a thorough understanding of surgical skill. Possible areas of application include automatic skill assessment, intra-operative monitoring of critical surgical steps, and…

Computer Vision and Pattern Recognition · Computer Science 2019-07-29 Isabel Funke , Sebastian Bodenstedt , Florian Oehme , Felix von Bechtolsheim , Jürgen Weitz , Stefanie Speidel

Robotic grippers are receiving increasing attention in various industries as essential components of robots for interacting and manipulating objects. While significant progress has been made in the past, conventional rigid grippers still…

Robotics · Computer Science 2024-04-02 Qianyu Guo , Ziqing Yu , Jiaming Fu , Yawen Lu , Yahya Zweiri , Dongming Gan

Precisely determining the contact force during safe interaction in Minimally Invasive Robotic Surgery (MIRS) is still an open research challenge. Inspired by post-operative qualitative analysis from surgical videos, the use of…

Computer Vision and Pattern Recognition · Computer Science 2024-01-25 Mikel De Iturrate Reyzabal , Mingcong Chen , Wei Huang , Sebastien Ourselin , Hongbin Liu

Accurate and robust tracking and reconstruction of the surgical scene is a critical enabling technology toward autonomous robotic surgery. Existing algorithms for 3D perception in surgery mainly rely on geometric information, while we…

Image and Video Processing · Electrical Eng. & Systems 2023-02-21 Shan Lin , Albert J. Miao , Jingpei Lu , Shunkai Yu , Zih-Yun Chiu , Florian Richter , Michael C. Yip

This work demonstrates the benefits of using tool-tissue interaction forces in the design of autonomous systems in robot-assisted surgery (RAS). Autonomous systems in surgery must manipulate tissues of different stiffness levels and hence…

The field of visual representation learning has seen explosive growth in the past years, but its benefits in robotics have been surprisingly limited so far. Prior work uses generic visual representations as a basis to learn (task-specific)…

Robotics · Computer Science 2023-08-16 Jianren Wang , Sudeep Dasari , Mohan Kumar Srirama , Shubham Tulsiani , Abhinav Gupta

As surgical robots become more common, automating away some of the burden of complex direct human operation becomes ever more feasible. Model-free reinforcement learning (RL) is a promising direction toward generalizable automated surgical…

Robotics · Computer Science 2021-05-04 Yotam Barnoy , Molly O'Brien , Will Wang , Gregory Hager

This paper proposes a visual-servoing method dedicated to grasping of daily-life objects. In order to obtain an affordable solution, we use a low-accurate robotic arm. Our method corrects errors by using an RGB-D sensor. It is based on SURF…

Robotics · Computer Science 2016-12-13 Ludovic Hofer , Michio Tanaka , Hakaru Tamukoh , Amir Ali Forough Nassiraei , Takashi Morie

In this work, we present a deep reinforcement learning based method to solve the problem of robotic grasping using visio-motor feedback. The use of a deep learning based approach reduces the complexity caused by the use of hand-designed…

Robotics · Computer Science 2020-07-10 Shirin Joshi , Sulabh Kumra , Ferat Sahin

In minimally invasive surgery, surgical workflow segmentation from video analysis is a well studied topic. The conventional approach defines it as a multi-class classification problem, where individual video frames are attributed a surgical…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Yitong Zhang , Sophia Bano , Ann-Sophie Page , Jan Deprest , Danail Stoyanov , Francisco Vasconcelos

In robotic surgery, pattern cutting through a deformable material is a challenging research field. The cutting procedure requires a robot to concurrently manipulate a scissor and a gripper to cut through a predefined contour trajectory on…

Robotics · Computer Science 2019-02-15 Ngoc Duy Nguyen , Thanh Nguyen , Saeid Nahavandi , Asim Bhatti , Glenn Guest

Robotics enables a variety of unconventional actuation strategies to be used for endoscopes, resulting in reduced trauma to the GI tract. For transmission of force to distally mounted endoscopic instruments, robotically actuated tendon…

Medical Physics · Physics 2017-03-17 Tian En Timothy Seah , Thanh Nho Do , Nobuyoshi Takeshita , Khek Yu Ho , Soo Jay Phee

Reconstruction of deformable scenes from endoscopic videos is important for many applications such as intraoperative navigation, surgical visual perception, and robotic surgery. It is a foundational requirement for realizing autonomous…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Shreya Saha , Zekai Liang , Shan Lin , Jingpei Lu , Michael Yip , Sainan Liu

High-resolution (HR) videos play a crucial role in many computer vision applications. Although existing video restoration (VR) methods can significantly enhance video quality by exploiting temporal information across video frames, they are…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Mary Aiyetigbo , Wanqi Yuan , Feng Luo , Nianyi Li

Purpose: Manual feedback from senior surgeons observing less experienced trainees is a laborious task that is very expensive, time-consuming and prone to subjectivity. With the number of surgical procedures increasing annually, there is an…

Machine Learning · Computer Science 2019-08-21 Hassan Ismail Fawaz , Germain Forestier , Jonathan Weber , Lhassane Idoumghar , Pierre-Alain Muller

Learning based video compression attracts increasing attention in the past few years. The previous hybrid coding approaches rely on pixel space operations to reduce spatial and temporal redundancy, which may suffer from inaccurate motion…

Image and Video Processing · Electrical Eng. & Systems 2021-08-24 Zhihao Hu , Guo Lu , Dong Xu