English
Related papers

Related papers: Tracking Everything in Robotic-Assisted Surgery

200 papers

Surgical video segmentation is a critical task in computer-assisted surgery, essential for enhancing surgical quality and patient outcomes. Recently, the Segment Anything Model 2 (SAM2) framework has demonstrated remarkable advancements in…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Ming Yin , Fu Wang , Xujiong Ye , Yanda Meng , Zeyu Fu

This paper presents a new algorithm for autonomous multitarget tracking of resident space objects using optical angles-only measurements from a spaceborne observer. To enable autonomous angles-only navigation of spacecraft swarms, an…

Signal Processing · Electrical Eng. & Systems 2021-10-04 Justin Kruger , Simone D'Amico

The tactile properties of tissue, such as elasticity and stiffness, often play an important role in surgical oncology when identifying tumors and pathological tissue boundaries. Though extremely valuable, robot-assisted surgery comes at the…

Signal Processing · Electrical Eng. & Systems 2026-04-07 Devi Yuliarti , Ravi Prakash , Hiu Ching Cheung , Amy Strong , Patrick J. Codd , Shan Lin

Automatic surgical instrument segmentation of endoscopic images is a crucial building block of many computer-assistance applications for minimally invasive surgery. So far, state-of-the-art approaches completely rely on the availability of…

Computer Vision and Pattern Recognition · Computer Science 2022-02-17 Luca Sestini , Benoit Rosa , Elena De Momi , Giancarlo Ferrigno , Nicolas Padoy

Purpose: This study demonstrates a proof of concept of a method for simultaneous anatomical imaging and real-time (SMART) passive device tracking for MR-guided interventions. Methods: Phase Correlation template matching was combined with a…

Medical Physics · Physics 2019-08-29 Frank Zijlstra , Max A. Viergever , Peter R. Seevinck

Instrument-tissue interaction forces in Minimally Invasive Surgery (MIS) provide valuable information that can be used to provide haptic perception, monitor tissue trauma, develop training guidelines, and evaluate the skill level of novice…

Robotics · Computer Science 2024-01-29 A. H. Hadi Hosseinabadi , S. E. Salcudean

Accurate and stable field-of-view (FoV) guidance is critical for safe and efficient minimally invasive surgery, yet existing approaches often conflate visual attention estimation with downstream camera control or rely on direct…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Rulin Zhou , Guankun Wang , An Wang , Yujie Ma , Lixin Ouyang , Bolin Cui , Junyan Li , Chaowei Zhu , Mingyang Li , Ming Chen , Xiaopin Zhong , Peng Lu , Jiankun Wang , Xianming Liu , Hongliang Ren

The problem of multi-object tracking (MOT) consists in detecting and tracking all the objects in a video sequence while keeping a unique identifier for each object. It is a challenging and fundamental problem for robotics. In precision…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Leonardo Saraceni , Ionut M. Motoi , Daniele Nardi , Thomas A. Ciarfuglia

The amount of surgical data, recorded during video-monitored surgeries, has extremely increased. This paper aims at improving existing solutions for the automated analysis of cataract surgeries in real time. Through the analysis of a video…

Computer Vision and Pattern Recognition · Computer Science 2016-09-20 Hassan Al Hajj , Gwenolé Quellec , Mathieu Lamard , Guy Cazuguel , Béatrice Cochener

Purpose: Accurate tool segmentation is essential in computer-aided procedures. However, this task conveys challenges due to artifacts' presence and the limited training data in medical scenarios. Methods that generalize to unseen data…

Computer Vision and Pattern Recognition · Computer Science 2024-02-29 Kanyifeechukwu J. Oguine , Roger D. Soberanis-Mukul , Nathan Drenkow , Mathias Unberath

The use of Augmented Reality (AR) devices for surgical guidance has gained increasing traction in the medical field. Traditional registration methods often rely on external fiducial markers to achieve high accuracy and real-time…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Yue Yang , Christoph Leuze , Brian Hargreaves , Bruce Daniel , Fred Baik

In Robot-Assisted Minimally Invasive Surgery (RAMIS), a camera assistant is normally required to control the position and zooming ratio of the laparoscope, following the surgeon's instructions. However, moving the laparoscope frequently may…

Image and Video Processing · Electrical Eng. & Systems 2020-11-10 Ruoxi Wang , Dandan Zhang , Qingbiao Li , Xiao-Yun Zhou , Benny Lo

Surgical automation has the capability to improve the consistency of patient outcomes and broaden access to advanced surgical care in underprivileged communities. Shared autonomy, where the robot automates routine subtasks while the surgeon…

Robotics · Computer Science 2024-09-24 Xiao Liang , Chung-Pang Wang , Nikhil Uday Shinde , Fei Liu , Florian Richter , Michael Yip

Despite significant developments in the design of surgical robots and automated techniques for objective evaluation of surgical skills, there are still challenges in ensuring safety in robot-assisted minimally-invasive surgery (RMIS). This…

Computer Vision and Pattern Recognition · Computer Science 2022-03-03 Zongyu Li , Kay Hutchinson , Homa Alemzadeh

Segmentation is a fundamental problem in surgical scene analysis using artificial intelligence. However, the inherent data scarcity in this domain makes it challenging to adapt traditional segmentation techniques for this task. To tackle…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Jay N. Paranjape , Nithin Gopalakrishnan Nair , Shameema Sikder , S. Swaroop Vedula , Vishal M. Patel

Accurate pose estimation of surgical tools in Robot-assisted Minimally Invasive Surgery (RMIS) is essential for surgical navigation and robot control. While traditional marker-based methods offer accuracy, they face challenges with…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Utsav Rai , Haozheng Xu , Stamatia Giannarou

To improve the efficiency of surgical trajectory segmentation for robot learning in robot-assisted minimally invasive surgery, this paper presents a fast unsupervised method using video and kinematic data, followed by a promoting procedure…

Computer Vision and Pattern Recognition · Computer Science 2018-10-02 Zhenzhou Shao , Hongfa Zhao , Jiexin Xie , Ying Qu , Yong Guan , Jindong Tan

Recent advances in robot-assisted surgery have resulted in progressively more precise, efficient, and minimally invasive procedures, sparking a new era of robotic surgical intervention. This enables doctors, in collaborative interaction…

Robotics · Computer Science 2024-01-30 Samuel Schmidgall , Axel Krieger , Jason Eshraghian

In pursuit of the time-optimal path tracking (TOPT) trajectory of a robot manipulator along a preset path, a beforehand identified robot dynamic model is usually used to obtain the required optimal trajectory for perfect tracking. However,…

Robotics · Computer Science 2019-08-06 Jiadong Xiao , Lin Li , Tie Zhang , Yanbiao Zou

Tracking Any Point (TAP) has emerged as a fundamental tool for video understanding. Current approaches adapt Vision Foundation Models (VFMs) like DINOv2 via offline finetuning or test-time optimization. However, these VFMs rely on static…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Qiangqiang Wu , Tianyu Yang , Bo Fang , Jia Wan , Matias Di Martino , Guillermo Sapiro , Antoni B. Chan