English
Related papers

Related papers: Self-Supervised Surgical Instrument 3D Reconstruct…

200 papers

This paper tackles instrument tracking and 3D visualization challenges in minimally invasive surgery (MIS), crucial for computer-assisted interventions. Conventional and robot-assisted MIS encounter issues with limited 2D camera projections…

Computer Vision and Pattern Recognition · Computer Science 2024-01-19 Shubhangi Nema , Abhishek Mathur , Leena Vachhani

Automatic surgical instrument segmentation of endoscopic images is a crucial building block of many computer-assistance applications for minimally invasive surgery. So far, state-of-the-art approaches completely rely on the availability of…

Computer Vision and Pattern Recognition · Computer Science 2022-02-17 Luca Sestini , Benoit Rosa , Elena De Momi , Giancarlo Ferrigno , Nicolas Padoy

Retinal surgery is a complex activity that can be challenging for a surgeon to perform effectively and safely. Image guided robot-assisted surgery is one of the promising solutions that bring significant surgical enhancement in treatment…

Coded Aperture Snapshot Spectral Imaging (CASSI) reconstruction aims to recover the 3D spatial-spectral signal from 2D measurement. Existing methods for reconstructing Hyperspectral Image (HSI) typically involve learning mappings from a 2D…

Image and Video Processing · Electrical Eng. & Systems 2025-03-19 Huan Chen , Wangcai Zhao , Tingfa Xu , Shiyun Zhou , Peifu Liu , Jianan Li

Recent advances in self-supervised learning havedemonstrated that it is possible to learn accurate monoculardepth reconstruction from raw video data, without using any 3Dground truth for supervision. However, in robotics…

Computer Vision and Pattern Recognition · Computer Science 2020-04-14 Robert McCraith , Lukas Neumann , Andrew Zisserman , Andrea Vedaldi

Our work learns a unified model for single-view 3D reconstruction of objects from hundreds of semantic categories. As a scalable alternative to direct 3D supervision, our work relies on segmented image collections for learning 3D of generic…

Computer Vision and Pattern Recognition · Computer Science 2022-04-08 Kalyan Vasudev Alwala , Abhinav Gupta , Shubham Tulsiani

Much progress has been made in the supervised learning of 3D reconstruction of rigid objects from multi-view images or a video. However, it is more challenging to reconstruct severely deformed objects from a single-view RGB image in an…

Computer Vision and Pattern Recognition · Computer Science 2022-01-25 Jie Mei , Jingxi Yu , Suzanne Romain , Craig Rose , Kelsey Magrane , Graeme LeeSon , Jenq-Neng Hwang

The emergence of real-time 3D ultrasound (US) makes it possible to consider image-based tracking of subcutaneous soft tissue targets for computer guided diagnosis and therapy. We propose a 3D transrectal US based tracking system for precise…

Other Computer Science · Computer Science 2008-01-17 Michael Baumann , Pierre Mozer , Vincent Daanen , Jocelyne Troccaz

SLAM systems are mainly applied for robot navigation while research on feasibility for motion planning with SLAM for tasks like bin-picking, is scarce. Accurate 3D reconstruction of objects and environments is important for planning motion…

Computer Vision and Pattern Recognition · Computer Science 2018-03-07 Sergey Triputen , Atmaraaj Gopal , Thomas Weber , Christian Hofert , Kristiaan Schreve , Matthias Ratsch

Accurate and efficient tracking of surgical instruments is fundamental for Robot-Assisted Minimally Invasive Surgery. Although vision-based robot pose estimation has enabled markerless calibration without tedious physical setups, reliable…

Robotics · Computer Science 2026-03-16 Hanyang Hu , Zekai Liang , Florian Richter , Michael C. Yip

We introduce SAOR, a novel approach for estimating the 3D shape, texture, and viewpoint of an articulated object from a single image captured in the wild. Unlike prior approaches that rely on pre-defined category-specific 3D templates or…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Mehmet Aygün , Oisin Mac Aodha

The Segmented Planar Imaging Detector for Electro-Optical Reconnaissance (SPIDER) is an optical interferometric imaging device that aims to offer an alternative to the large space telescope designs of today with reduced size, weight and…

Instrumentation and Methods for Astrophysics · Physics 2024-01-17 Matthijs Mars , Marta M. Betcke , Jason D. McEwen

We aim to track the endoscope location inside the surgical scene and provide 3D reconstruction, in real-time, from the sole input of the image sequence captured by the monocular endoscope. This information offers new possibilities for…

Computer Vision and Pattern Recognition · Computer Science 2016-08-30 Nader Mahmoud , Iñigo Cirauqui , Alexandre Hostettler , Christophe Doignon , Luc Soler , Jacques Marescaux , J. M. M. Montiel

Detection, tracking, and pose estimation of surgical instruments are crucial tasks for computer assistance during minimally invasive robotic surgery. In the majority of cases, the first step is the automatic segmentation of surgical tools.…

Computer Vision and Pattern Recognition · Computer Science 2017-03-28 Daniil Pakhomov , Vittal Premachandran , Max Allan , Mahdi Azizian , Nassir Navab

To translate synthetic aperture radar (SAR) image into interpretable forms for human understanding is the ultimate goal of SAR advanced information retrieval. Existing methods mainly focus on 3D surface reconstruction or local geometric…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Ziyu Yue , Ruixi You , Feng Xu

The growing prevalence of intelligent manufacturing and autonomous vehicles has intensified the demand for three-dimensional (3D) reconstruction under complex reflection and transmission conditions. Traditional structured light techniques…

Low Dose Computed Tomography suffers from a high amount of noise and/or undersampling artefacts in the reconstructed image. In the current article, a Deep Learning technique is exploited as a regularization term for the iterative…

Image and Video Processing · Electrical Eng. & Systems 2019-06-04 Shabab Bazrafkan , Vincent Van Nieuwenhove , Joris Soons , Jan De Beenhouwer , Jan Sijbers

The performance of existing single-view 3D reconstruction methods heavily relies on large-scale 3D annotations. However, such annotations are tedious and expensive to collect. Semi-supervised learning serves as an alternative way to…

Computer Vision and Pattern Recognition · Computer Science 2022-10-03 Zhen Xing , Hengduo Li , Zuxuan Wu , Yu-Gang Jiang

A major limitation of minimally invasive surgery is the difficulty in accurately locating the internal anatomical structures of the target organ due to the lack of tactile feedback and transparency. Augmented reality (AR) offers a promising…

Robotics · Computer Science 2024-09-19 Jingwei Song , Ray Zhang , Wenwei Zhang , Hao Zhou , Maani Ghaffari

Magnetic Resonance Imaging (MRI) has become an important technique in the clinic for the visualization, detection, and diagnosis of various diseases. However, one bottleneck limitation of MRI is the relatively slow data acquisition process.…

Image and Video Processing · Electrical Eng. & Systems 2022-11-28 Xue Liu , Juan Zou , Xiawu Zheng , Cheng Li , Hairong Zheng , Shanshan Wang