English
Related papers

Related papers: Depth estimation of endoscopy using sim-to-real tr…

200 papers

Robotic surgery has become a powerful tool for performing minimally invasive procedures, providing advantages in dexterity, precision, and 3D vision, over traditional surgery. One popular robotic system is the da Vinci surgical platform,…

Computer Vision and Pattern Recognition · Computer Science 2017-05-24 Menglong Ye , Edward Johns , Ankur Handa , Lin Zhang , Philip Pratt , Guang-Zhong Yang

Many studies utilize dual-pixel (DP) sensor phase characteristics for various applications, such as depth estimation and deblurring. However, since the DP image features are entirely determined by the camera hardware, DP-depth paired…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Fengchen He , Dayang Zhao , Hao Xu , Tingwei Quan , Shaoqun Zeng

Depth information plays a crucial role in autonomous systems for environmental perception and robot state estimation. With the rapid development of deep neural network technology, depth estimation has been extensively studied and shown…

Robotics · Computer Science 2024-11-11 Quang Truong Nguyen , Thanh Nguyen Canh , Xiem HoangVan

Depth estimation from 2D images is a common computer vision task that has applications in many fields including autonomous vehicles, scene understanding and robotics. The accuracy of a supervised depth estimation method mainly relies on the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-12 Muhammad Adeel Hafeez , Michael G. Madden , Ganesh Sistu , Ihsan Ullah

Surgical tool segmentation in endoscopic videos is an important component of computer assisted interventions systems. Recent success of image-based solutions using fully-supervised deep learning approaches can be attributed to the…

Computer Vision and Pattern Recognition · Computer Science 2020-07-23 Manish Sahu , Ronja Strömsdörfer , Anirban Mukhopadhyay , Stefan Zachow

Most current single image camera calibration methods rely on specific image features or user input, and cannot be applied to natural images captured in uncontrolled settings. We propose directly inferring camera calibration parameters from…

Computer Vision and Pattern Recognition · Computer Science 2018-04-24 Yannick Hold-Geoffroy , Kalyan Sunkavalli , Jonathan Eisenmann , Matt Fisher , Emiliano Gambaretto , Sunil Hadap , Jean-François Lalonde

Historically, patient datasets have been used to develop and validate various reconstruction algorithms for PET/MRI and PET/CT. To enable such algorithm development, without the need for acquiring hundreds of patient exams, in this paper we…

Deep convolutional neural networks (CNN) have recently been shown in many computer vision and pattern recog- nition applications to outperform by a significant margin state- of-the-art solutions that use traditional hand-crafted features.…

Robotics · Computer Science 2015-04-22 Yi Hou , Hong Zhang , Shilin Zhou

Novel imaging technologies raise many questions concerning the adaptation of computer-aided decision support systems. Classification models either need to be adapted or even newly trained from scratch to exploit the full potential of…

Image and Video Processing · Electrical Eng. & Systems 2020-04-28 Georg Wimmer , Michael Gadermayr , Andreas Vécsei , Andreas Uhl

Given the recent advances in depth prediction from Convolutional Neural Networks (CNNs), this paper investigates how predicted depth maps from a deep neural network can be deployed for accurate and dense monocular reconstruction. We propose…

Computer Vision and Pattern Recognition · Computer Science 2017-04-13 Keisuke Tateno , Federico Tombari , Iro Laina , Nassir Navab

We propose an estimation method using a recurrent neural network (RNN) of the colon's shape where deformation was occurred by a colonoscope insertion. Colonoscope tracking or a navigation system that navigates physician to polyp positions…

Computer Vision and Pattern Recognition · Computer Science 2020-04-29 Masahiro Oda , Holger R. Roth , Takayuki Kitasaka , Kazuhiro Furukawa , Ryoji Miyahara , Yoshiki Hirooka , Hidemi Goto , Nassir Navab , Kensaku Mori

While an increasing interest in deep models for single-image depth estimation methods can be observed, established schemes for their evaluation are still limited. We propose a set of novel quality criteria, allowing for a more detailed…

Computer Vision and Pattern Recognition · Computer Science 2018-05-04 Tobias Koch , Lukas Liebel , Friedrich Fraundorfer , Marco Körner

As in other areas of medical image analysis, e.g. semantic segmentation, deep learning is currently driving the development of new approaches for image registration. Multi-scale encoder-decoder network architectures achieve state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2021-03-02 Lasse Hansen , Mattias P. Heinrich

Intraoperative shape reconstruction of organs from endoscopic camera images is a complex yet indispensable technique for image-guided surgery. To address the uncertainty in reconstructing entire shapes from single-viewpoint occluded images,…

Computer Vision and Pattern Recognition · Computer Science 2023-01-27 Tomoki Oya , Megumi Nakao , Tetsuya Matsuda

Indoor positioning and navigation inside an area with no GPS-data availability is a challenging problem. There are applications such as augmented reality, autonomous driving, navigation of drones inside tunnels, in which indoor positioning…

Computer Vision and Pattern Recognition · Computer Science 2019-10-15 Ali Ghofrani , Rahil Mahdian Toroghi , Sayed Mojtaba Tabatabaie

We introduce a novel method for odometry estimation using convolutional neural networks from 3D LiDAR scans. The original sparse data are encoded into 2D matrices for the training of proposed networks and for the prediction. Our networks…

Robotics · Computer Science 2017-12-19 Martin Velas , Michal Spanel , Michal Hradis , Adam Herout

Colorectal cancer is one of the most common cancers in the world. While colonoscopy is an effective screening technique, navigating an endoscope through the colon to detect polyps is challenging. A 3D map of the observed surfaces could…

The advent of computed tomography significantly improves patient health regarding diagnosis, prognosis, and treatment planning and verification. However, tomographic imaging escalates concomitant radiation doses to patients, inducing…

Depth estimation plays a crucial role in various tasks within endoscopic surgery, including navigation, surface reconstruction, and augmented reality visualization. Despite the significant achievements of foundation models in vision tasks,…

Image and Video Processing · Electrical Eng. & Systems 2024-05-15 Beilei Cui , Mobarakol Islam , Long Bai , An Wang , Hongliang Ren

Endoscopy is the most widely used medical technique for cancer and polyp detection inside hollow organs. However, images acquired by an endoscope are frequently affected by illumination artefacts due to the enlightenment source orientation.…

Image and Video Processing · Electrical Eng. & Systems 2022-07-07 Axel Garcia-Vega , Ricardo Espinosa , Gilberto Ochoa-Ruiz , Thomas Bazin , Luis Eduardo Falcon-Morales , Dominique Lamarque , Christian Daul