English
Related papers

Related papers: ColonCrafter: A Depth Estimation Model for Colonos…

200 papers

Colonoscopy is crucial for identifying adenomatous polyps and preventing colorectal cancer. However, developing robust models for polyp detection is challenging by the limited size and accessibility of existing colonoscopy datasets. While…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Yifan Xie , Jingge Wang , Tao Feng , Fei Ma , Yang Li

Video depth estimation lifts monocular video clips to 3D by inferring dense depth at every frame. Recent advances in single-image depth estimation, brought about by the rise of large foundation models and the use of synthetic training data,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Bingxin Ke , Dominik Narnhofer , Shengyu Huang , Lei Ke , Torben Peters , Katerina Fragkiadaki , Anton Obukhov , Konrad Schindler

Diffusion models face significant challenges when employed for large-scale medical image reconstruction in real practice such as 3D Computed Tomography (CT). Due to the demanding memory, time, and data requirements, it is difficult to train…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Bowen Song , Jason Hu , Zhaoxu Luo , Jeffrey A. Fessler , Liyue Shen

Reliable recognition of standard cine cardiac MRI views is essential because each view determines which cardiac anatomy is visualized and which quantitative analyses can be performed. Incorrect view identification, whether by a human reader…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Nafiseh Ghaffar Nia , Vinesh Appadurai , Suchithra V. , Chinmay Rane , Daniel Pittman , James Carr , Adrienne Kline

As the number of people affected by diseases in the gastrointestinal system is ever-increasing, a higher demand on preventive screening is inevitable. This will significantly increase the workload on gastroenterologists. To help reduce the…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Pål Anders Floor , Ivar Farup , Marius Pedersen

We present an algorithm for estimating consistent dense depth maps and camera poses from a monocular video. We integrate a learning-based depth prior, in the form of a convolutional neural network trained for single-image depth estimation,…

Computer Vision and Pattern Recognition · Computer Science 2021-06-23 Johannes Kopf , Xuejian Rong , Jia-Bin Huang

We present a novel approach designed to address the complexities posed by challenging, out-of-distribution data in the single-image depth estimation task. Starting with images that facilitate depth prediction due to the absence of…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Fabio Tosi , Pierluigi Zama Ramirez , Matteo Poggi

Deep learning has the potential to improve colonoscopy by enabling 3D reconstruction of the colon, providing a comprehensive view of mucosal surfaces and lesions, and facilitating the identification of unexplored areas. However, the…

We present an algorithm for reconstructing dense, geometrically consistent depth for all pixels in a monocular video. We leverage a conventional structure-from-motion reconstruction to establish geometric constraints on pixels in the video.…

Computer Vision and Pattern Recognition · Computer Science 2020-08-28 Xuan Luo , Jia-Bin Huang , Richard Szeliski , Kevin Matzen , Johannes Kopf

Colorectal cancer screening modalities, such as optical colonoscopy (OC) and virtual colonoscopy (VC), are critical for diagnosing and ultimately removing polyps (precursors of colon cancer). The non-invasive VC is normally used to inspect…

Image and Video Processing · Electrical Eng. & Systems 2021-08-27 Shawn Mathew , Saad Nadeem , Sruti Kumari , Arie Kaufman

Accurate depth estimation plays a critical role in the navigation of endoscopic surgical robots, forming the foundation for 3D reconstruction and safe instrument guidance. Fine-tuning pretrained models heavily relies on endoscopic surgical…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Yinheng Lin , Yiming Huang , Beilei Cui , Long Bai , Huxin Gao , Hongliang Ren , Jiewen Lai

Segmenting polyps in colonoscopy images is essential for the early identification and diagnosis of colorectal cancer, a significant cause of worldwide cancer deaths. Prior deep learning based models such as Attention based variation, UNet…

Image and Video Processing · Electrical Eng. & Systems 2024-07-30 Al Mohimanul Islam , Sadia Shakiba Bhuiyan , Mysun Mashira , Md. Rayhan Ahmed , Salekul Islam , Swakkhar Shatabda

Estimating precise metric depth and scene reconstruction from monocular endoscopy is a fundamental task for surgical navigation in robotic surgery. However, traditional stereo matching adopts binocular images to perceive the depth…

Robotics · Computer Science 2022-11-29 Ruofeng Wei , Bin Li , Hangjie Mo , Fangxun Zhong , Yonghao Long , Qi Dou , Yun-Hui Liu , Dong Sun

3D colon reconstruction from Optical Colonoscopy (OC) to detect non-examined surfaces remains an unsolved problem. The challenges arise from the nature of optical colonoscopy data, characterized by highly reflective low-texture surfaces,…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Erez Posner , Adi Zholkover , Netanel Frank , Moshe Bouhnik

Endoscopic depth estimation is a critical technology for improving the safety and precision of minimally invasive surgery. It has attracted considerable attention from researchers in medical imaging, computer vision, and robotics. Over the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-16 Ke Niu , Zeyun Liu , Xue Feng , Heng Li , Qika Lin , Kaize Shi

Generative models hold promise for revolutionizing medical education, robot-assisted surgery, and data augmentation for machine learning. Despite progress in generating 2D medical images, the complex domain of clinical video generation has…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Chenxin Li , Hengyu Liu , Yifan Liu , Brandon Y. Feng , Wuyang Li , Xinyu Liu , Zhen Chen , Jing Shao , Yixuan Yuan

In this paper, we present DM-Calib, a diffusion-based approach for estimating pinhole camera intrinsic parameters from a single input image. Monocular camera calibration is essential for many 3D vision tasks. However, most existing methods…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Junyuan Deng , Wei Yin , Xiaoyang Guo , Qian Zhang , Xiaotao Hu , Weiqiang Ren , Xiao-Xiao Long , Ping Tan

Computed Tomography (CT) scans are the standard-of-care for the visualization and diagnosis of many clinical ailments, and are needed for the treatment planning of external beam radiotherapy. Unfortunately, the availability of CT scanners…

Image and Video Processing · Electrical Eng. & Systems 2024-08-28 Yiran Sun , Hana Baroudi , Tucker Netherton , Laurence Court , Osama Mawlawi , Ashok Veeraraghavan , Guha Balakrishnan

Reconstructing a 3D surface from colonoscopy video is challenging due to illumination and reflectivity variation in the video frame that can cause defective shape predictions. Aiming to overcome this challenge, we utilize the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Shuxian Wang , Yubo Zhang , Sarah K. McGill , Julian G. Rosenman , Jan-Michael Frahm , Soumyadip Sengupta , Stephen M. Pizer

The advent of autonomous driving and advanced driver assistance systems necessitates continuous developments in computer vision for 3D scene understanding. Self-supervised monocular depth estimation, a method for pixel-wise distance…

Computer Vision and Pattern Recognition · Computer Science 2023-02-03 Arnav Varma , Hemang Chawla , Bahram Zonooz , Elahe Arani