English
Related papers

Related papers: SfMLearner++: Learning Monocular Depth & Ego-Motio…

200 papers

Monocular depth estimation is critical for endoscopists to perform spatial perception and 3D navigation of surgical sites. However, most of the existing methods ignore the important geometric structural consistency, which inevitably leads…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Yongming Yang , Shuwei Shao , Tao Yang , Peng Wang , Zhuo Yang , Chengdong Wu , Hao Liu

We propose a method for metric-scale monocular depth estimation. Inferring depth from a single image is an ill-posed problem due to the loss of scale from perspective projection during the image formation process. Any scale chosen is a…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Ziyao Zeng , Yangchao Wu , Hyoungseob Park , Daniel Wang , Fengyu Yang , Stefano Soatto , Dong Lao , Byung-Woo Hong , Alex Wong

Monocular depth estimation is often described as an ill-posed and inherently ambiguous problem. Estimating depth from 2D images is a crucial step in scene reconstruction, 3Dobject recognition, segmentation, and detection. The problem can be…

Computer Vision and Pattern Recognition · Computer Science 2019-01-29 Amlaan Bhoi

Self-supervised monocular depth and ego-motion estimation is a promising approach to replace or supplement expensive depth sensors such as LiDAR for robotics applications like autonomous driving. However, most research in this area focuses…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Vitor Guizilini , Igor Vasiljevic , Rares Ambrus , Greg Shakhnarovich , Adrien Gaidon

We present MoGe, a powerful model for recovering 3D geometry from monocular open-domain images. Given a single image, our model directly predicts a 3D point map of the captured scene with an affine-invariant representation, which is…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Ruicheng Wang , Sicheng Xu , Cassie Dai , Jianfeng Xiang , Yu Deng , Xin Tong , Jiaolong Yang

UAVs have become an essential photogrammetric measurement as they are affordable, easily accessible and versatile. Aerial images captured from UAVs have applications in small and large scale texture mapping, 3D modelling, object detection…

Computer Vision and Pattern Recognition · Computer Science 2020-12-22 Logambal Madhuanand , Francesco Nex , Michael Ying Yang

We present an unsupervised learning framework for the task of monocular depth and camera motion estimation from unstructured video sequences. We achieve this by simultaneously training depth and camera pose estimation networks using the…

Computer Vision and Pattern Recognition · Computer Science 2017-08-02 Tinghui Zhou , Matthew Brown , Noah Snavely , David G. Lowe

Monocular depth estimation in endoscopy videos can enable assistive and robotic surgery to obtain better coverage of the organ and detection of various health issues. Despite promising progress on mainstream, natural image depth estimation,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Akshay Paruchuri , Samuel Ehrenstein , Shuxian Wang , Inbar Fried , Stephen M. Pizer , Marc Niethammer , Roni Sengupta

Recovering the scene depth from a single image is an ill-posed problem that requires additional priors, often referred to as monocular depth cues, to disambiguate different 3D interpretations. In recent works, those priors have been learned…

Computer Vision and Pattern Recognition · Computer Science 2020-08-18 Lam Huynh , Phong Nguyen-Ha , Jiri Matas , Esa Rahtu , Janne Heikkila

Monocular depth estimation in the wild inherently predicts depth up to an unknown scale. To resolve scale ambiguity issue, we present a learning algorithm that leverages monocular simultaneous localization and mapping (SLAM) with…

Computer Vision and Pattern Recognition · Computer Science 2022-03-11 Jaehoon Choi , Dongki Jung , Yonghan Lee , Deokhwa Kim , Dinesh Manocha , Donghwan Lee

Recent learning-based approaches, in which models are trained by single-view images have shown promising results for monocular 3D face reconstruction, but they suffer from the ill-posed face pose and depth ambiguity issue. In contrast to…

Computer Vision and Pattern Recognition · Computer Science 2020-07-27 Jiaxiang Shang , Tianwei Shen , Shiwei Li , Lei Zhou , Mingmin Zhen , Tian Fang , Long Quan

Gastroendoscopy has been a clinical standard for diagnosing and treating conditions that affect a part of a patient's digestive system, such as the stomach. Despite the fact that gastroendoscopy has a lot of advantages for patients, there…

Computer Vision and Pattern Recognition · Computer Science 2021-07-29 Aji Resindra Widya , Yusuke Monno , Masatoshi Okutomi , Sho Suzuki , Takuji Gotoda , Kenji Miki

As a crucial task of autonomous driving, 3D object detection has made great progress in recent years. However, monocular 3D object detection remains a challenging problem due to the unsatisfactory performance in depth estimation. Most…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Yinmin Zhang , Xinzhu Ma , Shuai Yi , Jun Hou , Zhihui Wang , Wanli Ouyang , Dan Xu

This paper presents an self-supervised deep learning network for monocular visual inertial odometry (named DeepVIO). DeepVIO provides absolute trajectory estimation by directly merging 2D optical flow feature (OFF) and Inertial Measurement…

Robotics · Computer Science 2019-07-01 Liming Han , Yimin Lin , Guoguang Du , Shiguo Lian

Monocular visual odometry approaches that purely rely on geometric cues are prone to scale drift and require sufficient motion parallax in successive frames for motion estimation and 3D reconstruction. In this paper, we propose to leverage…

Computer Vision and Pattern Recognition · Computer Science 2018-07-26 Nan Yang , Rui Wang , Jörg Stückler , Daniel Cremers

This paper presents an unsupervised deep learning framework called UnDEMoN for estimating dense depth map and 6-DoF camera pose information directly from monocular images. The proposed network is trained using unlabeled monocular stereo…

Computer Vision and Pattern Recognition · Computer Science 2018-11-28 Madhu Babu , Anima Majumder , Kaushik Das , Swagat Kumar

There has been tremendous research progress in estimating the depth of a scene from a monocular camera image. Existing methods for single-image depth prediction are exclusively based on deep neural networks, and their training can be…

Computer Vision and Pattern Recognition · Computer Science 2019-05-21 Ali Jahani Amiri , Shing Yan Loo , Hong Zhang

Dynamic scenes that contain both object motion and egomotion are a challenge for monocular visual odometry (VO). Another issue with monocular VO is the scale ambiguity, i.e. these methods cannot estimate scene depth and camera motion in…

Computer Vision and Pattern Recognition · Computer Science 2020-08-31 Hirak J Kashyap , Charless Fowlkes , Jeffrey L Krichmar

Most learning-based methods estimate ego-motion by utilizing visual sensors, which suffer from dramatic lighting variations and textureless scenarios. In this paper, we incorporate sparse but accurate depth measurements obtained from lidars…

Computer Vision and Pattern Recognition · Computer Science 2021-01-06 Bin Li , Mu Hu , Shuling Wang , Lianghao Wang , Xiaojin Gong

We address the problem of joint optical flow and camera motion estimation in rigid scenes by incorporating geometric constraints into an unsupervised deep learning framework. Unlike existing approaches which rely on brightness constancy and…

Computer Vision and Pattern Recognition · Computer Science 2020-02-28 Shihao Jiang , Dylan Campbell , Miaomiao Liu , Stephen Gould , Richard Hartley