English
Related papers

Related papers: MonoRec: Semi-Supervised Dense Reconstruction in D…

200 papers

We present a self-supervised learning-based pipeline for dense 3D reconstruction from full-length monocular endoscopic videos without a priori modeling of anatomy or shading. Our method only relies on unlabeled monocular endoscopic videos…

Computer Vision and Pattern Recognition · Computer Science 2019-09-10 Xingtong Liu , Ayushi Sinha , Masaru Ishii , Gregory D. Hager , Russell H. Taylor , Mathias Unberath

Monocular depth estimation aims at predicting depth from a single image or video. Recently, self-supervised methods draw much attention since they are free of depth annotations and achieve impressive performance on several daytime…

Computer Vision and Pattern Recognition · Computer Science 2021-08-16 Kun Wang , Zhenyu Zhang , Zhiqiang Yan , Xiang Li , Baobei Xu , Jun Li , Jian Yang

We present MonoPSR, a monocular 3D object detection method that leverages proposals and shape reconstruction. First, using the fundamental relations of a pinhole camera model, detections from a mature 2D object detector are used to generate…

Computer Vision and Pattern Recognition · Computer Science 2019-04-04 Jason Ku , Alex D. Pon , Steven L. Waslander

In this work, we propose a novel single-shot and keypoints-based framework for monocular 3D objects detection using only RGB images, called KM3D-Net. We design a fully convolutional model to predict object keypoints, dimension, and…

Computer Vision and Pattern Recognition · Computer Science 2020-09-03 Peixuan Li

The monocular depth estimation task has recently revealed encouraging prospects, especially for the autonomous driving task. To tackle the ill-posed problem of 3D geometric reasoning from 2D monocular images, multi-frame monocular methods…

Computer Vision and Pattern Recognition · Computer Science 2023-05-15 Zizhang Wu , Zhuozheng Li , Zhi-Gang Fan , Yunzhe Wu , Yuanzhu Gan , Jian Pu , Xianzhi Li

Solving depth estimation with monocular cameras enables the possibility of widespread use of cameras as low-cost depth estimation sensors in applications such as autonomous driving and robotics. However, learning such a scalable depth…

Computer Vision and Pattern Recognition · Computer Science 2020-07-30 Bin Cheng , Inderjot Singh Saggu , Raunak Shah , Gaurav Bansal , Dinesh Bharadia

Self-supervised monocular depth estimation has emerged as a promising approach since it does not rely on labeled training data. Most methods combine convolution and Transformer to model long-distance dependencies to estimate depth…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Xuezhi Xiang , Yao Wang , Lei Zhang , Denis Ombati , Himaloy Himu , Xiantong Zhen

Self-supervised learning of depth map prediction and motion estimation from monocular video sequences is of vital importance -- since it realizes a broad range of tasks in robotics and autonomous vehicles. A large number of research efforts…

Computer Vision and Pattern Recognition · Computer Science 2021-03-24 Ue-Hwan Kim , Jong-Hwan Kim

We present a method for predicting dense depth in scenarios where both a monocular camera and people in the scene are freely moving. Existing methods for recovering depth for dynamic, non-rigid objects from monocular video impose strong…

Computer Vision and Pattern Recognition · Computer Science 2019-04-26 Zhengqi Li , Tali Dekel , Forrester Cole , Richard Tucker , Noah Snavely , Ce Liu , William T. Freeman

Compressive sensing (CS) reconstructs images from sub-Nyquist measurements by solving a sparsity-regularized inverse problem. Traditional CS solvers use iterative optimizers with hand crafted sparsifiers, while early data-driven methods…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Pamuditha Somarathne , Tharindu Wickremasinghe , Amashi Niwarthana , A. Thieshanthan , Chamira U. S. Edussooriya , Dushan N. Wadduwage

Monocular 3D object detection is a fundamental but very important task to many applications including autonomous driving, robotic grasping and augmented reality. Existing leading methods tend to estimate the depth of the input image first,…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Han Sun , Zhaoxin Fan , Zhenbo Song , Zhicheng Wang , Kejian Wu , Jianfeng Lu

Monocular depth estimation is known as an ill-posed task in which objects in a 2D image usually do not contain sufficient information to predict their depth. Thus, it acts differently from other tasks (e.g., classification and segmentation)…

Computer Vision and Pattern Recognition · Computer Science 2023-08-11 Wencheng Han , Junbo Yin , Jianbing Shen

We present a novel framework named NeuralRecon for real-time 3D scene reconstruction from a monocular video. Unlike previous methods that estimate single-view depth maps separately on each key-frame and fuse them later, we propose to…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Jiaming Sun , Yiming Xie , Linghao Chen , Xiaowei Zhou , Hujun Bao

We introduce a way to learn to estimate a scene representation from a single image by predicting a low-dimensional subspace of optical flow for each training example, which encompasses the variety of possible camera and object movement.…

Computer Vision and Pattern Recognition · Computer Science 2022-10-28 Richard Strong Bowen , Richard Tucker , Ramin Zabih , Noah Snavely

Event cameras are novel sensors that output brightness changes in the form of a stream of asynchronous events instead of intensity frames. Compared to conventional image sensors, they offer significant advantages: high temporal resolution,…

Computer Vision and Pattern Recognition · Computer Science 2020-10-23 Javier Hidalgo-Carrió , Daniel Gehrig , Davide Scaramuzza

We present DenseRaC, a novel end-to-end framework for jointly estimating 3D human pose and body shape from a monocular RGB image. Our two-step framework takes the body pixel-to-surface correspondence map (i.e., IUV map) as proxy…

Computer Vision and Pattern Recognition · Computer Science 2019-10-10 Yuanlu Xu , Song-Chun Zhu , Tony Tung

3D reconstruction of depth and motion from monocular video in dynamic environments is a highly ill-posed problem due to scale ambiguities when projecting to the 2D image domain. In this work, we investigate the performance of the current…

Computer Vision and Pattern Recognition · Computer Science 2022-01-24 Christian Homeyer , Oliver Lange , Christoph Schnörr

Reconstructing dynamic 4D scenes remains challenging due to the presence of moving objects that corrupt camera pose estimation. Existing optimization methods alleviate this issue with additional supervision, but they are mostly…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Juntong Fang , Zequn Chen , Weiqi Zhang , Donglin Di , Xuancheng Zhang , Chengmin Yang , Yu-Shen Liu

Monocular depth estimation (MDE) plays a pivotal role in various computer vision applications, such as robotics, augmented reality, and autonomous driving. Despite recent advancements, existing methods often fail to meet key requirements…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Andrii Litvynchuk , Ivan Livinsky , Anand Ravi , Nima Kalantari , Andrii Tsarov

We present a self-supervised learning framework to estimate the individual object motion and monocular depth from video. We model the object motion as a 6 degree-of-freedom rigid-body transformation. The instance segmentation mask is…

Computer Vision and Pattern Recognition · Computer Science 2020-05-14 Qi Dai , Vaishakh Patil , Simon Hecker , Dengxin Dai , Luc Van Gool , Konrad Schindler