English
Related papers

Related papers: Self-Supervised Monocular Scene Decomposition and …

200 papers

Observable motion in videos can give rise to the definition of objects moving with respect to the scene. The task of segmenting such moving objects is referred to as motion segmentation and is usually tackled either by aggregating motion…

Computer Vision and Pattern Recognition · Computer Science 2020-08-19 Amirhossein Kardoost , Kalun Ho , Peter Ochs , Margret Keuper

In the recent years, many methods demonstrated the ability of neural networks to learn depth and pose changes in a sequence of images, using only self-supervision as the training signal. Whilst the networks achieve good performance, the…

Computer Vision and Pattern Recognition · Computer Science 2021-10-14 Robert McCraith , Lukas Neumann , Andrea Vedaldi

Monocular depth estimation can play an important role in addressing the issue of deriving scene geometry from 2D images. It has been used in a variety of industries, including robots, self-driving cars, scene comprehension, 3D…

Computer Vision and Pattern Recognition · Computer Science 2022-12-23 Ruilin Ma , Shiyao Chen , Qin Zhang

Unsupervised learning of depth and ego-motion from unlabelled monocular videos has recently drawn great attention, which avoids the use of expensive ground truth in the supervised one. It achieves this by using the photometric errors…

Computer Vision and Pattern Recognition · Computer Science 2020-11-23 Hualie Jiang , Laiyan Ding , Zhenglong Sun , Rui Huang

Depth estimation is a critical topic for robotics and vision-related tasks. In monocular depth estimation, in comparison with supervised learning that requires expensive ground truth labeling, self-supervised methods possess great potential…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Jinchang Zhang , Praveen Kumar Reddy , Xue-Iuan Wong , Yiannis Aloimonos , Guoyu Lu

Monocular depth estimation has been increasingly adopted in robotics and autonomous driving for its ability to infer scene geometry from a single camera. In self-supervised monocular depth estimation frameworks, the network jointly…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Tae-Wook Um , Ki-Hyeon Kim , Hyun-Duck Choi , Hyo-Sung Ahn

Perceiving 3D objects from monocular inputs is crucial for robotic systems, given its economy compared to multi-sensor settings. It is notably difficult as a single image can not provide any clues for predicting absolute depth values.…

Computer Vision and Pattern Recognition · Computer Science 2023-03-02 Tai Wang , Jiangmiao Pang , Dahua Lin

It is an exciting task to recover the scene's 3d-structure and camera pose from the video sequence. Most of the current solutions divide it into two parts, monocular depth recovery and camera pose estimation. The monocular depth recovery is…

Computer Vision and Pattern Recognition · Computer Science 2018-05-24 YanTong Wu , Yang Liu

There have been attempts to detect 3D objects by fusion of stereo camera images and LiDAR sensor data or using LiDAR for pre-training and only monocular images for testing, but there have been less attempts to use only monocular image…

Computer Vision and Pattern Recognition · Computer Science 2022-09-21 Curie Kim , Ue-Hwan Kim , Jong-Hwan Kim

We present an approach which takes advantage of both structure and semantics for unsupervised monocular learning of depth and ego-motion. More specifically, we model the motion of individual objects and learn their 3D motion vector jointly…

Computer Vision and Pattern Recognition · Computer Science 2019-06-14 Vincent Casser , Soeren Pirk , Reza Mahjourian , Anelia Angelova

Event cameras can record scene dynamics with high temporal resolution, providing rich scene details for monocular depth estimation (MDE) even at low-level illumination. Therefore, existing complementary learning approaches for MDE fuse…

Computer Vision and Pattern Recognition · Computer Science 2024-03-01 Haotian Liu , Sanqing Qu , Fan Lu , Zongtao Bu , Florian Roehrbein , Alois Knoll , Guang Chen

Training deep networks for semantic segmentation requires large amounts of labeled training data, which presents a major challenge in practice, as labeling segmentation masks is a highly labor-intensive process. To address this issue, we…

Computer Vision and Pattern Recognition · Computer Science 2021-08-31 Lukas Hoyer , Dengxin Dai , Qin Wang , Yuhua Chen , Luc Van Gool

Monocular depth estimation in endoscopy videos can enable assistive and robotic surgery to obtain better coverage of the organ and detection of various health issues. Despite promising progress on mainstream, natural image depth estimation,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Akshay Paruchuri , Samuel Ehrenstein , Shuxian Wang , Inbar Fried , Stephen M. Pizer , Marc Niethammer , Roni Sengupta

Over the past few years, self-supervised monocular depth estimation that does not depend on ground-truth during the training phase has received widespread attention. Most efforts focus on designing different types of network architectures…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Shuwei Shao , Zhongcai Pei , Weihai Chen , Dingchi Sun , Peter C. Y. Chen , Zhengguo Li

Self-supervised monocular depth estimation has seen significant progress in recent years, especially in outdoor environments. However, depth prediction results are not satisfying in indoor scenes where most of the existing data are captured…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Runze Li , Pan Ji , Yi Xu , Bir Bhanu

Accurate monocular depth estimation is crucial for 3D scene understanding, but existing methods often blur depth at object boundaries, introducing spurious intermediate 3D points. While achieving sharp edges usually requires very…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Aurélien Cecille , Stefan Duffner , Franck Davoine , Rémi Agier , Thibault Neveu

A new unsupervised learning method of depth and ego-motion using multiple masks from monocular video is proposed in this paper. The depth estimation network and the ego-motion estimation network are trained according to the constraints of…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Guangming Wang , Hesheng Wang , Yiling Liu , Weidong Chen

A thermal camera can robustly capture thermal radiation images under harsh light conditions such as night scenes, tunnels, and disaster scenarios. However, despite this advantage, neither depth nor ego-motion estimation research for the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-08 Ukcheol Shin , Kyunghyun Lee , Seokju Lee , In So Kweon

Recent work has shown that CNN-based depth and ego-motion estimators can be learned using unlabelled monocular videos. However, the performance is limited by unidentified moving objects that violate the underlying static scene assumption in…

Computer Vision and Pattern Recognition · Computer Science 2019-10-04 Jia-Wang Bian , Zhichao Li , Naiyan Wang , Huangying Zhan , Chunhua Shen , Ming-Ming Cheng , Ian Reid

In this paper, we propose MonoRec, a semi-supervised monocular dense reconstruction architecture that predicts depth maps from a single moving camera in dynamic environments. MonoRec is based on a multi-view stereo setting which encodes the…

Computer Vision and Pattern Recognition · Computer Science 2022-09-22 Felix Wimbauer , Nan Yang , Lukas von Stumberg , Niclas Zeller , Daniel Cremers