English
Related papers

Related papers: Multi-Frame Self-Supervised Depth Estimation with …

200 papers

This paper proposes a self-supervised monocular image-to-depth prediction framework that is trained with an end-to-end photometric loss that handles not only 6-DOF camera motion but also 6-DOF moving object instances. Self-supervision is…

Computer Vision and Pattern Recognition · Computer Science 2022-08-10 Houssem Boulahbal , Adrian Voicila , Andrew Comport

Recent geometric methods need reliable estimates of 3D motion parameters to procure accurate dense depth map of a complex dynamic scene from monocular images \cite{kumar2017monocular, ranftl2016dense}. Generally, to estimate…

Computer Vision and Pattern Recognition · Computer Science 2019-03-26 Suryansh Kumar , Ram Srivatsav Ghorakavi , Yuchao Dai , Hongdong Li

In this paper, we propose a novel method for monocular depth estimation in dynamic scenes. We first explore the arbitrariness of object's movement trajectory in dynamic scenes theoretically. To overcome the arbitrariness, we use assume that…

Computer Vision and Pattern Recognition · Computer Science 2024-11-08 Kebin Peng , John Quarles , Kevin Desai

Recent work in unsupervised multi-object segmentation shows impressive results by predicting motion from a single image despite the inherent ambiguity in predicting motion without the next image. On the other hand, the set of possible…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Sadra Safadoust , Fatma Güney

Solving depth estimation with monocular cameras enables the possibility of widespread use of cameras as low-cost depth estimation sensors in applications such as autonomous driving and robotics. However, learning such a scalable depth…

Computer Vision and Pattern Recognition · Computer Science 2020-07-30 Bin Cheng , Inderjot Singh Saggu , Raunak Shah , Gaurav Bansal , Dinesh Bharadia

Self-supervised monocular depth prediction provides a cost-effective solution to obtain the 3D location of each pixel. However, the existing approaches usually lead to unsatisfactory accuracy, which is critical for autonomous robots. In…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Ziyue Feng , Longlong Jing , Peng Yin , Yingli Tian , Bing Li

Light field cameras have been proved to be powerful tools for 3D reconstruction and virtual reality applications. However, the limited resolution of light field images brings a lot of difficulties for further information display and…

Image and Video Processing · Electrical Eng. & Systems 2020-08-27 Qingyan Sun , Shuo Zhang , Song Chang , Lixi Zhu , Youfang Lin

In this work, we propose a novel unsupervised deep learning model to address multi-focus image fusion problem. First, we train an encoder-decoder network in unsupervised manner to acquire deep feature of input images. And then we utilize…

Computer Vision and Pattern Recognition · Computer Science 2020-09-25 Boyuan Ma , Xiaojuan Ban , Haiyou Huang , Yu Zhu

This paper tackles the challenges of self-supervised monocular depth estimation in indoor scenes caused by large rotation between frames and low texture. We ease the learning process by obtaining coarse camera poses from monocular sequences…

Computer Vision and Pattern Recognition · Computer Science 2023-09-29 Chaoqiang Zhao , Matteo Poggi , Fabio Tosi , Lei Zhou , Qiyu Sun , Yang Tang , Stefano Mattoccia

Despite significant progress in monocular depth estimation in the wild, recent state-of-the-art methods cannot be used to recover accurate 3D scene shape due to an unknown depth shift induced by shift-invariant reconstruction losses used in…

Computer Vision and Pattern Recognition · Computer Science 2020-12-18 Wei Yin , Jianming Zhang , Oliver Wang , Simon Niklaus , Long Mai , Simon Chen , Chunhua Shen

With the frequent use of self-supervised monocular depth estimation in robotics and autonomous driving, the model's efficiency is becoming increasingly important. Most current approaches apply much larger and more complex networks to…

Computer Vision and Pattern Recognition · Computer Science 2024-01-09 Wang Boya , Wang Shuo , Ye Dong , Dou Ziwen

Depth from a monocular video can enable billions of devices and robots with a single camera to see the world in 3D. In this paper, we present an approach with a differentiable flow-to-depth layer for video depth estimation. The model…

Computer Vision and Pattern Recognition · Computer Science 2020-03-04 Jiaxin Xie , Chenyang Lei , Zhuwen Li , Li Erran Li , Qifeng Chen

Temporal modeling and spatio-temporal collaboration are pivotal techniques for video-based human pose estimation. Most state-of-the-art methods adopt optical flow or temporal difference, learning local visual content correspondence across…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Runyang Feng , Haoming Chen

Perceiving 3D objects from monocular inputs is crucial for robotic systems, given its economy compared to multi-sensor settings. It is notably difficult as a single image can not provide any clues for predicting absolute depth values.…

Computer Vision and Pattern Recognition · Computer Science 2023-03-02 Tai Wang , Jiangmiao Pang , Dahua Lin

Features from multiple scales can greatly benefit the semantic edge detection task if they are well fused. However, the prevalent semantic edge detection methods apply a fixed weight fusion strategy where images with different semantics are…

Computer Vision and Pattern Recognition · Computer Science 2019-02-26 Yuan Hu , Yunpeng Chen , Xiang Li , Jiashi Feng

Monocular depth estimation is a highly challenging problem that is often addressed with deep neural networks. While these are able to use recognition of image features to predict reasonably looking depth maps the result often has low metric…

Computer Vision and Pattern Recognition · Computer Science 2020-12-22 Patrik Persson , Linn Öström , Carl Olsson

Depth estimation plays a important role in SLAM, odometry, and autonomous driving. Especially, monocular depth estimation is profitable technology because of its low cost, memory, and computation. However, it is not a sufficiently…

Computer Vision and Pattern Recognition · Computer Science 2022-02-25 Hyeonsoo Jang , Yeongmin Ko , Younkwan Lee , Moongu Jeon

Existing methods for reconstructing objects and humans from a monocular image suffer from severe mesh collisions and performance limitations for interacting occluding objects. This paper introduces a method to obtain a globally consistent…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Sarthak Batra , Partha P. Chakrabarti , Simon Hadfield , Armin Mustafa

The vision-based semantic scene completion task aims to predict dense geometric and semantic 3D scene representations from 2D images. However, the presence of dynamic objects in the scene seriously affects the accuracy of the model…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Meng Wang , Fan Wu , Yunchuan Qin , Ruihui Li , Zhuo Tang , Kenli Li

Depth estimation plays a pivotal role in advancing human-robot interactions, especially in indoor environments where accurate 3D scene reconstruction is essential for tasks like navigation and object handling. Monocular depth estimation,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Siddiqui Muhammad Yasir , Hyunsik Ahn