English
Related papers

Related papers: Monocular 3D Object Detection with Depth from Moti…

200 papers

Deep Learning based techniques have been adopted with precision to solve a lot of standard computer vision problems, some of which are image classification, object detection and segmentation. Despite the widespread success of these…

Computer Vision and Pattern Recognition · Computer Science 2016-11-21 Vikram Mohanty , Shubh Agrawal , Shaswat Datta , Arna Ghosh , Vishnu Dutt Sharma , Debashish Chakravarty

Self-supervised monocular depth estimation (DE) is an approach to learning depth without costly depth ground truths. However, it often struggles with moving objects that violate the static scene assumption during training. To address this…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Jaeho Moon , Juan Luis Gonzalez Bello , Byeongjun Kwon , Munchurl Kim

Localizing objects in 3D space and understanding their associated 3D properties is challenging given only monocular RGB images. The situation is compounded by the loss of depth information during perspective projection. We present Center3D,…

Computer Vision and Pattern Recognition · Computer Science 2020-05-28 Yunlei Tang , Sebastian Dorn , Chiragkumar Savani

We present a novel method for simultaneous learning of depth, egomotion, object motion, and camera intrinsics from monocular videos, using only consistency across neighboring video frames as supervision signal. Similarly to prior work, our…

Computer Vision and Pattern Recognition · Computer Science 2019-10-31 Ariel Gordon , Hanhan Li , Rico Jonschkowski , Anelia Angelova

We propose a novel approach for monocular 3D object detection by leveraging local perspective effects of each object. While the global perspective effect shown as size and position variations has been exploited for monocular 3D detection…

Computer Vision and Pattern Recognition · Computer Science 2023-01-06 Minghan Zhu , Lingting Ge , Panqu Wang , Huei Peng

In this technical report, we present our solution, dubbed MV-FCOS3D++, for the Camera-Only 3D Detection track in Waymo Open Dataset Challenge 2022. For multi-view camera-only 3D detection, methods based on bird-eye-view or 3D geometric…

Computer Vision and Pattern Recognition · Computer Science 2022-07-27 Tai Wang , Qing Lian , Chenming Zhu , Xinge Zhu , Wenwei Zhang

Perceiving accurate 3D object shape is important for robots to interact with the physical world. Current research along this direction has been primarily relying on visual observations. Vision, however useful, has inherent limitations due…

Computer Vision and Pattern Recognition · Computer Science 2018-08-10 Shaoxiong Wang , Jiajun Wu , Xingyuan Sun , Wenzhen Yuan , William T. Freeman , Joshua B. Tenenbaum , Edward H. Adelson

We address the problem of 3D object detection from 2D monocular images in autonomous driving scenarios. We propose to lift the 2D images to 3D representations using learned neural networks and leverage existing networks working directly on…

Computer Vision and Pattern Recognition · Computer Science 2019-10-14 Siddharth Srivastava , Frederic Jurie , Gaurav Sharma

Monocular depth estimation aims to recover the depth information of 3D scenes from 2D images. Recent work has made significant progress, but its reliance on large-scale datasets and complex decoders has limited its efficiency and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-07 Zeyu Ren , Zeyu Zhang , Wukai Li , Qingxiang Liu , Hao Tang

Following the successful application of deep convolutional neural networks to 2d human pose estimation, the next logical problem to solve is 3d human pose estimation from monocular images. While previous solutions have shown some success,…

Computer Vision and Pattern Recognition · Computer Science 2021-03-04 Alec Diaz-Arias , Mitchell Messmore , Dmitriy Shin , Stephen Baek

Stereoscopic 3D displays adopt a binocular depth cue to provide depth perception. However, users should be equipped with expensive special devices to appreciate depth perception based on the binocular depth cues. Also, visual fatigue…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Seungchul Ryu , Hyunjin Yoo , Tara Akhavan

We present a system for learning motion of independently moving objects from stereo videos. The only human annotation used in our system are 2D object bounding boxes which introduce the notion of objects to our system. Unlike prior learning…

Computer Vision and Pattern Recognition · Computer Science 2019-01-09 Zhe Cao , Abhishek Kar , Christian Haene , Jitendra Malik

We propose a 3D object detection system with multi-sensor refinement in the context of autonomous driving. In our framework, the monocular camera serves as the fundamental sensor for 2D object proposal and initial 3D bounding box…

Computer Vision and Pattern Recognition · Computer Science 2019-11-20 Peiliang Li , Siqi Liu , Shaojie Shen

Transformers have revolutionized deep learning based computer vision with improved performance as well as robustness to natural corruptions and adversarial attacks. Transformers are used predominantly for 2D vision tasks, including image…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Hemang Chawla , Arnav Varma , Elahe Arani , Bahram Zonooz

This paper presents an approach that reconstructs a hand-held object from a monocular video. In contrast to many recent methods that directly predict object geometry by a trained network, the proposed approach does not require any learned…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Di Huang , Xiaopeng Ji , Xingyi He , Jiaming Sun , Tong He , Qing Shuai , Wanli Ouyang , Xiaowei Zhou

Current self-supervised monocular depth estimation methods are mostly based on estimating a rigid-body motion representing camera motion. These methods suffer from the well-known scale ambiguity problem in their predictions. We propose…

Computer Vision and Pattern Recognition · Computer Science 2023-01-06 Sadra Safadoust , Fatma Güney

Monocular Depth Estimation (MDE) is performed to produce 3D information that can be used in downstream tasks such as those related to on-board perception for Autonomous Vehicles (AVs) or driver assistance. Therefore, a relevant arising…

Computer Vision and Pattern Recognition · Computer Science 2023-02-21 Akhil Gurram , Antonio M. Lopez

Estimating the pose of a moving camera from monocular video is a challenging problem, especially due to the presence of moving objects in dynamic environments, where the performance of existing camera pose estimation methods are susceptible…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Wang Zhao , Shaohui Liu , Hengkai Guo , Wenping Wang , Yong-Jin Liu

Existing deep models predict 2D and 3D kinematic poses from video that are approximately accurate, but contain visible errors that violate physical constraints, such as feet penetrating the ground and bodies leaning at extreme angles. In…

Computer Vision and Pattern Recognition · Computer Science 2020-07-27 Davis Rempe , Leonidas J. Guibas , Aaron Hertzmann , Bryan Russell , Ruben Villegas , Jimei Yang

Monocular 3D object detection is a low-cost but challenging task, as it requires generating accurate 3D localization solely from a single image input. Recent developed depth-assisted methods show promising results by using explicit depth…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Zizhang Wu , Yunzhe Wu , Jian Pu , Xianzhi Li , Xiaoquan Wang