English
Related papers

Related papers: Monocular 3D Detection with Geometric Constraints …

200 papers

We present a novel approach for unsupervised learning of depth and ego-motion from monocular video. Unsupervised learning removes the need for separate supervisory signals (depth or ego-motion ground truth, or multi-view video). Prior work…

Computer Vision and Pattern Recognition · Computer Science 2018-06-12 Reza Mahjourian , Martin Wicke , Anelia Angelova

Although cameras are ubiquitous, robotic platforms typically rely on active sensors like LiDAR for direct 3D perception. In this work, we propose a novel self-supervised monocular depth estimation method combining geometry with a new deep…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Vitor Guizilini , Rares Ambrus , Sudeep Pillai , Allan Raventos , Adrien Gaidon

A key contributor to recent progress in 3D detection from single images is monocular depth estimation. Existing methods focus on how to leverage depth explicitly, by generating pseudo-pointclouds or providing attention cues for image…

Computer Vision and Pattern Recognition · Computer Science 2022-10-07 Dennis Park , Jie Li , Dian Chen , Vitor Guizilini , Adrien Gaidon

Current state-of-the-art solutions for motion capture from a single camera are optimization driven: they optimize the parameters of a 3D human model so that its re-projection matches measurements in the video (e.g. person segmentation,…

Computer Vision and Pattern Recognition · Computer Science 2017-12-06 Hsiao-Yu Fish Tung , Hsiao-Wei Tung , Ersin Yumer , Katerina Fragkiadaki

In this paper, we propose a Monocular 3D Single Stage object Detector (M3DSSD) with feature alignment and asymmetric non-local attention. Current anchor-based monocular 3D object detection methods suffer from feature mismatching. To…

Computer Vision and Pattern Recognition · Computer Science 2021-03-25 Shujie Luo , Hang Dai , Ling Shao , Yong Ding

Recent advances in self-supervised learning havedemonstrated that it is possible to learn accurate monoculardepth reconstruction from raw video data, without using any 3Dground truth for supervision. However, in robotics…

Computer Vision and Pattern Recognition · Computer Science 2020-04-14 Robert McCraith , Lukas Neumann , Andrew Zisserman , Andrea Vedaldi

Monocular depth inference has gained tremendous attention from researchers in recent years and remains as a promising replacement for expensive time-of-flight sensors, but issues with scale acquisition and implementation overhead still…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Kenny Chen , Alexandra Pogue , Brett T. Lopez , Ali-akbar Agha-mohammadi , Ankur Mehta

This paper introduces KeyDiff3D, a framework for unsupervised monocular 3D keypoints estimation that accurately predicts 3D keypoints from a single image. While previous methods rely on manual annotations or calibrated multi-view images,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 Subin Jeon , In Cho , Junyoung Hong , Seon Joo Kim

Monocular multi-object detection and localization in 3D space has been proven to be a challenging task. The MoNet3D algorithm is a novel and effective framework that can predict the 3D position of each object in a monocular image and draw a…

Computer Vision and Pattern Recognition · Computer Science 2020-06-30 Xichuan Zhou , Yicong Peng , Chunqiao Long , Fengbo Ren , Cong Shi

Detecting and localizing objects in the real 3D space, which plays a crucial role in scene understanding, is particularly challenging given only a single RGB image due to the geometric information loss during imagery projection. We propose…

Computer Vision and Pattern Recognition · Computer Science 2020-04-01 Zengyi Qin , Jinglu Wang , Yan Lu

Monocular 3D object detection aims to extract the 3D position and properties of objects from a 2D input image. This is an ill-posed problem with a major difficulty lying in the information loss by depth-agnostic cameras. Conventional…

Computer Vision and Pattern Recognition · Computer Science 2020-09-01 Lijie Liu , Chufan Wu , Jiwen Lu , Lingxi Xie , Jie Zhou , Qi Tian

We propose GeoNet, a jointly unsupervised learning framework for monocular depth, optical flow and ego-motion estimation from videos. The three components are coupled by the nature of 3D scene geometry, jointly learned by our framework in…

Computer Vision and Pattern Recognition · Computer Science 2018-03-13 Zhichao Yin , Jianping Shi

Autonomous driving perception tasks rely heavily on cameras as the primary sensor for Object Detection, Semantic Segmentation, Instance Segmentation, and Object Tracking. However, RGB images captured by cameras lack depth information, which…

Computer Vision and Pattern Recognition · Computer Science 2023-08-02 Marcelo Eduardo Pederiva , José Mario De Martino , Alessandro Zimmer

While expensive LiDAR and stereo camera rigs have enabled the development of successful 3D object detection methods, monocular RGB-only approaches lag much behind. This work advances the state of the art by introducing MoVi-3D, a novel,…

Computer Vision and Pattern Recognition · Computer Science 2020-04-03 Andrea Simonelli , Samuel Rota Bulò , Lorenzo Porzi , Elisa Ricci , Peter Kontschieder

This paper investigates the geometric consistency for monocular 3D object detection, which suffers from the ill-posed depth estimation. We first conduct a thorough analysis to reveal how existing methods fail to consistently localize…

Computer Vision and Pattern Recognition · Computer Science 2022-05-24 Qing Lian , Botao Ye , Ruijia Xu , Weilong Yao , Tong Zhang

Monocular 3D object detection is of great significance for autonomous driving but remains challenging. The core challenge is to predict the distance of objects in the absence of explicit depth information. Unlike regressing the distance as…

Computer Vision and Pattern Recognition · Computer Science 2022-06-30 Xuepeng Shi , Qi Ye , Xiaozhi Chen , Chuangrong Chen , Zhixiang Chen , Tae-Kyun Kim

Monocular cameras are one of the most commonly used sensors in the automotive industry for autonomous vehicles. One major drawback using a monocular camera is that it only makes observations in the two dimensional image plane and can not…

Computer Vision and Pattern Recognition · Computer Science 2018-02-28 Samuel Scheidegger , Joachim Benjaminsson , Emil Rosenberg , Amrit Krishnan , Karl Granstrom

Monocular 3D object detection is a crucial and challenging task for autonomous driving vehicle, while it uses only a single camera image to infer 3D objects in the scene. To address the difficulty of predicting depth using only pictorial…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Jia-Quan Yu , Soo-Chang Pei

We present MonoPSR, a monocular 3D object detection method that leverages proposals and shape reconstruction. First, using the fundamental relations of a pinhole camera model, detections from a mature 2D object detector are used to generate…

Computer Vision and Pattern Recognition · Computer Science 2019-04-04 Jason Ku , Alex D. Pon , Steven L. Waslander

Monocular 3D object detection (Mono3D) in mobile settings (e.g., on a vehicle, a drone, or a robot) is an important yet challenging task. Due to the near-far disparity phenomenon of monocular vision and the ever-changing camera pose, it is…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Yunsong Zhou , Quan Liu , Hongzi Zhu , Yunzhe Li , Shan Chang , Minyi Guo