English
Related papers

Related papers: Monocular Differentiable Rendering for Self-Superv…

200 papers

Self-supervised monocular depth estimation approaches either ignore independently moving objects in the scene or need a separate segmentation step to identify them. We propose MonoDepthSeg to jointly estimate depth and segment moving…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Sadra Safadoust , Fatma Güney

This paper aims to design a 3D object detection model from 2D images taken by monocular cameras by combining the estimated bird's-eye view elevation map and the deep representation of object features. The proposed model has a pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2020-11-25 Ali Babolhavaeji , Mohammad Fanaei

In this paper we propose a novel 3D single-shot object detection method for detecting vehicles in monocular RGB images. Our approach lifts 2D detections to 3D space by predicting additional regression and classification parameters and hence…

Computer Vision and Pattern Recognition · Computer Science 2020-06-24 Nils Gählert , Jun-Jun Wan , Nicolas Jourdan , Jan Finkbeiner , Uwe Franke , Joachim Denzler

In this paper, we propose to learn a deep fitting degree scoring network for monocular 3D object detection, which aims to score fitting degree between proposals and object conclusively. Different from most existing monocular frameworks…

Computer Vision and Pattern Recognition · Computer Science 2019-06-11 Lijie Liu , Jiwen Lu , Chunjing Xu , Qi Tian , Jie Zhou

This paper reports a new continuous 3D loss function for learning depth from monocular images. The dense depth prediction from a monocular image is supervised using sparse LIDAR points, which enables us to leverage available open source…

Computer Vision and Pattern Recognition · Computer Science 2020-08-11 Minghan Zhu , Maani Ghaffari , Yuanxin Zhong , Pingping Lu , Zhong Cao , Ryan M. Eustice , Huei Peng

While DETR-like architectures have demonstrated significant potential for monocular 3D object detection, they are often hindered by a critical limitation: the exclusion of 3D attributes from the bipartite matching process. This exclusion…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Kiet Dang Vu , Trung Thai Tran , Kien Nguyen Do Trung , Duc Dung Nguyen

We propose Differentiable Stereopsis, a multi-view stereo approach that reconstructs shape and texture from few input views and noisy cameras. We pair traditional stereopsis and modern differentiable rendering to build an end-to-end model…

Computer Vision and Pattern Recognition · Computer Science 2022-09-27 Shubham Goel , Georgia Gkioxari , Jitendra Malik

Reliable perception of the environment plays a crucial role in enabling efficient self-driving vehicles. Therefore, the perception system necessitates the acquisition of comprehensive 3D data regarding the surrounding objects within a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Ahmed El-Dawy , Amr El-Zawawi , Mohamed El-Habrouk

3D object detection from monocular image(s) is a challenging and long-standing problem of computer vision. To combine information from different perspectives without troublesome 2D instance tracking, recent methods tend to aggregate…

Computer Vision and Pattern Recognition · Computer Science 2022-09-01 Jianlin Liu , Zhuofei Huang , Dihe Huang , Shang Xu , Ying Chen , Yong Liu

Self-supervised deep learning methods have leveraged stereo images for training monocular depth estimation. Although these methods show strong results on outdoor datasets such as KITTI, they do not match performance of supervised methods on…

Computer Vision and Pattern Recognition · Computer Science 2021-06-28 Benjamin Keltjens , Tom van Dijk , Guido de Croon

Monocular 3D object detection (M3OD) is a significant yet inherently challenging task in autonomous driving due to absence of explicit depth cues in a single RGB image. In this paper, we strive to boost currently underperforming monocular…

Computer Vision and Pattern Recognition · Computer Science 2023-11-08 Weijia Zhang , Dongnan Liu , Chao Ma , Weidong Cai

We present a method for single image 3D cuboid object detection and multi-view object SLAM in both static and dynamic environments, and demonstrate that the two parts can improve each other. Firstly for single image object detection, we…

Robotics · Computer Science 2019-04-08 Shichao Yang , Sebastian Scherer

Estimating 3D bounding boxes from monocular images is an essential component in autonomous driving, while accurate 3D object detection from this kind of data is very challenging. In this work, by intensive diagnosis experiments, we quantify…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Xinzhu Ma , Yinmin Zhang , Dan Xu , Dongzhan Zhou , Shuai Yi , Haojie Li , Wanli Ouyang

The main challenge of monocular 3D object detection is the accurate localization of 3D center. Motivated by a new and strong observation that this challenge can be remedied by a 3D-space local-grid search scheme in an ideal case, we propose…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Xianpeng Liu , Ce Zheng , Kelvin Cheng , Nan Xue , Guo-Jun Qi , Tianfu Wu

Monocular 3D object detection has vast application potential across various fields. DETR-type models have shown remarkable performance in different areas, but there is still considerable room for improvement in monocular 3D detection,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Pan Liao , Feng Yang , Di Wu , Wenhui Zhao , Jinwen Yu

Monocular 3D object detection aims to localize 3D bounding boxes in an input single 2D image. It is a highly challenging problem and remains open, especially when no extra information (e.g., depth, lidar and/or multi-frames) can be…

Computer Vision and Pattern Recognition · Computer Science 2021-12-10 Xianpeng Liu , Nan Xue , Tianfu Wu

Low-cost autonomous agents including autonomous driving vehicles chiefly adopt monocular 3D object detection to perceive surrounding environment. This paper studies 3D intermediate representation methods which generate intermediate 3D…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Qian Ye , Ling Jiang , Wang Zhen , Yuyang Du

Monocular 3D object detection is a fundamental but very important task to many applications including autonomous driving, robotic grasping and augmented reality. Existing leading methods tend to estimate the depth of the input image first,…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Han Sun , Zhaoxin Fan , Zhenbo Song , Zhicheng Wang , Kejian Wu , Jianfeng Lu

Depth estimation is usually ill-posed and ambiguous for monocular camera-based 3D multi-person pose estimation. Since LiDAR can capture accurate depth information in long-range scenes, it can benefit both the global localization of…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Peishan Cong , Yiteng Xu , Yiming Ren , Juze Zhang , Lan Xu , Jingya Wang , Jingyi Yu , Yuexin Ma

The advent of autonomous driving and advanced driver assistance systems necessitates continuous developments in computer vision for 3D scene understanding. Self-supervised monocular depth estimation, a method for pixel-wise distance…

Computer Vision and Pattern Recognition · Computer Science 2023-02-03 Arnav Varma , Hemang Chawla , Bahram Zonooz , Elahe Arani