English
Related papers

Related papers: Towards Unified 3D Object Detection via Algorithm …

200 papers

This paper presents Multi-view Labelling Object Detector (MLOD). The detector takes an RGB image and a LIDAR point cloud as input and follows the two-stage object detection framework. A Region Proposal Network (RPN) generates 3D proposals…

Computer Vision and Pattern Recognition · Computer Science 2019-09-11 Jian Deng , Krzysztof Czarnecki

Multimodal sensor fusion has demonstrated remarkable performance improvements over unimodal approaches in 3D object detection for autonomous vehicles. Typically, existing methods transform multimodal data from independent sensors, such as…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Markus Essl , Marta Moscati , Mubashir Noman , Muhammad Zaigham Zaheer , Usman Naseem , Shah Nawaz , Markus Schedl

In this paper, we present BEVerse, a unified framework for 3D perception and prediction based on multi-camera systems. Unlike existing studies focusing on the improvement of single-task approaches, BEVerse features in producing…

Computer Vision and Pattern Recognition · Computer Science 2022-05-20 Yunpeng Zhang , Zheng Zhu , Wenzhao Zheng , Junjie Huang , Guan Huang , Jie Zhou , Jiwen Lu

Conventional human trajectory prediction models rely on clean curated data, requiring specialized equipment or manual labeling, which is often impractical for robotic applications. The existing predictors tend to overfit to clean…

Computer Vision and Pattern Recognition · Computer Science 2025-03-06 Po-Chien Luan , Yang Gao , Celine Demonsant , Alexandre Alahi

More and more research works fuse the LiDAR and camera information to improve the 3D object detection of the autonomous driving system. Recently, a simple yet effective fusion framework has achieved an excellent detection performance,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-11 Yun Zhao , Zhan Gong , Peiru Zheng , Hong Zhu , Shaohua Wu

Recently, Bird's-Eye-View (BEV) representation has gained increasing attention in multi-view 3D object detection, which has demonstrated promising applications in autonomous driving. Although multi-view camera systems can be deployed at low…

Computer Vision and Pattern Recognition · Computer Science 2022-12-02 Jianing Li , Ming Lu , Jiaming Liu , Yandong Guo , Li Du , Shanghang Zhang

Monocular 3D object detection is valuable for various applications such as robotics and AR/VR. Existing methods are confined to closed-set settings, where the training and testing sets consist of the same scenes and/or object categories.…

Computer Vision and Pattern Recognition · Computer Science 2025-09-08 Yung-Hsu Yang , Luigi Piccinelli , Mattia Segu , Siyuan Li , Rui Huang , Yuqian Fu , Marc Pollefeys , Hermann Blum , Zuria Bauer

The detection of 3D objects through a single perspective camera is a challenging issue. The anchor-free and keypoint-based models receive increasing attention recently due to their effectiveness and simplicity. However, most of these…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Wei Chen , Jie Zhao , Wan-Lei Zhao , Song-Yuan Wu

Bird's-Eye View (BEV) features are popular intermediate scene representations shared by the 3D backbone and the detector head in LiDAR-based object detectors. However, little research has been done to investigate how to incorporate…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Haitao Yang , Zaiwei Zhang , Xiangru Huang , Min Bai , Chen Song , Bo Sun , Li Erran Li , Qixing Huang

Multi-view 3D object detection is becoming popular in autonomous driving due to its high effectiveness and low cost. Most of the current state-of-the-art detectors follow the query-based bird's-eye-view (BEV) paradigm, which benefits from…

Computer Vision and Pattern Recognition · Computer Science 2023-06-05 Zhangyang Qi , Jiaqi Wang , Xiaoyang Wu , Hengshuang Zhao

Environmental perception with the multi-modal fusion of radar and camera is crucial in autonomous driving to increase accuracy, completeness, and robustness. This paper focuses on utilizing millimeter-wave (MMW) radar and camera sensor…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Taohua Zhou , Yining Shi , Junjie Chen , Kun Jiang , Mengmeng Yang , Diange Yang

Integrating LiDAR and Camera information into Bird's-Eye-View (BEV) has become an essential topic for 3D object detection in autonomous driving. Existing methods mostly adopt an independent dual-branch framework to generate LiDAR and camera…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Hongxiang Cai , Zeyuan Zhang , Zhenyu Zhou , Ziyin Li , Wenbo Ding , Jiuhua Zhao

Monocular 3D object detection (M3OD) is a significant yet inherently challenging task in autonomous driving due to absence of explicit depth cues in a single RGB image. In this paper, we strive to boost currently underperforming monocular…

Computer Vision and Pattern Recognition · Computer Science 2023-11-08 Weijia Zhang , Dongnan Liu , Chao Ma , Weidong Cai

Three-dimensional object detection is one of the key tasks in autonomous driving. To reduce costs in practice, low-cost multi-view cameras for 3D object detection are proposed to replace the expansive LiDAR sensors. However, relying solely…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Zhiwei Lin , Zhe Liu , Zhongyu Xia , Xinhao Wang , Yongtao Wang , Shengxiang Qi , Yang Dong , Nan Dong , Le Zhang , Ce Zhu

3D object detection from visual sensors is a cornerstone capability of robotic systems. State-of-the-art methods focus on reasoning and decoding object bounding boxes from multi-view camera input. In this work we gain intuition from the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-10 Dian Chen , Jie Li , Vitor Guizilini , Rares Ambrus , Adrien Gaidon

As a crucial task of autonomous driving, 3D object detection has made great progress in recent years. However, monocular 3D object detection remains a challenging problem due to the unsatisfactory performance in depth estimation. Most…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Yinmin Zhang , Xinzhu Ma , Shuai Yi , Jun Hou , Zhihui Wang , Wanli Ouyang , Dan Xu

Accurate, fast, and reliable 3D perception is essential for autonomous driving. Recently, bird's-eye view (BEV)-based perception approaches have emerged as superior alternatives to perspective-based solutions, offering enhanced spatial…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Ozsel Kilinc , Cem Tarhan

Monocular 3D object detection aims to predict the object location, dimension and orientation in 3D space alongside the object category given only a monocular image. It poses a great challenge due to its ill-posed property which is…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Zheyuan Zhou , Liang Du , Xiaoqing Ye , Zhikang Zou , Xiao Tan , Li Zhang , Xiangyang Xue , Jianfeng Feng

Simultaneous perception of 2D objects in perspective view and 3D objects in Bird's Eye View (BEV) is challenging for multi-camera autonomous driving. Existing two-stage pipelines use 2D results only as a one-time cue for 3D detection. We…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Yingqi Tang , Zhaotie Meng , Erkang Cheng , Haibin Ling

3D object detection algorithms for autonomous driving reason about 3D obstacles either from 3D birds-eye view or perspective view or both. Recent works attempt to improve the detection performance via mining and fusing from multiple…

Computer Vision and Pattern Recognition · Computer Science 2021-03-25 Liang Xie , Guodong Xu , Deng Cai , Xiaofei He