English
Related papers

Related papers: BEVDilation: LiDAR-Centric Multi-Modal Fusion for …

200 papers

This paper presents Multi-view Labelling Object Detector (MLOD). The detector takes an RGB image and a LIDAR point cloud as input and follows the two-stage object detection framework. A Region Proposal Network (RPN) generates 3D proposals…

Computer Vision and Pattern Recognition · Computer Science 2019-09-11 Jian Deng , Krzysztof Czarnecki

Semantic scene segmentation from a bird's-eye-view (BEV) perspective plays a crucial role in facilitating planning and decision-making for mobile robots. Although recent vision-only methods have demonstrated notable advancements in…

Accurate 3D object detection is essential for automated vehicles to navigate safely in complex real-world environments. Bird's Eye View (BEV) representations, which project multi-sensor data into a top-down spatial format, have emerged as a…

Computer Vision and Pattern Recognition · Computer Science 2025-11-07 Sanjay Kumar , Tim Brophy , Eoin Martino Grua , Ganesh Sistu , Valentina Donzella , Ciaran Eising

Multi-modal sensor fusion in Bird's Eye View (BEV) representation has become the leading approach for 3D object detection. However, existing methods often rely on depth estimators or transformer encoders to transform image features into BEV…

Computer Vision and Pattern Recognition · Computer Science 2025-07-14 Yongjin Lee , Hyeon-Mun Jeong , Yurim Jeon , Sanghyun Kim

Recently, Bird's-Eye-View (BEV) representation has gained increasing attention in multi-view 3D object detection, which has demonstrated promising applications in autonomous driving. Although multi-view camera systems can be deployed at low…

Computer Vision and Pattern Recognition · Computer Science 2022-12-02 Jianing Li , Ming Lu , Jiaming Liu , Yandong Guo , Li Du , Shanghang Zhang

Fusing LiDAR and camera information is essential for achieving accurate and reliable 3D object detection in autonomous driving systems. This is challenging due to the difficulty of combining multi-granularity geometric and semantic features…

Computer Vision and Pattern Recognition · Computer Science 2023-03-06 Yang Jiao , Zequn Jie , Shaoxiang Chen , Jingjing Chen , Lin Ma , Yu-Gang Jiang

This paper investigates the advantages of using Bird's Eye View (BEV) representation in 360-degree visual place recognition (VPR). We propose a novel network architecture that utilizes the BEV representation in feature extraction, feature…

Computer Vision and Pattern Recognition · Computer Science 2023-05-24 Xuecheng Xu , Yanmei Jiao , Sha Lu , Xiaqing Ding , Rong Xiong , Yue Wang

Recently, camera-radar fusion-based 3D object detection methods in bird's eye view (BEV) have gained attention due to the complementary characteristics and cost-effectiveness of these sensors. Previous approaches using forward projection…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 In-Jae Lee , Sihwan Hwang , Youngseok Kim , Wonjune Kim , Sanmin Kim , Dongsuk Kum

Fusing data from cameras and LiDAR sensors is an essential technique to achieve robust 3D object detection. One key challenge in camera-LiDAR fusion involves mitigating the large domain gap between the two sensors in terms of coordinates…

Computer Vision and Pattern Recognition · Computer Science 2023-02-17 Yecheol Kim , Konyul Park , Minwook Kim , Dongsuk Kum , Jun Won Choi

Environmental perception with the multi-modal fusion of radar and camera is crucial in autonomous driving to increase accuracy, completeness, and robustness. This paper focuses on utilizing millimeter-wave (MMW) radar and camera sensor…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Taohua Zhou , Yining Shi , Junjie Chen , Kun Jiang , Mengmeng Yang , Diange Yang

Vision-based roadside 3D object detection has attracted rising attention in autonomous driving domain, since it encompasses inherent advantages in reducing blind spots and expanding perception range. While previous work mainly focuses on…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Wenjie Wang , Yehao Lu , Guangcong Zheng , Shuigen Zhan , Xiaoqing Ye , Zichang Tan , Jingdong Wang , Gaoang Wang , Xi Li

We propose DeepFusion, a modular multi-modal architecture to fuse lidars, cameras and radars in different combinations for 3D object detection. Specialized feature extractors take advantage of each modality and can be exchanged easily,…

Computer Vision and Pattern Recognition · Computer Science 2022-09-28 Florian Drews , Di Feng , Florian Faion , Lars Rosenbaum , Michael Ulrich , Claudius Gläser

Multi-view 3D detection with bird's eye view (BEV) is crucial for autonomous driving and robotics, but its robustness in real-world is limited as it struggles to predict accurate depth values. A mainstream solution, cross-modal…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Rui Ding , Zhaonian Kuang , Zongwei Zhou , Meng Yang , Xinhu Zheng , Gang Hua

Existing LiDAR-Camera fusion methods have achieved strong results in 3D object detection. To address the sparsity of point clouds, previous approaches typically construct spatial pseudo point clouds via depth completion as auxiliary input…

Computer Vision and Pattern Recognition · Computer Science 2025-08-28 Jijun Wang , Yan Wu , Yujian Mo , Junqiao Zhao , Jun Yan , Yinghao Hu

Recently, LSS-based multi-view 3D object detection provides an economical and deployment-friendly solution for autonomous driving. However, all the existing LSS-based methods transform multi-view image features into a Cartesian…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Zichen Yu , Quanli Liu , Wei Wang , Liyong Zhang , Xiaoguang Zhao

Combining LiDAR and Camera-view data has become a common approach for 3D Object Detection. However, previous approaches combine the two input streams at a point-level, throwing away semantic information derived from camera features. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-10-17 Pranav Gupta , Rishabh Rengarajan , Viren Bankapur , Vedansh Mannem , Lakshit Ahuja , Surya Vijay , Kevin Wang

To achieve accurate and low-cost 3D object detection, existing methods propose to benefit camera-based multi-view detectors with spatial cues provided by the LiDAR modality, e.g., dense depth supervision and bird-eye-view (BEV) feature…

Computer Vision and Pattern Recognition · Computer Science 2022-12-29 Peixiang Huang , Li Liu , Renrui Zhang , Song Zhang , Xinli Xu , Baichao Wang , Guoyi Liu

Due to the trending need of building autonomous robotic perception system, sensor fusion has attracted a lot of attention amongst researchers and engineers to make best use of cross-modality information. However, in order to build a robotic…

Computer Vision and Pattern Recognition · Computer Science 2023-02-15 Apoorv Singh

Camera-radar fusion offers a robust and low-cost alternative to Camera-lidar fusion for the 3D object detection task in real-time under adverse weather and lighting conditions. However, currently, in the literature, it is possible to find…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Ruan Bispo , Dane Mitrev , Letizia Mariotti , Clément Botty , Denver Humphrey , Anthony Scanlan , Ciarán Eising

Accurate and robust 3D object detection is essential for autonomous driving, where fusing data from sensors like LiDAR and camera enhances detection accuracy. However, sensor malfunctions such as corruption or disconnection can degrade…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Reza Sadeghian , Niloofar Hooshyaripour , Chris Joslin , WonSook Lee