English
Related papers

Related papers: BEVFusion: A Simple and Robust LiDAR-Camera Fusion…

200 papers

Fusing Radar and Lidar sensor data can fully utilize their complementary advantages and provide more accurate reconstruction of the surrounding for autonomous driving systems. Surround Radar/Lidar can provide 360-degree view sampling with…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Wenjing Xie , Tao Hu , Neiwen Ling , Guoliang Xing , Chun Jason Xue , Nan Guan

By identifying four important components of existing LiDAR-camera 3D object detection methods (LiDAR and camera candidates, transformation, and fusion outputs), we observe that all existing methods either find dense candidates or yield…

Computer Vision and Pattern Recognition · Computer Science 2023-04-28 Yichen Xie , Chenfeng Xu , Marie-Julie Rakotosaona , Patrick Rim , Federico Tombari , Kurt Keutzer , Masayoshi Tomizuka , Wei Zhan

In this paper, we study the problem of jointly estimating the optical flow and scene flow from synchronized 2D and 3D data. Previous methods either employ a complex pipeline that splits the joint task into independent stages, or fuse 2D and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Haisong Liu , Tao Lu , Yihui Xu , Jia Liu , Limin Wang

The ability to accurately detect and localize objects is recognized as being the most important for the perception of self-driving cars. From 2D to 3D object detection, the most difficult is to determine the distance from the ego-vehicle to…

Computer Vision and Pattern Recognition · Computer Science 2021-05-31 Nguyen Anh Minh Mai , Pierre Duthon , Louahdi Khoudour , Alain Crouzil , Sergio A. Velastin

3D object detection based on LiDAR point clouds is a crucial module in autonomous driving particularly for long range sensing. Most of the research is focused on achieving higher accuracy and these models are not optimized for deployment on…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Sambit Mohapatra , Senthil Yogamani , Heinrich Gotzig , Stefan Milz , Patrick Mader

Vehicle object detection benefits from both LiDAR and camera data, with LiDAR offering superior performance in many scenarios. Fusion of these modalities further enhances accuracy, but existing methods often introduce complexity or…

Computer Vision and Pattern Recognition · Computer Science 2025-02-21 Vanshika Vats , Marzia Binta Nizam , James Davis

Camera and LiDAR serve as informative sensors for accurate and robust autonomous driving systems. However, these sensors often exhibit heterogeneous natures, resulting in distributional modality gaps that present significant challenges for…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Yiran Yang , Xu Gao , Tong Wang , Xin Hao , Yifeng Shi , Xiao Tan , Xiaoqing Ye , Jingdong Wang

Multi-sensor fusion-based road segmentation plays an important role in the intelligent driving system since it provides a drivable area. The existing mainstream fusion method is mainly to feature fusion in the image space domain which…

Computer Vision and Pattern Recognition · Computer Science 2020-04-21 Haoran Li , Yaran Chen , Qichao Zhang , Dongbin Zhao

As one of the automotive sensors that have emerged in recent years, 4D millimeter-wave radar has a higher resolution than conventional 3D radar and provides precise elevation measurements. But its point clouds are still sparse and noisy,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Hongsi Liu , Jun Liu , Guangfeng Jiang , Xin Jin

An automated vehicle operating in an urban environment must be able to perceive and recognise object/obstacles in a three-dimensional world while navigating in a constantly changing environment. In order to plan and execute accurate…

Computer Vision and Pattern Recognition · Computer Science 2020-07-13 Julie Stephany Berrio , Mao Shan , Stewart Worrall , Eduardo Nebot

Recent advances in 4D imaging radar have enabled robust perception in adverse weather, while camera sensors provide dense semantic information. Fusing the these complementary modalities has great potential for cost-effective 3D perception.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Xiaozhi Li , Huijun Di , Jian Li , Feng Liu , Wei Liang

The fusion of LiDARs and cameras has been increasingly adopted in autonomous driving for perception tasks. The performance of such fusion-based algorithms largely depends on the accuracy of sensor calibration, which is challenging due to…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Yuxuan Xiao , Yao Li , Chengzhen Meng , Xingchen Li , Jianmin Ji , Yanyong Zhang

Multi-modal systems enhance performance in autonomous driving but face inefficiencies due to indiscriminate processing within each modality. Additionally, the independent feature learning of each modality lacks interaction, which results in…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Guoliang You , Xiaomeng Chu , Yifan Duan , Xingchen Li , Sha Zhang , Jianmin Ji , Yanyong Zhang

Existing LiDAR-based 3D object detectors typically rely on manually annotated labels for training to achieve good performance. However, obtaining high-quality 3D labels is time-consuming and labor-intensive. To address this issue, recent…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Mingqian Ji , Jian Yang , Shanshan Zhang

LiDAR scene flow is the task of estimating per-point 3D motion between consecutive point clouds. Recent methods achieve centimeter-level accuracy on popular autonomous vehicle (AV) datasets, but are typically only trained and evaluated on a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Siyi Li , Qingwen Zhang , Ishan Khatri , Kyle Vedder , Eric Eaton , Deva Ramanan , Neehar Peri

Although multiview fusion has demonstrated potential in LiDAR segmentation, its dependence on computationally intensive point-based interactions, arising from the lack of fixed correspondences between views such as range view and Bird's-Eye…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Shoumeng Qiu , Xinrun Li , XiangYang Xue , Jian Pu

Radar and LiDAR have been widely used in autonomous driving as LiDAR provides rich structure information, and radar demonstrates high robustness under adverse weather. Recent studies highlight the effectiveness of fusing radar and LiDAR…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Xiangyuan Peng , Huawei Sun , Kay Bierzynski , Anton Fischbacher , Lorenzo Servadei , Robert Wille

Accurate 3D object detection in autonomous driving is critical yet challenging due to occlusions, varying object sizes, and complex urban environments. This paper introduces the KAN-RCBEVDepth method, an innovative approach aimed at…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Zhihao Lai , Chuanhao Liu , Shihui Sheng , Zhiqiang Zhang

Robust road segmentation is a key challenge in self-driving research. Though many image-based methods have been studied and high performances in dataset evaluations have been reported, developing robust and reliable road segmentation is…

Computer Vision and Pattern Recognition · Computer Science 2019-05-29 Huafeng Liu , Yazhou Yao , Zeren Sun , Xiangrui Li , Ke Jia , Zhenmin Tang

Point-pixel registration between LiDAR point clouds and camera images is a fundamental yet challenging task in autonomous driving and robotic perception. A key difficulty lies in the modality gap between unstructured point clouds and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Yu Han , Zhiwei Huang , Yanting Zhang , Fangjun Ding , Shen Cai , Rui Fan