English
Related papers

Related papers: SpaRC: Sparse Radar-Camera Fusion for 3D Object De…

200 papers

Integrating LiDAR and camera information in the bird's eye view (BEV) representation has demonstrated its effectiveness in 3D object detection. However, because of the fundamental disparity in geometric accuracy between these sensors,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Guowen Zhang , Chenhang He , Liyi Chen , Lei Zhang

Multi-sensor fusion is crucial for accurate 3D object detection in autonomous driving, with cameras and LiDAR being the most commonly used sensors. However, existing methods perform sensor fusion in a single view by projecting features from…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Rohit Mohan , Daniele Cattaneo , Florian Drews , Abhinav Valada

The integration of data from diverse sensor modalities (e.g., camera and LiDAR) constitutes a prevalent methodology within the ambit of autonomous driving scenarios. Recent advancements in efficient point cloud transformers have underscored…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Yutao Zhu , Xiaosong Jia , Xinyu Yang , Junchi Yan

The 4D Millimeter wave (mmWave) radar is a promising technology for vehicle sensing due to its cost-effectiveness and operability in adverse weather conditions. However, the adoption of this technology has been hindered by sparsity and…

Computer Vision and Pattern Recognition · Computer Science 2023-10-06 Jianan Liu , Qiuchi Zhao , Weiyi Xiong , Tao Huang , Qing-Long Han , Bing Zhu

Due to the trending need of building autonomous robotic perception system, sensor fusion has attracted a lot of attention amongst researchers and engineers to make best use of cross-modality information. However, in order to build a robotic…

Computer Vision and Pattern Recognition · Computer Science 2023-02-15 Apoorv Singh

Sensor fusion is crucial for an accurate and robust perception system on autonomous vehicles. Most existing datasets and perception solutions focus on fusing cameras and LiDAR. However, the collaboration between camera and radar is…

Computer Vision and Pattern Recognition · Computer Science 2023-11-20 Yizhou Wang , Jen-Hao Cheng , Jui-Te Huang , Sheng-Yao Kuan , Qiqian Fu , Chiming Ni , Shengyu Hao , Gaoang Wang , Guanbin Xing , Hui Liu , Jenq-Neng Hwang

With the rapid advancement of autonomous driving technology, there is a growing need for enhanced safety and efficiency in the automatic environmental perception of vehicles during their operation. In modern vehicle setups, cameras and…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Di Wu , Feng Yang , Benlian Xu , Pan Liao , Bo Liu

Multi-view radar-camera fused 3D object detection provides a farther detection range and more helpful features for autonomous driving, especially under adverse weather. The current radar-camera fusion methods deliver kinds of designs to…

Computer Vision and Pattern Recognition · Computer Science 2023-02-22 Zizhang Wu , Guilian Chen , Yuanzhu Gan , Lei Wang , Jian Pu

As one of the automotive sensors that have emerged in recent years, 4D millimeter-wave radar has a higher resolution than conventional 3D radar and provides precise elevation measurements. But its point clouds are still sparse and noisy,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Hongsi Liu , Jun Liu , Guangfeng Jiang , Xin Jin

Current LiDAR-only 3D detection methods inevitably suffer from the sparsity of point clouds. Many multi-modal methods are proposed to alleviate this issue, while different representations of images and point clouds make it difficult to fuse…

Computer Vision and Pattern Recognition · Computer Science 2022-07-05 Xiaopei Wu , Liang Peng , Honghui Yang , Liang Xie , Chenxi Huang , Chengqi Deng , Haifeng Liu , Deng Cai

Radars, due to their robustness to adverse weather conditions and ability to measure object motions, have served in autonomous driving and intelligent agents for years. However, Radar-based perception suffers from its unintuitive sensing…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Liu Liu , Shuaifeng Zhi , Zhenhua Du , Li Liu , Xinyu Zhang , Kai Huo , Weidong Jiang

There are two critical sensors for 3D perception in autonomous driving, the camera and the LiDAR. The camera provides rich semantic information such as color, texture, and the LiDAR reflects the 3D shape and locations of surrounding…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Kaicheng Yu , Tang Tao , Hongwei Xie , Zhiwei Lin , Zhongwei Wu , Zhongyu Xia , Tingting Liang , Haiyang Sun , Jiong Deng , Dayang Hao , Yongtao Wang , Xiaodan Liang , Bing Wang

LiDAR-camera fusion is one of the core processes for the perception system of current automated driving systems. The typical sensor fusion process includes a list of coordinate transformation operations following system calibration.…

Robotics · Computer Science 2023-11-09 Dan Shen , Zhengming Zhang , Renran Tian , Yaobin Chen , Rini Sherony

In the field of autonomous driving, 3D object detection is a very important perception module. Although the current SOTA algorithm combines Camera and Lidar sensors, limited by the high price of Lidar, the current mainstream landing schemes…

Computer Vision and Pattern Recognition · Computer Science 2023-07-24 Kai Lei , Zhan Chen , Shuman Jia , Xiaoteng Zhang

Cooperative perception can increase the view field and decrease the occlusion of an ego vehicle, hence improving the perception performance and safety of autonomous driving. Despite the success of previous works on cooperative object…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Yunshuang Yuan , Yan Xia , Daniel Cremers , Monika Sester

Two major challenges of 3D LiDAR Panoptic Segmentation (PS) are that point clouds of an object are surface-aggregated and thus hard to model the long-range dependency especially for large instances, and that objects are too close to…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Shuangjie Xu , Rui Wan , Maosheng Ye , Xiaoyi Zou , Tongyi Cao

Understanding how different AI models encode the same high-level concepts, such as objects or attributes, remains challenging because each model typically produces its own isolated representation. Existing interpretability methods like…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Ali Nasiri-Sarvi , Hassan Rivaz , Mahdi S. Hosseini

Perceiving the surrounding environment is a fundamental task in autonomous driving. To obtain highly accurate perception results, modern autonomous driving systems typically employ multi-modal sensors to collect comprehensive environmental…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Zhiwei Lin , Zhe Liu , Yongtao Wang , Le Zhang , Ce Zhu

In the perception task of autonomous driving, multi-modal methods have become a trend due to the complementary characteristics of LiDAR point clouds and image data. However, the performance of multi-modal methods is usually limited by the…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Binglu Ren , Jianqin Yin

The perception system in autonomous vehicles is responsible for detecting and tracking the surrounding objects. This is usually done by taking advantage of several sensing modalities to increase robustness and accuracy, which makes sensor…

Computer Vision and Pattern Recognition · Computer Science 2021-01-07 Ramin Nabati , Hairong Qi