English
Related papers

Related papers: MSMDFusion: Fusing LiDAR and Camera at Multiple Sc…

200 papers

Accurate and robust object detection is critical for autonomous driving. Image-based detectors face difficulties caused by low visibility in adverse weather conditions. Thus, radar-camera fusion is of particular interest but presents…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Huawei Sun , Hao Feng , Georg Stettinger , Lorenzo Servadei , Robert Wille

Multi-sensor fusion (MSF) is widely used in autonomous vehicles (AVs) for perception, particularly for 3D object detection with camera and LiDAR sensors. The purpose of fusion is to capitalize on the advantages of each modality while…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Zhiyuan Cheng , Hongjun Choi , James Liang , Shiwei Feng , Guanhong Tao , Dongfang Liu , Michael Zuzak , Xiangyu Zhang

In the field of autonomous driving, 3D object detection is a very important perception module. Although the current SOTA algorithm combines Camera and Lidar sensors, limited by the high price of Lidar, the current mainstream landing schemes…

Computer Vision and Pattern Recognition · Computer Science 2023-07-24 Kai Lei , Zhan Chen , Shuman Jia , Xiaoteng Zhang

While LiDAR sensors have been successfully applied to 3D object detection, the affordability of radar and camera sensors has led to a growing interest in fusing radars and cameras for 3D object detection. However, previous radar-camera…

Computer Vision and Pattern Recognition · Computer Science 2024-05-17 Jisong Kim , Minjae Seong , Geonho Bang , Dongsuk Kum , Jun Won Choi

The ability to accurately detect and localize objects is recognized as being the most important for the perception of self-driving cars. From 2D to 3D object detection, the most difficult is to determine the distance from the ego-vehicle to…

Computer Vision and Pattern Recognition · Computer Science 2021-05-31 Nguyen Anh Minh Mai , Pierre Duthon , Louahdi Khoudour , Alain Crouzil , Sergio A. Velastin

Multimodal 3D object detection based on deep neural networks has indeed made significant progress. However, it still faces challenges due to the misalignment of scale and spatial information between features extracted from 2D images and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Bonan Ding , Jin Xie , Jing Nie , Jiale Cao

In this paper, we focus on exploring the fusion of images and point clouds for 3D object detection in view of the complementary nature of the two modalities, i.e., images possess more semantic information while point clouds specialize in…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Ming Zhu , Chao Ma , Pan Ji , Xiaokang Yang

Accurate and robust 3D object detection is essential for autonomous driving, where fusing data from sensors like LiDAR and camera enhances detection accuracy. However, sensor malfunctions such as corruption or disconnection can degrade…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Reza Sadeghian , Niloofar Hooshyaripour , Chris Joslin , WonSook Lee

3D object detection with multi-sensors is essential for an accurate and reliable perception system of autonomous driving and robotics. Existing 3D detectors significantly improve the accuracy by adopting a two-stage paradigm which merely…

Computer Vision and Pattern Recognition · Computer Science 2022-09-23 Xinli Xu , Shaocong Dong , Lihe Ding , Jie Wang , Tingfa Xu , Jianan Li

In this paper, we present an extension to LaserNet, an efficient and state-of-the-art LiDAR based 3D object detector. We propose a method for fusing image data with the LiDAR data and show that this sensor fusion method improves the…

Computer Vision and Pattern Recognition · Computer Science 2019-04-26 Gregory P. Meyer , Jake Charland , Darshan Hegde , Ankit Laddha , Carlos Vallespi-Gonzalez

In this paper, we propose a new deep architecture for fusing camera and LiDAR sensors for 3D object detection. Because the camera and LiDAR sensor signals have different characteristics and distributions, fusing these two modalities is…

Computer Vision and Pattern Recognition · Computer Science 2020-12-10 Jin Hyeok Yoo , Yecheol Kim , Jisong Kim , Jun Won Choi

For 3D object detection, both camera and lidar have been demonstrated to be useful sensory devices for providing complementary information about the same scenery with data representations in different modalities, e.g., 2D RGB image vs 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-11-08 Xinhao Xiang , Jiawei Zhang

Reliable 3D object perception is essential in autonomous driving. Owing to its sensing capabilities in all weather conditions, 4D radar has recently received much attention. However, compared to LiDAR, 4D radar provides much sparser point…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Sheng Yang , Tong Zhan , Shichen Qiao , Jicheng Gong , Qing Yang , Jian Wang , Yanfeng Lu

Multi-sensor fusion is essential for an accurate and reliable autonomous driving system. Recent approaches are based on point-level fusion: augmenting the LiDAR point cloud with camera features. However, the camera-to-LiDAR projection…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Zhijian Liu , Haotian Tang , Alexander Amini , Xinyu Yang , Huizi Mao , Daniela Rus , Song Han

Leveraging multi-modal fusion, especially between camera and LiDAR, has become essential for building accurate and robust 3D object detection systems for autonomous vehicles. Until recently, point decorating approaches, in which point…

Computer Vision and Pattern Recognition · Computer Science 2023-04-28 Philip Jacobson , Yiyang Zhou , Wei Zhan , Masayoshi Tomizuka , Ming C. Wu

3D object detection is an important task that has been widely applied in autonomous driving. To perform this task, a new trend is to fuse multi-modal inputs, i.e., LiDAR and camera. Under such a trend, recent methods fuse these two…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Yang Song , Lin Wang

2D RGB images and 3D LIDAR point clouds provide complementary knowledge for the perception system of autonomous vehicles. Several 2D and 3D fusion methods have been explored for the LIDAR semantic segmentation task, but they suffer from…

Computer Vision and Pattern Recognition · Computer Science 2023-07-11 Jun Cen , Shiwei Zhang , Yixuan Pei , Kun Li , Hang Zheng , Maochun Luo , Yingya Zhang , Qifeng Chen

Automotive traffic scenes are complex due to the variety of possible scenarios, objects, and weather conditions that need to be handled. In contrast to more constrained environments, such as automated underground trains, automotive…

Computer Vision and Pattern Recognition · Computer Science 2021-06-29 Felix Nobis , Ehsan Shafiei , Phillip Karle , Johannes Betz , Markus Lienkamp

In this paper, we propose a novel approach to address the problem of camera and radar sensor fusion for 3D object detection in autonomous vehicle perception systems. Our approach builds on recent advances in deep learning and leverages the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Daniel Dworak , Mateusz Komorkiewicz , Paweł Skruch , Jerzy Baranowski

More and more research works fuse the LiDAR and camera information to improve the 3D object detection of the autonomous driving system. Recently, a simple yet effective fusion framework has achieved an excellent detection performance,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-11 Yun Zhao , Zhan Gong , Peiru Zheng , Hong Zhu , Shaohua Wu