English
Related papers

Related papers: Radar-Camera Sensor Fusion for Joint Object Detect…

200 papers

Accurately localizing 3D objects like pedestrians, cyclists, and other vehicles is essential in Autonomous Driving. To ensure high detection performance, Autonomous Vehicles complement RGB cameras with LiDAR sensors, but effectively…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Carlo Sgaravatti , Riccardo Pieroni , Matteo Corno , Sergio M. Savaresi , Luca Magri , Giacomo Boracchi

The growing urban complexity demands an efficient algorithm to acquire and process various sensor information from autonomous vehicles. In this paper, we introduce an algorithm to utilize object detection results from the image to…

Computer Vision and Pattern Recognition · Computer Science 2021-03-02 Madhumitha Sakthi , Ahmed Tewfik

This paper presents an algorithm for indoor layout estimation and reconstruction through the fusion of a sequence of captured images and LiDAR data sets. In the proposed system, a movable platform collects both intensity images and 2D LiDAR…

Computer Vision and Pattern Recognition · Computer Science 2020-01-16 Jieyu Li , Robert L Stevenson

In this work, a deep learning approach has been developed to carry out road detection by fusing LIDAR point clouds and camera images. An unstructured and sparse point cloud is first projected onto the camera image plane and then upsampled…

Computer Vision and Pattern Recognition · Computer Science 2018-09-24 Luca Caltagirone , Mauro Bellone , Lennart Svensson , Mattias Wahde

Radar is ubiquitous in autonomous driving systems due to its low cost and good adaptability to bad weather. Nevertheless, the radar detection performance is usually inferior because its point cloud is sparse and not accurate due to the poor…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Yang Liu , Feng Wang , Naiyan Wang , Zhaoxiang Zhang

Object detection through either RGB images or the LiDAR point clouds has been extensively explored in autonomous driving. However, it remains challenging to make these two data sources complementary and beneficial to each other. In this…

Computer Vision and Pattern Recognition · Computer Science 2022-04-22 Zehui Chen , Zhenyu Li , Shiquan Zhang , Liangji Fang , Qinghong Jiang , Feng Zhao , Bolei Zhou , Hang Zhao

LiDAR and Radar are two complementary sensing approaches in that LiDAR specializes in capturing an object's 3D shape while Radar provides longer detection ranges as well as velocity hints. Though seemingly natural, how to efficiently…

Computer Vision and Pattern Recognition · Computer Science 2023-06-05 Yingjie Wang , Jiajun Deng , Yao Li , Jinshui Hu , Cong Liu , Yu Zhang , Jianmin Ji , Wanli Ouyang , Yanyong Zhang

In this paper, we propose PointRCNN for 3D object detection from raw point cloud. The whole framework is composed of two stages: stage-1 for the bottom-up 3D proposal generation and stage-2 for refining proposals in the canonical…

Computer Vision and Pattern Recognition · Computer Science 2019-05-17 Shaoshuai Shi , Xiaogang Wang , Hongsheng Li

In this paper, we present a Transformer-based architecture for 3D radar object detection that uses a novel Transformer Decoder as the prediction head to directly regress 3D bounding boxes and class scores from radar feature representations.…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Changxu Zhang , Zhaoze Wang , Tai Fei , Christopher Grimm , Yi Jin , Claas Tebruegge , Ernst Warsitz , Markus Gardill

Multimodal sensor fusion methods for 3D object detection have been revolutionizing the autonomous driving research field. Nevertheless, most of these methods heavily rely on dense LiDAR data and accurately calibrated sensors which is often…

Robotics · Computer Science 2023-06-14 Maciej K. Wozniak , Viktor Karefjards , Marko Thiel , Patric Jensfelt

Service mobile robots are often required to avoid dynamic objects while performing their tasks, but they usually have only limited computational resources. To further advance the practical application of service robots in complex dynamic…

Robotics · Computer Science 2026-02-25 Yushen He , Lei Zhao , Tianchen Deng , Zipeng Fang , Weidong Chen

Vision-based autonomous driving requires reliable and efficient object detection. This work proposes a DiffusionDet-based framework that exploits data fusion from the monocular camera and depth sensor to provide the RGB and depth (RGB-D)…

Computer Vision and Pattern Recognition · Computer Science 2024-06-06 Eliraz Orfaig , Inna Stainvas , Igal Bilik

While recent low-cost radar-camera approaches have shown promising results in multi-modal 3D object detection, both sensors face challenges from environmental and intrinsic disturbances. Poor lighting or adverse weather conditions degrade…

Computer Vision and Pattern Recognition · Computer Science 2025-02-19 Jingtong Yue , Zhiwei Lin , Xin Lin , Xiaoyu Zhou , Xiangtai Li , Lu Qi , Yongtao Wang , Ming-Hsuan Yang

4D radars, which provide 3D point cloud data along with Doppler velocity, are attractive components of modern automated driving systems due to their low cost and robustness under adverse weather conditions. However, they provide a…

Robotics · Computer Science 2026-03-13 Siqi Pei , Andras Palffy , Dariu M. Gavrila

In this paper, we present LiRaNet, a novel end-to-end trajectory prediction method which utilizes radar sensor information along with widely used lidar and high definition (HD) maps. Automotive radar provides rich, complementary…

Computer Vision and Pattern Recognition · Computer Science 2020-11-16 Meet Shah , Zhiling Huang , Ankit Laddha , Matthew Langford , Blake Barber , Sidney Zhang , Carlos Vallespi-Gonzalez , Raquel Urtasun

Multi-object tracking (MOT) with camera-LiDAR fusion demands accurate results of object detection, affinity computation and data association in real time. This paper presents an efficient multi-modal MOT framework with online joint…

Computer Vision and Pattern Recognition · Computer Science 2021-08-11 Kemiao Huang , Qi Hao

As an emerging technology and a relatively affordable device, the 4D imaging radar has already been confirmed effective in performing 3D object detection in autonomous driving. Nevertheless, the sparsity and noisiness of 4D radar point…

Computer Vision and Pattern Recognition · Computer Science 2023-10-04 Weiyi Xiong , Jianan Liu , Tao Huang , Qing-Long Han , Yuxuan Xia , Bing Zhu

Recent developments and the beginning market introduction of high-resolution imaging 4D (3+1D) radar sensors have initialized deep learning-based radar perception research. We investigate deep learning-based models operating on radar point…

Robotics · Computer Science 2023-08-11 Patrick Palmer , Martin Krueger , Richard Altendorfer , Ganesh Adam , Torsten Bertram

Visual Odometry (VO) estimation is an important source of information for vehicle state estimation and autonomous driving. Recently, deep learning based approaches have begun to appear in the literature. However, in the context of driving,…

Computer Vision and Pattern Recognition · Computer Science 2021-12-28 Nimet Kaygusuz , Oscar Mendez , Richard Bowden

Place recognition is one of the most crucial modules for autonomous vehicles to identify places that were previously visited in GPS-invalid environments. Sensor fusion is considered an effective method to overcome the weaknesses of…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Zijie Zhou , Jingyi Xu , Guangming Xiong , Junyi Ma