English
Related papers

Related papers: Radar-Camera Sensor Fusion for Joint Object Detect…

200 papers

3D object detection is a key perception component in autonomous driving. Most recent approaches are based on Lidar sensors only or fused with cameras. Maps (e.g., High Definition Maps), a basic infrastructure for intelligent vehicles,…

Computer Vision and Pattern Recognition · Computer Science 2021-03-11 Jin Fang , Dingfu Zhou , Xibin Song , Liangjun Zhang

LiDAR and camera are two essential sensors for 3D object detection in autonomous driving. LiDAR provides accurate and reliable 3D geometry information while the camera provides rich texture with color. Despite the increasing popularity of…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Qi Jiang , Hao Sun , Xi Zhang

This paper presents a Multi-Object Tracking (MOT) framework that fuses radar and camera data to enhance tracking efficiency while minimizing manual interventions. Contrary to many studies that underutilize radar and assign it a…

Computer Vision and Pattern Recognition · Computer Science 2025-11-06 Lei Cheng , Siyang Cao

Robust real-time detection and motion forecasting of traffic participants is necessary for autonomous vehicles to safely navigate urban environments. In this paper, we present RV-FuseNet, a novel end-to-end approach for joint detection and…

Computer Vision and Pattern Recognition · Computer Science 2021-03-24 Ankit Laddha , Shivam Gautam , Gregory P. Meyer , Carlos Vallespi-Gonzalez , Carl K. Wellington

LiDAR and camera are two important sensors for 3D object detection in autonomous driving. Despite the increasing popularity of sensor fusion in this field, the robustness against inferior image conditions, e.g., bad illumination and sensor…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Xuyang Bai , Zeyu Hu , Xinge Zhu , Qingqiu Huang , Yilun Chen , Hongbo Fu , Chiew-Lan Tai

Robust road segmentation is a key challenge in self-driving research. Though many image-based methods have been studied and high performances in dataset evaluations have been reported, developing robust and reliable road segmentation is…

Computer Vision and Pattern Recognition · Computer Science 2019-05-29 Huafeng Liu , Yazhou Yao , Zeren Sun , Xiangrui Li , Ke Jia , Zhenmin Tang

In the recent literature, on the one hand, many 3D multi-object tracking (MOT) works have focused on tracking accuracy and neglected computation speed, commonly by designing rather complex cost functions and feature extractors. On the other…

Computer Vision and Pattern Recognition · Computer Science 2022-08-29 Xiyang Wang , Chunyun Fu , Zhankun Li , Ying Lai , Jiawei He

The unique cost, flexibility, speed, and efficiency of modern UAVs make them an attractive choice in many applications in contemporary society. This, however, causes an ever-increasing number of reported malicious or accidental incidents,…

Artificial Intelligence · Computer Science 2024-10-22 Nikos Sakellariou , Antonios Lalas , Konstantinos Votis , Dimitrios Tzovaras

Depth estimation is critical in autonomous driving for interpreting 3D scenes accurately. Recently, radar-camera depth estimation has become of sufficient interest due to the robustness and low-cost properties of radar. Thus, this paper…

Computer Vision and Pattern Recognition · Computer Science 2024-09-02 Huawei Sun , Hao Feng , Julius Ott , Lorenzo Servadei , Robert Wille

In this work, we present SpaRC, a novel Sparse fusion transformer for 3D perception that integrates multi-view image semantics with Radar and Camera point features. The fusion of radar and camera modalities has emerged as an efficient…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Philipp Wolters , Johannes Gilg , Torben Teepe , Fabian Herzog , Felix Fent , Gerhard Rigoll

Multi-modal depth estimation is one of the key challenges for endowing autonomous machines with robust robotic perception capabilities. There have been outstanding advances in the development of uni-modal depth estimation techniques based…

Robotics · Computer Science 2023-07-21 Johan S. Obando-Ceron , Victor Romero-Cano , Sildomar Monteiro

We present a novel approach for metric dense depth estimation based on the fusion of a single-view image and a sparse, noisy Radar point cloud. The direct fusion of heterogeneous Radar and image data, or their encodings, tends to yield…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Han Li , Yukai Ma , Yaqing Gu , Kewei Hu , Yong Liu , Xingxing Zuo

Robust 3D object detection in extreme weather and illumination conditions is a challenging task. While radars and thermal cameras are known for their resilience to these conditions, few studies have been conducted on radar-thermal fusion…

Computer Vision and Pattern Recognition · Computer Science 2023-09-13 Qiao Yan , Yihan Wang

LiDAR-based 3D object detection is an important task for autonomous driving and current approaches suffer from sparse and partial point clouds of distant and occluded objects. In this paper, we propose a novel two-stage approach, namely…

Computer Vision and Pattern Recognition · Computer Science 2020-12-23 Yanan Zhang , Di Huang , Yunhong Wang

Lidar-based sensing drives current autonomous vehicles. Despite rapid progress, current Lidar sensors still lag two decades behind traditional color cameras in terms of resolution and cost. For autonomous driving, this means that large…

Computer Vision and Pattern Recognition · Computer Science 2021-11-15 Tianwei Yin , Xingyi Zhou , Philipp Krähenbühl

4D millimeter-wave (MMW) radar, which provides both height information and dense point cloud data over 3D MMW radar, has become increasingly popular in 3D object detection. In recent years, radar-vision fusion models have demonstrated…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Haocheng Zhao , Runwei Guan , Taoyu Wu , Ka Lok Man , Limin Yu , Yutao Yue

Accurate detection of objects in 3D point clouds is a key problem in autonomous driving systems. Collaborative perception can incorporate information from spatially diverse sensors and provide significant benefits for improving the…

Computer Vision and Pattern Recognition · Computer Science 2022-05-25 Junyong Wang , Yuan Zeng , Yi Gong

As the previous state-of-the-art 4D radar-camera fusion-based 3D object detection method, LXL utilizes the predicted image depth distribution maps and radar 3D occupancy grids to assist the sampling-based image view transformation. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-21 Weiyi Xiong , Zean Zou , Qiuchi Zhao , Fengchun He , Bing Zhu

Fully autonomous driving systems require fast detection and recognition of sensitive objects in the environment. In this context, intelligent vehicles should share their sensor data with computing platforms and/or other vehicles, to detect…

Networking and Internet Architecture · Computer Science 2021-04-27 Valentina Rossi , Paolo Testolina , Marco Giordani , Michele Zorzi

Millimeter-wave radars are being increasingly integrated into commercial vehicles to support new advanced driver-assistance systems by enabling robust and high-performance object detection, localization, as well as recognition - a key…

Signal Processing · Electrical Eng. & Systems 2022-05-02 Xiangyu Gao , Guanbin Xing , Sumit Roy , Hui Liu