English
Related papers

Related papers: Radar and Camera Fusion for Object Detection and T…

200 papers

4D radar has received significant attention in autonomous driving thanks to its robustness under adverse weathers. Due to the sparse points and noisy measurements of the 4D radar, most of the research finish the 3D object detection task by…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Hanzhi Zhong , Zhiyu Xiang , Ruoyu Xu , Jingyun Fu , Peng Xu , Shaohong Wang , Zhihao Yang , Tianyu Pu , Eryun Liu

Multi-object tracking (MOT) with camera-LiDAR fusion demands accurate results of object detection, affinity computation and data association in real time. This paper presents an efficient multi-modal MOT framework with online joint…

Computer Vision and Pattern Recognition · Computer Science 2021-08-11 Kemiao Huang , Qi Hao

3D multi-object tracking is a crucial component in the perception system of autonomous driving vehicles. Tracking all dynamic objects around the vehicle is essential for tasks such as obstacle avoidance and path planning. Autonomous…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Ramin Nabati , Landon Harris , Hairong Qi

While LiDAR sensors have been successfully applied to 3D object detection, the affordability of radar and camera sensors has led to a growing interest in fusing radars and cameras for 3D object detection. However, previous radar-camera…

Computer Vision and Pattern Recognition · Computer Science 2024-05-17 Jisong Kim , Minjae Seong , Geonho Bang , Dongsuk Kum , Jun Won Choi

In the recent literature, on the one hand, many 3D multi-object tracking (MOT) works have focused on tracking accuracy and neglected computation speed, commonly by designing rather complex cost functions and feature extractors. On the other…

Computer Vision and Pattern Recognition · Computer Science 2022-08-29 Xiyang Wang , Chunyun Fu , Zhankun Li , Ying Lai , Jiawei He

Cameras can be used to perceive the environment around the vehicle, while affordable radar sensors are popular in autonomous driving systems as they can withstand adverse weather conditions unlike cameras. However, radar point clouds are…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Kavin Chandrasekaran , Sorin Grigorescu , Gijs Dubbelman , Pavol Jancura

Autonomous driving holds great promise in addressing traffic safety concerns by leveraging artificial intelligence and sensor technology. Multi-Object Tracking plays a critical role in ensuring safer and more efficient navigation through…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Lei Cheng , Arindam Sengupta , Siyang Cao

Accurate and robust 3D object detection is a critical component in autonomous vehicles and robotics. While recent radar-camera fusion methods have made significant progress by fusing information in the bird's-eye view (BEV) representation,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Jisong Kim , Minjae Seong , Jun Won Choi

Perceiving the surrounding environment is a fundamental task in autonomous driving. To obtain highly accurate perception results, modern autonomous driving systems typically employ multi-modal sensors to collect comprehensive environmental…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Zhiwei Lin , Zhe Liu , Yongtao Wang , Le Zhang , Ce Zhu

To enable self-driving vehicles accurate detection and tracking of surrounding objects is essential. While Light Detection and Ranging (LiDAR) sensors have set the benchmark for high-performance systems, the appeal of camera-only solutions…

Computer Vision and Pattern Recognition · Computer Science 2024-08-07 Nicolas Baumann , Michael Baumgartner , Edoardo Ghignone , Jonas Kühne , Tobias Fischer , Yung-Hsu Yang , Marc Pollefeys , Michele Magno

One of the main paths towards the reduction of traffic accidents is the increase in vehicle safety through driver assistance systems or even systems with a complete level of autonomy. In these types of systems, tasks such as obstacle…

Computer Vision and Pattern Recognition · Computer Science 2023-03-09 Felipe Manfio Barbosa , Fernando Santos Osório

Automotive traffic scenes are complex due to the variety of possible scenarios, objects, and weather conditions that need to be handled. In contrast to more constrained environments, such as automated underground trains, automotive…

Computer Vision and Pattern Recognition · Computer Science 2021-06-29 Felix Nobis , Ehsan Shafiei , Phillip Karle , Johannes Betz , Markus Lienkamp

Reliable detection and tracking of surrounding objects are indispensable for comprehensive motion prediction and planning of autonomous vehicles. Due to the limitations of individual sensors, the fusion of multiple sensor modalities is…

Robotics · Computer Science 2023-10-13 Phillip Karle , Felix Fent , Sebastian Huch , Florian Sauerbeck , Markus Lienkamp

Environment modeling utilizing sensor data fusion and object tracking is crucial for safe automated driving. In recent years, the classical occupancy grid map approach, which assumes a static environment, has been extended to dynamic…

Computer Vision and Pattern Recognition · Computer Science 2021-01-12 Christopher Diehl , Eduard Feicho , Alexander Schwambach , Thomas Dammeier , Eric Mares , Torsten Bertram

Despite radar's popularity in the automotive industry, for fusion-based 3D object detection, most existing works focus on LiDAR and camera fusion. In this paper, we propose TransCAR, a Transformer-based Camera-And-Radar fusion solution for…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Su Pang , Daniel Morris , Hayder Radha

Target detection is pivotal for modern urban computing applications. While image-based techniques are widely adopted, they falter under challenging environmental conditions such as adverse weather, poor lighting, and occlusion. To improve…

Image and Video Processing · Electrical Eng. & Systems 2024-02-29 Chen Zhu , Zhouxiang Zhao , Zejing Shan , Lijie Yang , Sijie Ji , Zhaohui Yang , Zhaoyang Zhang

Object detection in camera images, using deep learning has been proven successfully in recent years. Rising detection rates and computationally efficient network structures are pushing this technique towards application in production…

Computer Vision and Pattern Recognition · Computer Science 2020-05-18 Felix Nobis , Maximilian Geisslinger , Markus Weber , Johannes Betz , Markus Lienkamp

In autonomous driving, camera-radar fusion offers complementary sensing and low deployment cost. Existing methods perform fusion through input mixing, feature map mixing, or query-based feature sampling. We propose a new fusion paradigm,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Jialong Wu , Yihan Wang , Matthias Rottmann

Multi-modal fusion is a fundamental task for the perception of an autonomous driving system, which has recently intrigued many researchers. However, achieving a rather good performance is not an easy task due to the noisy raw data,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Keli Huang , Botian Shi , Xiang Li , Xin Li , Siyuan Huang , Yikang Li

Radars and cameras are mature, cost-effective, and robust sensors and have been widely used in the perception stack of mass-produced autonomous driving systems. Due to their complementary properties, outputs from radar detection (radar…

Computer Vision and Pattern Recognition · Computer Science 2021-06-21 Xu Dong , Binnan Zhuang , Yunxiang Mao , Langechuan Liu