English
Related papers

Related papers: CramNet: Camera-Radar Fusion with Ray-Constrained …

200 papers

4D millimeter-wave (mmWave) radar has been widely adopted in autonomous driving and robot perception due to its low cost and all-weather robustness. However, point-cloud-based radar representations suffer from information loss due to…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Runwei Guan , Jianan Liu , Shaofeng Liang , Fangqiang Ding , Shanliang Yao , Xiaokai Bai , Daizong Liu , Tao Huang , Guoqiang Mao , Hui Xiong

3D multi-object tracking is a crucial component in the perception system of autonomous driving vehicles. Tracking all dynamic objects around the vehicle is essential for tasks such as obstacle avoidance and path planning. Autonomous…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Ramin Nabati , Landon Harris , Hairong Qi

Robust 3D object detection in extreme weather and illumination conditions is a challenging task. While radars and thermal cameras are known for their resilience to these conditions, few studies have been conducted on radar-thermal fusion…

Computer Vision and Pattern Recognition · Computer Science 2023-09-13 Qiao Yan , Yihan Wang

By exploiting complementary sensor information, radar and camera fusion systems have the potential to provide a highly robust and reliable perception system for advanced driver assistance systems and automated driving functions. Recent…

Computer Vision and Pattern Recognition · Computer Science 2023-09-28 Lukas Stäcker , Philipp Heidenreich , Jason Rambach , Didier Stricker

Depth estimation is critical in autonomous driving for interpreting 3D scenes accurately. Recently, radar-camera depth estimation has become of sufficient interest due to the robustness and low-cost properties of radar. Thus, this paper…

Computer Vision and Pattern Recognition · Computer Science 2024-09-02 Huawei Sun , Hao Feng , Julius Ott , Lorenzo Servadei , Robert Wille

We tackle the problem of exploiting Radar for perception in the context of self-driving as Radar provides complementary information to other sensors such as LiDAR or cameras in the form of Doppler velocity. The main challenges of using…

Computer Vision and Pattern Recognition · Computer Science 2020-07-29 Bin Yang , Runsheng Guo , Ming Liang , Sergio Casas , Raquel Urtasun

Cameras can be used to perceive the environment around the vehicle, while affordable radar sensors are popular in autonomous driving systems as they can withstand adverse weather conditions unlike cameras. However, radar point clouds are…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Kavin Chandrasekaran , Sorin Grigorescu , Gijs Dubbelman , Pavol Jancura

Thanks to the complementary nature of millimeter wave radar and camera, deep learning-based radar-camera 3D object detection methods may reliably produce accurate detections even in low-visibility conditions. This makes them preferable to…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Irfan Tito Kurniawan , Bambang Riyanto Trilaksono

Recent advances in 4D imaging radar have enabled robust perception in adverse weather, while camera sensors provide dense semantic information. Fusing the these complementary modalities has great potential for cost-effective 3D perception.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Xiaozhi Li , Huijun Di , Jian Li , Feng Liu , Wei Liang

We propose DeepFusion, a modular multi-modal architecture to fuse lidars, cameras and radars in different combinations for 3D object detection. Specialized feature extractors take advantage of each modality and can be exchanged easily,…

Computer Vision and Pattern Recognition · Computer Science 2022-09-28 Florian Drews , Di Feng , Florian Faion , Lars Rosenbaum , Michael Ulrich , Claudius Gläser

Recently, camera-radar fusion-based 3D object detection methods in bird's eye view (BEV) have gained attention due to the complementary characteristics and cost-effectiveness of these sensors. Previous approaches using forward projection…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 In-Jae Lee , Sihwan Hwang , Youngseok Kim , Wonjune Kim , Sanmin Kim , Dongsuk Kum

4D radar has received significant attention in autonomous driving thanks to its robustness under adverse weathers. Due to the sparse points and noisy measurements of the 4D radar, most of the research finish the 3D object detection task by…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Hanzhi Zhong , Zhiyu Xiang , Ruoyu Xu , Jingyun Fu , Peng Xu , Shaohong Wang , Zhihao Yang , Tianyu Pu , Eryun Liu

One of the main paths towards the reduction of traffic accidents is the increase in vehicle safety through driver assistance systems or even systems with a complete level of autonomy. In these types of systems, tasks such as obstacle…

Computer Vision and Pattern Recognition · Computer Science 2023-03-09 Felipe Manfio Barbosa , Fernando Santos Osório

While LiDAR sensors have been successfully applied to 3D object detection, the affordability of radar and camera sensors has led to a growing interest in fusing radars and cameras for 3D object detection. However, previous radar-camera…

Computer Vision and Pattern Recognition · Computer Science 2024-05-17 Jisong Kim , Minjae Seong , Geonho Bang , Dongsuk Kum , Jun Won Choi

Environmental perception with the multi-modal fusion of radar and camera is crucial in autonomous driving to increase accuracy, completeness, and robustness. This paper focuses on utilizing millimeter-wave (MMW) radar and camera sensor…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Taohua Zhou , Yining Shi , Junjie Chen , Kun Jiang , Mengmeng Yang , Diange Yang

In autonomous driving, camera-radar fusion offers complementary sensing and low deployment cost. Existing methods perform fusion through input mixing, feature map mixing, or query-based feature sampling. We propose a new fusion paradigm,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Jialong Wu , Yihan Wang , Matthias Rottmann

A realistic view of the vehicle's surroundings is generally offered by camera sensors, which is crucial for environmental perception. Affordable radar sensors, on the other hand, are becoming invaluable due to their robustness in variable…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Kavin Chandrasekaran , Sorin Grigorescu , Gijs Dubbelman , Pavol Jancura

The emerging 4D millimeter-wave radar, measuring the range, azimuth, elevation, and Doppler velocity of objects, is recognized for its cost-effectiveness and robustness in autonomous driving. Nevertheless, its point clouds exhibit…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Yuzhi Wu , Li Xiao , Jun Liu , Guangfeng Jiang , XiangGen Xia

There are two critical sensors for 3D perception in autonomous driving, the camera and the LiDAR. The camera provides rich semantic information such as color, texture, and the LiDAR reflects the 3D shape and locations of surrounding…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Kaicheng Yu , Tang Tao , Hongwei Xie , Zhiwei Lin , Zhongwei Wu , Zhongyu Xia , Tingting Liang , Haiyang Sun , Jiong Deng , Dayang Hao , Yongtao Wang , Xiaodan Liang , Bing Wang

4D radar-camera sensing configuration has gained increasing importance in autonomous driving. However, existing 3D object detection methods that fuse 4D Radar and camera data confront several challenges. First, their absolute depth…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Zhongyu Xia , Yousen Tang , Yongtao Wang , Zhifeng Wang , Weijun Qin