English
Related papers

Related papers: SpaRC: Sparse Radar-Camera Fusion for 3D Object De…

200 papers

In this paper we present a novel radar-camera sensor fusion framework for accurate object detection and distance estimation in autonomous driving scenarios. The proposed architecture uses a middle-fusion approach to fuse the radar point…

Computer Vision and Pattern Recognition · Computer Science 2020-09-18 Ramin Nabati , Hairong Qi

Accurate 3D object detection for autonomous driving requires complementary sensors. Cameras provide dense semantics but unreliable depth, while millimeter-wave radar offers precise range and velocity measurements with sparse geometry. We…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Mayank Mayank , Bharanidhar Duraisamy , Florian Geiß , Abhinav Valada

As an emerging technology and a relatively affordable device, the 4D imaging radar has already been confirmed effective in performing 3D object detection in autonomous driving. Nevertheless, the sparsity and noisiness of 4D radar point…

Computer Vision and Pattern Recognition · Computer Science 2023-10-04 Weiyi Xiong , Jianan Liu , Tao Huang , Qing-Long Han , Yuxuan Xia , Bing Zhu

3D lane detection has emerged as a critical challenge in autonomous driving, encompassing identification and localization of lane markings and the 3D road surface. Conventional 3D methods detect lanes from dense birds-eye-viewed (BEV)…

Computer Vision and Pattern Recognition · Computer Science 2026-01-09 Maximilian Pittner , Joel Janai , Mario Faigle , Alexandru Paul Condurache

Detection and tracking of moving objects is an essential component in environmental perception for autonomous driving. In the flourishing field of multi-view 3D camera-based detectors, different transformer-based pipelines are designed to…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Yining Shi , Jingyan Shen , Yifan Sun , Yunlong Wang , Jiaxin Li , Shiqi Sun , Kun Jiang , Diange Yang

Robust 3D object detection is critical for safe autonomous driving. Camera and radar sensors are synergistic as they capture complementary information and work well under different environmental conditions. Fusing camera and radar data is…

Computer Vision and Pattern Recognition · Computer Science 2022-10-19 Jyh-Jing Hwang , Henrik Kretzschmar , Joshua Manela , Sean Rafferty , Nicholas Armstrong-Crews , Tiffany Chen , Dragomir Anguelov

Three-dimensional object detection is one of the key tasks in autonomous driving. To reduce costs in practice, low-cost multi-view cameras for 3D object detection are proposed to replace the expansive LiDAR sensors. However, relying solely…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Zhiwei Lin , Zhe Liu , Zhongyu Xia , Xinhao Wang , Yongtao Wang , Shengxiang Qi , Yang Dong , Nan Dong , Le Zhang , Ce Zhu

Accurate and robust 3D object detection is a critical component in autonomous vehicles and robotics. While recent radar-camera fusion methods have made significant progress by fusing information in the bird's-eye view (BEV) representation,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Jisong Kim , Minjae Seong , Jun Won Choi

4D millimeter-wave radar is a promising sensing modality for autonomous driving, yet effective 3D object detection from 4D radar and monocular images remains challenging. Existing fusion approaches either rely on instance proposals lacking…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Xiaokai Bai , Chenxu Zhou , Lianqing Zheng , Si-Yuan Cao , Jianan Liu , Xiaohan Zhang , Yiming Li , Zhengzhuang Zhang , Hui-liang Shen

Leveraging multi-modal fusion, especially between camera and LiDAR, has become essential for building accurate and robust 3D object detection systems for autonomous vehicles. Until recently, point decorating approaches, in which point…

Computer Vision and Pattern Recognition · Computer Science 2023-04-28 Philip Jacobson , Yiyang Zhou , Wei Zhan , Masayoshi Tomizuka , Ming C. Wu

Cameras can be used to perceive the environment around the vehicle, while affordable radar sensors are popular in autonomous driving systems as they can withstand adverse weather conditions unlike cameras. However, radar point clouds are…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Kavin Chandrasekaran , Sorin Grigorescu , Gijs Dubbelman , Pavol Jancura

Outside of urban hubs, autonomous cars and trucks have to master driving on intercity highways. Safe, long-distance highway travel at speeds exceeding 100 km/h demands perception distances of at least 250 m, which is about five times the…

Computer Vision and Pattern Recognition · Computer Science 2025-08-20 Edoardo Palladin , Samuel Brucker , Filippo Ghilotti , Praveen Narayanan , Mario Bijelic , Felix Heide

As a result of several successful applications in computer vision and image processing, sparse representation (SR) has attracted significant attention in multi-sensor image fusion. Unlike the traditional multiscale transforms (MSTs) that…

Computer Vision and Pattern Recognition · Computer Science 2017-02-14 Qiang Zhang , Yi Liu , Rick S. Blum , Jungong Han , Dacheng Tao

Thanks to the complementary nature of millimeter wave radar and camera, deep learning-based radar-camera 3D object detection methods may reliably produce accurate detections even in low-visibility conditions. This makes them preferable to…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Irfan Tito Kurniawan , Bambang Riyanto Trilaksono

Recent efforts in Gaussian-Splat-based Novel View Synthesis can achieve photorealistic rendering; however, such capability is limited in sparse-view scenarios due to sparse initialization and over-fitting floaters. Recent progress in depth…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Yutao Tang , Yuxiang Guo , Deming Li , Cheng Peng

Accurate 3D object detection is critical for autonomous driving, necessitating reliable, cost-effective sensors capable of operating in adverse weather conditions. Camera and millimeter-wave radar fusion has emerged as a promising solution;…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Bingyi Liu , Chuanhui Zhu , Hongfei Xue , Jian Teng , Jipeng Liu , Enshu Wang , Penglin Dai , Pu Wang

4D radar measurements offer an affordable and weather-robust solution for 3D perception. However, the inherent sparsity and noise of radar point clouds present significant challenges for accurate 3D object detection, underscoring the need…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Xiaokai Bai , Jiahao Cheng , Songkai Wang , Yixuan Luo , Lianqing Zheng , Xiaohan Zhang , Si-Yuan Cao , Hui-Liang Shen

Radars and cameras belong to the most frequently used sensors for advanced driver assistance systems and automated driving research. However, there has been surprisingly little research on radar-camera fusion with neural networks. One of…

Computer Vision and Pattern Recognition · Computer Science 2023-09-29 Lukas Stäcker , Shashank Mishra , Philipp Heidenreich , Jason Rambach , Didier Stricker

Panoptic segmentation is a fundamental task in computer vision and a crucial component for perception in autonomous vehicles. Recent mask-transformer-based methods achieve impressive performance on standard benchmarks but face significant…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Lojze Žust , Matej Kristan

4D millimeter-wave (mmWave) radar has been widely adopted in autonomous driving and robot perception due to its low cost and all-weather robustness. However, point-cloud-based radar representations suffer from information loss due to…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Runwei Guan , Jianan Liu , Shaofeng Liang , Fangqiang Ding , Shanliang Yao , Xiaokai Bai , Daizong Liu , Tao Huang , Guoqiang Mao , Hui Xiong