English
Related papers

Related papers: Vision meets mmWave Radar: 3D Object Perception Be…

200 papers

To enable self-driving vehicles accurate detection and tracking of surrounding objects is essential. While Light Detection and Ranging (LiDAR) sensors have set the benchmark for high-performance systems, the appeal of camera-only solutions…

Computer Vision and Pattern Recognition · Computer Science 2024-08-07 Nicolas Baumann , Michael Baumgartner , Edoardo Ghignone , Jonas Kühne , Tobias Fischer , Yung-Hsu Yang , Marc Pollefeys , Michele Magno

Radars and cameras are mature, cost-effective, and robust sensors and have been widely used in the perception stack of mass-produced autonomous driving systems. Due to their complementary properties, outputs from radar detection (radar…

Computer Vision and Pattern Recognition · Computer Science 2021-06-21 Xu Dong , Binnan Zhuang , Yunxiang Mao , Langechuan Liu

Radar has stronger adaptability in adverse scenarios for autonomous driving environmental perception compared to widely adopted cameras and LiDARs. Compared with commonly used 3D radars, the latest 4D radars have precise vertical resolution…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Xinyu Zhang , Li Wang , Jian Chen , Cheng Fang , Lei Yang , Ziying Song , Guangqi Yang , Yichen Wang , Xiaofei Zhang , Jun Li , Zhiwei Li , Qingshan Yang , Zhenlin Zhang , Shuzhi Sam Ge

Multi-sensor fusion has significant potential in perception tasks for both indoor and outdoor environments. Especially under challenging conditions such as adverse weather and low-light environments, the combined use of millimeter-wave…

Image and Video Processing · Electrical Eng. & Systems 2025-05-23 Tieshuai Song , Jiandong Ye , Ao Guo , Guidong He , Bin Yang

Automotive FMCW radars remain reliable in rain and glare, yet their sparse, noisy point clouds constrain 3-D object detection. We therefore release CoVeRaP, a 21 k-frame cooperative dataset that time-aligns radar, camera, and GPS streams…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Jinyue Song , Hansol Ku , Jayneel Vora , Nelson Lee , Ahmad Kamari , Prasant Mohapatra , Parth Pathak

Object detection is a core component of perception systems, providing the ego vehicle with information about its surroundings to ensure safe route planning. While cameras and Lidar have significantly advanced perception systems, their…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Farzeen Munir , Shoaib Azam , Tomasz Kucner , Ville Kyrki , Moongu Jeon

Reliable 3D object perception is essential in autonomous driving. Owing to its sensing capabilities in all weather conditions, 4D radar has recently received much attention. However, compared to LiDAR, 4D radar provides much sparser point…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Sheng Yang , Tong Zhan , Shichen Qiao , Jicheng Gong , Qing Yang , Jian Wang , Yanfeng Lu

4D radar has received significant attention in autonomous driving thanks to its robustness under adverse weathers. Due to the sparse points and noisy measurements of the 4D radar, most of the research finish the 3D object detection task by…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Hanzhi Zhong , Zhiyu Xiang , Ruoyu Xu , Jingyun Fu , Peng Xu , Shaohong Wang , Zhihao Yang , Tianyu Pu , Eryun Liu

Various autonomous or assisted driving strategies have been facilitated through the accurate and reliable perception of the environment around a vehicle. Among the commonly used sensors, radar has usually been considered as a robust and…

Computer Vision and Pattern Recognition · Computer Science 2021-07-07 Yizhou Wang , Zhongyu Jiang , Yudong Li , Jenq-Neng Hwang , Guanbin Xing , Hui Liu

Perceiving the surrounding environment is a fundamental task in autonomous driving. To obtain highly accurate perception results, modern autonomous driving systems typically employ multi-modal sensors to collect comprehensive environmental…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Zhiwei Lin , Zhe Liu , Yongtao Wang , Le Zhang , Ce Zhu

With the rapid advancements of sensor technology and deep learning, autonomous driving systems are providing safe and efficient access to intelligent vehicles as well as intelligent transportation. Among these equipped sensors, the radar…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Shanliang Yao , Runwei Guan , Zitian Peng , Chenhang Xu , Yilu Shi , Weiping Ding , Eng Gee Lim , Yong Yue , Hyungjoon Seo , Ka Lok Man , Jieming Ma , Xiaohui Zhu , Yutao Yue

Accurate 3D object detection for autonomous driving requires complementary sensors. Cameras provide dense semantics but unreliable depth, while millimeter-wave radar offers precise range and velocity measurements with sparse geometry. We…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Mayank Mayank , Bharanidhar Duraisamy , Florian Geiß , Abhinav Valada

Radar is a key component of the suite of perception sensors used for safe and reliable navigation of autonomous vehicles. Its unique capabilities include high-resolution velocity imaging, detection of agents in occlusion and over long…

Computer Vision and Pattern Recognition · Computer Science 2023-09-29 Arvind Srivastav , Soumyajit Mandal

Lidar-based sensing drives current autonomous vehicles. Despite rapid progress, current Lidar sensors still lag two decades behind traditional color cameras in terms of resolution and cost. For autonomous driving, this means that large…

Computer Vision and Pattern Recognition · Computer Science 2021-11-15 Tianwei Yin , Xingyi Zhou , Philipp Krähenbühl

Due to its light and weather-independent sensing, millimeter-wave (MMW) radar is essential in smart environments. Intelligent vehicle systems and industry-grade MMW radars have integrated such capabilities. Industry-grade MMW radars are…

Computer Vision and Pattern Recognition · Computer Science 2023-05-04 Maloy Kumar Devnath , Avijoy Chakma , Mohammad Saeid Anwar , Emon Dey , Zahid Hasan , Marc Conn , Biplab Pal , Nirmalya Roy

Fusing LiDAR and camera information is essential for achieving accurate and reliable 3D object detection in autonomous driving systems. This is challenging due to the difficulty of combining multi-granularity geometric and semantic features…

Computer Vision and Pattern Recognition · Computer Science 2023-03-06 Yang Jiao , Zequn Jie , Shaoxiang Chen , Jingjing Chen , Lin Ma , Yu-Gang Jiang

Object detection in camera images, using deep learning has been proven successfully in recent years. Rising detection rates and computationally efficient network structures are pushing this technique towards application in production…

Computer Vision and Pattern Recognition · Computer Science 2020-05-18 Felix Nobis , Maximilian Geisslinger , Markus Weber , Johannes Betz , Markus Lienkamp

Autonomous driving requires robust perception across diverse environmental conditions, yet 3D semantic occupancy prediction remains challenging under adverse weather and lighting. In this work, we present the first study combining 4D radar…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 David Ninfa , Andras Palffy , Holger Caesar

As one of the automotive sensors that have emerged in recent years, 4D millimeter-wave radar has a higher resolution than conventional 3D radar and provides precise elevation measurements. But its point clouds are still sparse and noisy,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Hongsi Liu , Jun Liu , Guangfeng Jiang , Xin Jin

Camera and radar sensors have significant advantages in cost, reliability, and maintenance compared to LiDAR. Existing fusion methods often fuse the outputs of single modalities at the result-level, called the late fusion strategy. This can…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Youngseok Kim , Sanmin Kim , Jun Won Choi , Dongsuk Kum