English
Related papers

Related papers: Radar-Camera Pixel Depth Association for Depth Com…

200 papers

One of the main paths towards the reduction of traffic accidents is the increase in vehicle safety through driver assistance systems or even systems with a complete level of autonomy. In these types of systems, tasks such as obstacle…

Computer Vision and Pattern Recognition · Computer Science 2023-03-09 Felipe Manfio Barbosa , Fernando Santos Osório

In this paper, we propose a novel approach to address the problem of camera and radar sensor fusion for 3D object detection in autonomous vehicle perception systems. Our approach builds on recent advances in deep learning and leverages the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Daniel Dworak , Mateusz Komorkiewicz , Paweł Skruch , Jerzy Baranowski

Object detection is a core component of perception systems, providing the ego vehicle with information about its surroundings to ensure safe route planning. While cameras and Lidar have significantly advanced perception systems, their…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Farzeen Munir , Shoaib Azam , Tomasz Kucner , Ville Kyrki , Moongu Jeon

Environmental perception with the multi-modal fusion of radar and camera is crucial in autonomous driving to increase accuracy, completeness, and robustness. This paper focuses on utilizing millimeter-wave (MMW) radar and camera sensor…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Taohua Zhou , Yining Shi , Junjie Chen , Kun Jiang , Mengmeng Yang , Diange Yang

4D radar has received significant attention in autonomous driving thanks to its robustness under adverse weathers. Due to the sparse points and noisy measurements of the 4D radar, most of the research finish the 3D object detection task by…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Hanzhi Zhong , Zhiyu Xiang , Ruoyu Xu , Jingyun Fu , Peng Xu , Shaohong Wang , Zhihao Yang , Tianyu Pu , Eryun Liu

Camera and radar sensors have significant advantages in cost, reliability, and maintenance compared to LiDAR. Existing fusion methods often fuse the outputs of single modalities at the result-level, called the late fusion strategy. This can…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Youngseok Kim , Sanmin Kim , Jun Won Choi , Dongsuk Kum

Simulating realistic radar data has the potential to significantly accelerate the development of data-driven approaches to radar processing. However, it is fraught with difficulty due to the notoriously complex image formation process. Here…

Robotics · Computer Science 2020-12-01 Rob Weston , Oiwi Parker Jones , Ingmar Posner

Depth estimation plays a pivotal role in autonomous driving, facilitating a comprehensive understanding of the vehicle's 3D surroundings. Radar, with its robustness to adverse weather conditions and capability to measure distances, has…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Huawei Sun , Zixu Wang , Hao Feng , Julius Ott , Lorenzo Servadei , Robert Wille

Multi-modal depth estimation is one of the key challenges for endowing autonomous machines with robust robotic perception capabilities. There have been outstanding advances in the development of uni-modal depth estimation techniques based…

Robotics · Computer Science 2023-07-21 Johan S. Obando-Ceron , Victor Romero-Cano , Sildomar Monteiro

Recently, several works have proposed fusing radar data as an additional perceptual signal into monocular depth estimation models because radar data is robust against varying light and weather conditions. Although improved performances were…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Chen-Chou Lo , Patrick Vandewalle

LiDAR and Radar are two complementary sensing approaches in that LiDAR specializes in capturing an object's 3D shape while Radar provides longer detection ranges as well as velocity hints. Though seemingly natural, how to efficiently…

Computer Vision and Pattern Recognition · Computer Science 2023-06-05 Yingjie Wang , Jiajun Deng , Yao Li , Jinshui Hu , Cong Liu , Yu Zhang , Jianmin Ji , Wanli Ouyang , Yanyong Zhang

Radar-Camera depth estimation aims to predict dense and accurate metric depth by fusing input images and Radar data. Model efficiency is crucial for this task in pursuit of real-time processing on autonomous vehicles and robotic platforms.…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Yiran Wang , Jiaqi Li , Chaoyi Hong , Ruibo Li , Liusheng Sun , Xiao Song , Zhe Wang , Zhiguo Cao , Guosheng Lin

The perception system in autonomous vehicles is responsible for detecting and tracking the surrounding objects. This is usually done by taking advantage of several sensing modalities to increase robustness and accuracy, which makes sensor…

Computer Vision and Pattern Recognition · Computer Science 2021-01-07 Ramin Nabati , Hairong Qi

We present an end-to-end method for object detection and trajectory prediction utilizing multi-view representations of LiDAR returns and camera images. In this work, we recognize the strengths and weaknesses of different view…

Computer Vision and Pattern Recognition · Computer Science 2021-10-20 Sudeep Fadadu , Shreyash Pandey , Darshan Hegde , Yi Shi , Fang-Chieh Chou , Nemanja Djuric , Carlos Vallespi-Gonzalez

We present a heterogeneous localization framework for solving radar global localization and pose tracking on pre-built lidar maps. To bridge the gap of sensing modalities, deep neural networks are constructed to create shared embedding…

Robotics · Computer Science 2021-06-21 Huan Yin , Yue Wang , Rong Xiong

To accurately estimate locations and velocities of surrounding targets (cars) is crucial for advanced driver assistance systems based on radar sensors. In this paper we derive methods for fusing data from multiple radar sensors in order to…

Signal Processing · Electrical Eng. & Systems 2019-08-08 Bin Zhu , Augusto Ferrante , Johan Karlsson , Mattia Zorzi

As one of the automotive sensors that have emerged in recent years, 4D millimeter-wave radar has a higher resolution than conventional 3D radar and provides precise elevation measurements. But its point clouds are still sparse and noisy,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Hongsi Liu , Jun Liu , Guangfeng Jiang , Xin Jin

Radars and cameras belong to the most frequently used sensors for advanced driver assistance systems and automated driving research. However, there has been surprisingly little research on radar-camera fusion with neural networks. One of…

Computer Vision and Pattern Recognition · Computer Science 2023-09-29 Lukas Stäcker , Shashank Mishra , Philipp Heidenreich , Jason Rambach , Didier Stricker

Dense depth recovery is crucial in autonomous driving, serving as a foundational element for obstacle avoidance, 3D object detection, and local path planning. Adverse weather conditions, including haze, dust, rain, snow, and darkness,…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Han Li , Yukai Ma , Yuehao Huang , Yaqing Gu , Weihua Xu , Yong Liu , Xingxing Zuo

Reliable 3D object perception is essential in autonomous driving. Owing to its sensing capabilities in all weather conditions, 4D radar has recently received much attention. However, compared to LiDAR, 4D radar provides much sparser point…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Sheng Yang , Tong Zhan , Shichen Qiao , Jicheng Gong , Qing Yang , Jian Wang , Yanfeng Lu