English
Related papers

Related papers: Radar and Camera Fusion for Object Detection and T…

200 papers

Millimeter-wave radar plays a vital role in 3D object detection for autonomous driving due to its all-weather and all-lighting-condition capabilities for perception. However, radar point clouds suffer from pronounced sparsity and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Zijian Gu , Jianwei Ma , Yan Huang , Honghao Wei , Zhanye Chen , Hui Zhang , Wei Hong

The combination of LiDAR and camera modalities is proven to be necessary and typical for 3D object detection according to recent studies. Existing fusion strategies tend to overly rely on the LiDAR modal in essence, which exploits the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Yang Yang , Weijie Ma , Hao Chen , Linlin Ou , Xinyi Yu

Fusing data from cameras and LiDAR sensors is an essential technique to achieve robust 3D object detection. One key challenge in camera-LiDAR fusion involves mitigating the large domain gap between the two sensors in terms of coordinates…

Computer Vision and Pattern Recognition · Computer Science 2023-02-17 Yecheol Kim , Konyul Park , Minwook Kim , Dongsuk Kum , Jun Won Choi

Fully autonomous driving systems require fast detection and recognition of sensitive objects in the environment. In this context, intelligent vehicles should share their sensor data with computing platforms and/or other vehicles, to detect…

Networking and Internet Architecture · Computer Science 2021-04-27 Valentina Rossi , Paolo Testolina , Marco Giordani , Michele Zorzi

4D millimeter-wave (mmWave) radar has been widely adopted in autonomous driving and robot perception due to its low cost and all-weather robustness. However, point-cloud-based radar representations suffer from information loss due to…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Runwei Guan , Jianan Liu , Shaofeng Liang , Fangqiang Ding , Shanliang Yao , Xiaokai Bai , Daizong Liu , Tao Huang , Guoqiang Mao , Hui Xiong

Radar and camera fusion yields robustness in perception tasks by leveraging the strength of both sensors. The typical extracted radar point cloud is 2D without height information due to insufficient antennas along the elevation axis, which…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Huawei Sun , Hao Feng , Gianfranco Mauro , Julius Ott , Georg Stettinger , Lorenzo Servadei , Robert Wille

Multi-sensor fusion is crucial for accurate 3D object detection in autonomous driving, with cameras and LiDAR being the most commonly used sensors. However, existing methods perform sensor fusion in a single view by projecting features from…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Rohit Mohan , Daniele Cattaneo , Florian Drews , Abhinav Valada

LiDAR and Radar are two complementary sensing approaches in that LiDAR specializes in capturing an object's 3D shape while Radar provides longer detection ranges as well as velocity hints. Though seemingly natural, how to efficiently…

Computer Vision and Pattern Recognition · Computer Science 2023-06-05 Yingjie Wang , Jiajun Deng , Yao Li , Jinshui Hu , Cong Liu , Yu Zhang , Jianmin Ji , Wanli Ouyang , Yanyong Zhang

Recent advancements in perception for autonomous driving are driven by deep learning. In order to achieve robust and accurate scene understanding, autonomous vehicles are usually equipped with different sensors (e.g. cameras, LiDARs,…

The rise of autonomous vehicles has significantly increased the demand for robust 3D object detection systems. While cameras and LiDAR sensors each offer unique advantages--cameras provide rich texture information and LiDAR offers precise…

Computer Vision and Pattern Recognition · Computer Science 2025-07-04 Zitian Wang , Zehao Huang , Yulu Gao , Naiyan Wang , Si Liu

Tracking people in a video sequence is one of the fields of interest in computer vision. It has broad applications in motion capture and surveillance. However, due to the complexity of human dynamic structure, detecting and tracking are not…

Image and Video Processing · Electrical Eng. & Systems 2018-06-19 Hiliwi Leake Kidane

In this paper, we present a parallel architecture for a sensor fusion detection system that combines a camera and 1D light detection and ranging (lidar) sensor for object detection. The system contains two object detection methods, one…

Computer Vision and Pattern Recognition · Computer Science 2022-01-25 I-Hsi Kao , Ya-Zhu Yian , Jian-An Su , Yi-Horng Lai , Jau-Woei Perng , Tung-Li Hsieh , Yi-Shueh Tsai , Min-Shiu Hsieh

Safety and reliability are crucial for the public acceptance of autonomous driving. To ensure accurate and reliable environmental perception, intelligent vehicles must exhibit accuracy and robustness in various environments. Millimeter-wave…

Computer Vision and Pattern Recognition · Computer Science 2025-02-24 Yue Sun , Yeqiang Qian , Chunxiang Wang , Ming Yang

There are two critical sensors for 3D perception in autonomous driving, the camera and the LiDAR. The camera provides rich semantic information such as color, texture, and the LiDAR reflects the 3D shape and locations of surrounding…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Kaicheng Yu , Tang Tao , Hongwei Xie , Zhiwei Lin , Zhongwei Wu , Zhongyu Xia , Tingting Liang , Haiyang Sun , Jiong Deng , Dayang Hao , Yongtao Wang , Xiaodan Liang , Bing Wang

With autonomous driving developing in a booming stage, accurate object detection in complex scenarios attract wide attention to ensure the safety of autonomous driving. Millimeter wave (mmWave) radar and vision fusion is a mainstream…

Computer Vision and Pattern Recognition · Computer Science 2022-04-04 Zhiqing Wei , Fengkai Zhang , Shuo Chang , Yangyang Liu , Huici Wu , Zhiyong Feng

This paper proposes a depth estimation method using radar-image fusion by addressing the uncertain vertical directions of sparse radar measurements. In prior radar-image fusion work, image features are merged with the uncertain sparse…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Masaya Kotani , Takeru Oba , Norimichi Ukita

Reliable 3D object perception is essential in autonomous driving. Owing to its sensing capabilities in all weather conditions, 4D radar has recently received much attention. However, compared to LiDAR, 4D radar provides much sparser point…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Sheng Yang , Tong Zhan , Shichen Qiao , Jicheng Gong , Qing Yang , Jian Wang , Yanfeng Lu

Automatic detection of flying drones is a key issue where its presence, especially if unauthorized, can create risky situations or compromise security. Here, we design and evaluate a multi-sensor drone detection system. In conjunction with…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Fredrik Svanström , Fernando Alonso-Fernandez , Cristofer Englund

Thanks to the complementary nature of millimeter wave radar and camera, deep learning-based radar-camera 3D object detection methods may reliably produce accurate detections even in low-visibility conditions. This makes them preferable to…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Irfan Tito Kurniawan , Bambang Riyanto Trilaksono

High-resolution radar sensors are able to resolve multiple detections per object and therefore provide valuable information for vehicle environment perception. For instance, multiple detections allow to infer the size of an object or to…

Signal Processing · Electrical Eng. & Systems 2019-10-29 Alexander Scheel , Klaus Dietmayer