English
Related papers

Related papers: Vision-RADAR fusion for Robotics BEV Detections: A…

200 papers

In the typical urban intersection scenario, both vehicles and infrastructures are equipped with visual and LiDAR sensors. By successfully integrating the data from vehicle-side and road monitoring devices, a more comprehensive and accurate…

Computer Vision and Pattern Recognition · Computer Science 2024-05-17 Xinyu Zhang , Yijin Xiong , Qianxin Qu , Renjie Wang , Xin Gao , Jing Liu , Shichun Guo , Jun Li

Object detection is an essential task for autonomous robots operating in dynamic and changing environments. A robot should be able to detect objects in the presence of sensor noise that can be induced by changing lighting conditions for…

Robotics · Computer Science 2019-11-20 Oier Mees , Andreas Eitel , Wolfram Burgard

Bird's eye view (BEV) perception is becoming increasingly important in the field of autonomous driving. It uses multi-view camera data to learn a transformer model that directly projects the perception of the road environment onto the BEV…

Computer Vision and Pattern Recognition · Computer Science 2023-09-11 Rui Song , Runsheng Xu , Andreas Festag , Jiaqi Ma , Alois Knoll

Bird's-eye-view (BEV) representations are the dominant paradigm for 3D perception in autonomous driving, providing a unified spatial canvas where detection and segmentation features are geometrically registered to the same physical…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Ahmet İnanç , Özgür Erkent

Data fusion has become an active research topic in recent years. Growing computational performance has allowed the use of redundant sensors to measure a single phenomenon. While Bayesian fusion approaches are common in general applications,…

Robotics · Computer Science 2017-04-25 Andres F. Echeverri , Henry Medeiros , Ryan Walsh , Yevgeniy Reznichenko , Richard Povinelli

Recent advancements in bird's eye view (BEV) representations have shown remarkable promise for in-vehicle 3D perception. However, while these methods have achieved impressive results on standard benchmarks, their robustness in varied…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Shaoyuan Xie , Lingdong Kong , Wenwei Zhang , Jiawei Ren , Liang Pan , Kai Chen , Ziwei Liu

Multi-sensor fusion is essential for accurate 3D object detection in self-driving systems. Camera and LiDAR are the most commonly used sensors, and usually, their fusion happens at the early or late stages of 3D detectors with the help of…

Computer Vision and Pattern Recognition · Computer Science 2023-11-08 Javed Ahmad , Alessio Del Bue

3D object detection and occupancy prediction are critical tasks in autonomous driving, attracting significant attention. Despite the potential of recent vision-based methods, they encounter challenges under adverse conditions. Thus,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Lianqing Zheng , Jianan Liu , Runwei Guan , Long Yang , Shouyi Lu , Yuanzhe Li , Xiaokai Bai , Jie Bai , Zhixiong Ma , Hui-Liang Shen , Xichan Zhu

While recent low-cost radar-camera approaches have shown promising results in multi-modal 3D object detection, both sensors face challenges from environmental and intrinsic disturbances. Poor lighting or adverse weather conditions degrade…

Computer Vision and Pattern Recognition · Computer Science 2025-02-19 Jingtong Yue , Zhiwei Lin , Xin Lin , Xiaoyu Zhou , Xiangtai Li , Lu Qi , Yongtao Wang , Ming-Hsuan Yang

Robust object detection for Unmanned Surface Vehicles (USVs) in complex water environments is essential for reliable navigation and operation. Specifically, water surface object detection faces challenges from blurred edges and diverse…

Computer Vision and Pattern Recognition · Computer Science 2025-04-11 Huilin Yin , Pengyu Wang , Senmao Li , Jun Yan , Daniel Watzenig

A critical aspect of autonomous vehicles (AVs) is the object detection stage, which is increasingly being performed with sensor fusion models: multimodal 3D object detection models which utilize both 2D RGB image data and 3D data from a…

Computer Vision and Pattern Recognition · Computer Science 2021-09-16 Won Park , Nan Liu , Qi Alfred Chen , Z. Morley Mao

This paper presents novel hybrid architectures that combine grid- and point-based processing to improve the detection performance and orientation estimation of radar-based object detection networks. Purely grid-based detection models…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Michael Ulrich , Sascha Braun , Daniel Köhler , Daniel Niederlöhner , Florian Faion , Claudius Gläser , Holger Blume

We propose LiRaFusion to tackle LiDAR-radar fusion for 3D object detection to fill the performance gap of existing LiDAR-radar detectors. To improve the feature extraction capabilities from these two modalities, we design an early fusion…

Robotics · Computer Science 2024-02-20 Jingyu Song , Lingjun Zhao , Katherine A. Skinner

3D object detection is a common function within the perception system of an autonomous vehicle and outputs a list of 3D bounding boxes around objects of interest. Various 3D object detection methods have relied on fusion of different sensor…

Computer Vision and Pattern Recognition · Computer Science 2020-11-02 Eduardo Arnold , Mehrdad Dianati , Robert de Temple , Saber Fallah

In the field of autonomous driving and mobile robotics, there has been a significant shift in the methods used to create Bird's Eye View (BEV) representations. This shift is characterised by using transformers and learning to fuse…

Robotics · Computer Science 2024-10-29 Mehdi Hosseinzadeh , Ian Reid

Accurate LiDAR-camera calibration is fundamental to fusing multi-modal perception in autonomous driving and robotic systems. Traditional calibration methods require extensive data collection in controlled environments and cannot compensate…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Weiduo Yuan , Jerry Li , Justin Yue , Divyank Shah , Konstantinos Karydis , Hang Qiu

Combining complementary sensor modalities is crucial to providing robust perception for safety-critical robotics applications such as autonomous driving (AD). Recent state-of-the-art camera-lidar fusion methods for AD rely on monocular…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 James Gunn , Zygmunt Lenyk , Anuj Sharma , Andrea Donati , Alexandru Buburuzan , John Redford , Romain Mueller

Leading autonomous vehicle (AV) platforms and testing infrastructures are, unfortunately, proprietary and closed-source. Thus, it is difficult to evaluate how well safety-critical AVs perform and how safe they truly are. Similarly, few…

Systems and Control · Electrical Eng. & Systems 2023-03-30 R. Spencer Hallyburton , Nate Zelter , David Hunt , Kristen Angell , Miroslav Pajic

3D perception based on the representations learned from multi-camera bird's-eye-view (BEV) is trending as cameras are cost-effective for mass production in autonomous driving industry. However, there exists a distinct performance gap…

Computer Vision and Pattern Recognition · Computer Science 2023-09-27 Zeyu Wang , Dingwen Li , Chenxu Luo , Cihang Xie , Xiaodong Yang

Construction robots operate in unstructured construction sites, where effective visual perception is crucial for ensuring safe and seamless operations. However, construction robots often handle large elements and perform tasks across…

Robotics · Computer Science 2024-12-17 Jia Xu , Manish Dixit , Xi Wang