English
Related papers

Related papers: Velocity Driven Vision: Asynchronous Sensor Fusion…

200 papers

Correct radar data fusion depends on knowledge of the spatial transform between sensor pairs. Current methods for determining this transform operate by aligning identifiable features in different radar scans, or by relying on measurements…

Robotics · Computer Science 2023-08-30 Qilong Cheng , Emmett Wise , Jonathan Kelly

In this work, we present an uncertainty-based method for sensor fusion with camera and radar data. The outputs of two neural networks, one processing camera and the other one radar data, are combined in an uncertainty aware manner. To this…

Computer Vision and Pattern Recognition · Computer Science 2020-11-24 Kamil Kowol , Matthias Rottmann , Stefan Bracke , Hanno Gottschalk

LiDAR and 4D radar are widely used in autonomous driving and robotics. While LiDAR provides rich spatial information, 4D radar offers velocity measurement and remains robust under adverse conditions. As a result, increasing studies have…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Xiangyuan Peng , Miao Tang , Huawei Sun , Bierzynski Kay , Lorenzo Servadei , Robert Wille

Multi-view aggregation promises to overcome the occlusion and missed detection challenge in multi-object detection and tracking. Recent approaches in multi-view detection and 3D object detection made a huge performance leap by projecting…

Computer Vision and Pattern Recognition · Computer Science 2023-10-23 Torben Teepe , Philipp Wolters , Johannes Gilg , Fabian Herzog , Gerhard Rigoll

3D object detection based on LiDAR point clouds is a crucial module in autonomous driving particularly for long range sensing. Most of the research is focused on achieving higher accuracy and these models are not optimized for deployment on…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Sambit Mohapatra , Senthil Yogamani , Heinrich Gotzig , Stefan Milz , Patrick Mader

In the domain of autonomous driving, the integration of multi-modal perception techniques based on data from diverse sensors has demonstrated substantial progress. Effectively surpassing the capabilities of state-of-the-art single-modality…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Sheng-Yao Kuan , Jen-Hao Cheng , Hsiang-Wei Huang , Wenhao Chai , Cheng-Yen Yang , Hugo Latapie , Gaowen Liu , Bing-Fei Wu , Jenq-Neng Hwang

Accurate and robust 3D object detection is essential for autonomous driving, where fusing data from sensors like LiDAR and camera enhances detection accuracy. However, sensor malfunctions such as corruption or disconnection can degrade…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Reza Sadeghian , Niloofar Hooshyaripour , Chris Joslin , WonSook Lee

While camera and LiDAR are widely used in most of the assisted and autonomous driving systems, only a few works have been proposed to associate the temporal synchronization and extrinsic calibration for camera and LiDAR which are dedicated…

Robotics · Computer Science 2022-07-22 Shouan Wang , Xinyu Zhang , GuiPeng Zhang , Yijin Xiong , Ganglin Tian , Shichun Guo , Jun Li

Accurate 3D object detection for autonomous driving requires complementary sensors. Cameras provide dense semantics but unreliable depth, while millimeter-wave radar offers precise range and velocity measurements with sparse geometry. We…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Mayank Mayank , Bharanidhar Duraisamy , Florian Geiß , Abhinav Valada

Perception is a key component of Automated vehicles (AVs). However, sensors mounted to the AVs often encounter blind spots due to obstructions from other vehicles, infrastructure, or objects in the surrounding area. While recent…

Robotics · Computer Science 2025-04-14 Nithish Kumar Saravanan , Varun Jammula , Yezhou Yang , Jeffrey Wishart , Junfeng Zhao

Radars and cameras belong to the most frequently used sensors for advanced driver assistance systems and automated driving research. However, there has been surprisingly little research on radar-camera fusion with neural networks. One of…

Computer Vision and Pattern Recognition · Computer Science 2023-09-29 Lukas Stäcker , Shashank Mishra , Philipp Heidenreich , Jason Rambach , Didier Stricker

In this paper, we propose a novel approach to address the problem of camera and radar sensor fusion for 3D object detection in autonomous vehicle perception systems. Our approach builds on recent advances in deep learning and leverages the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Daniel Dworak , Mateusz Komorkiewicz , Paweł Skruch , Jerzy Baranowski

A novel relative localization approach for guidance of a micro-scale Unmanned Aerial Vehicle (UAV) by a well-equipped aerial robot fusing Visual-Inertial Odometry (VIO) with Light Detection and Ranging (LiDAR) is proposed in this paper.…

Robotics · Computer Science 2026-03-05 Václav Pritzl , Matouš Vrba , Petr Štěpán , Martin Saska

By exploiting complementary sensor information, radar and camera fusion systems have the potential to provide a highly robust and reliable perception system for advanced driver assistance systems and automated driving functions. Recent…

Computer Vision and Pattern Recognition · Computer Science 2023-09-28 Lukas Stäcker , Philipp Heidenreich , Jason Rambach , Didier Stricker

In this work, we propose \textit{MVFuseNet}, a novel end-to-end method for joint object detection and motion forecasting from a temporal sequence of LiDAR data. Most existing methods operate in a single view by projecting data in either…

Computer Vision and Pattern Recognition · Computer Science 2021-04-23 Ankit Laddha , Shivam Gautam , Stefan Palombo , Shreyash Pandey , Carlos Vallespi-Gonzalez

In this work, we propose a new approach that combines data from multiple sensors for reliable obstacle avoidance. The sensors include two depth cameras and a LiDAR arranged so that they can capture the whole 3D area in front of the robot…

Robotics · Computer Science 2022-12-27 Thanh Nguyen Canh , Truong Son Nguyen , Cong Hoang Quach , Xiem HoangVan , Manh Duong Phung

LiDAR and Radar are two complementary sensing approaches in that LiDAR specializes in capturing an object's 3D shape while Radar provides longer detection ranges as well as velocity hints. Though seemingly natural, how to efficiently…

Computer Vision and Pattern Recognition · Computer Science 2023-06-05 Yingjie Wang , Jiajun Deng , Yao Li , Jinshui Hu , Cong Liu , Yu Zhang , Jianmin Ji , Wanli Ouyang , Yanyong Zhang

In autonomous driving, LiDAR and radar are crucial for environmental perception. LiDAR offers precise 3D spatial sensing information but struggles in adverse weather like fog. Conversely, radar signals can penetrate rain or mist due to…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Yanlong Yang , Jianan Liu , Tao Huang , Qing-Long Han , Gang Ma , Bing Zhu

Semantic scene segmentation from a bird's-eye-view (BEV) perspective plays a crucial role in facilitating planning and decision-making for mobile robots. Although recent vision-only methods have demonstrated notable advancements in…

Camera and radar sensors have significant advantages in cost, reliability, and maintenance compared to LiDAR. Existing fusion methods often fuse the outputs of single modalities at the result-level, called the late fusion strategy. This can…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Youngseok Kim , Sanmin Kim , Jun Won Choi , Dongsuk Kum