English
Related papers

Related papers: LiDAR-as-Camera for End-to-End Driving

200 papers

The goal of extrinsic calibration is the alignment of sensor data to ensure an accurate representation of the surroundings and enable sensor fusion applications. From a safety perspective, sensor calibration is a key enabler of autonomous…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Ilir Tahiraj , Jeremialie Swadiryus , Felix Fent , Markus Lienkamp

This study aims to improve the performance and generalization capability of end-to-end autonomous driving with scene understanding leveraging deep learning and multimodal sensor fusion techniques. The designed end-to-end deep neural network…

Robotics · Computer Science 2020-08-04 Zhiyu Huang , Chen Lv , Yang Xing , Jingda Wu

3D perception using sensors under vehicle industrial standard is the rigid demand in autonomous driving. MEMS LiDAR emerges with irresistible trend due to its lower cost, more robust, and meeting the mass-production standards. However, it…

Computer Vision and Pattern Recognition · Computer Science 2021-02-17 Jianing Zhang , Wei Li , Honggang Gou , Lu Fang , Ruigang Yang

LiDARs plays an important role in self-driving cars and its configuration such as the location placement for each LiDAR can influence object detection performance. This paper aims to investigate an optimal configuration that maximizes the…

Robotics · Computer Science 2018-05-22 Shenyu Mou , Yan Chang , Wenshuo Wang , Ding Zhao

Most sensor setups for onboard autonomous perception are composed of LiDARs and vision systems, as they provide complementary information that improves the reliability of the different algorithms necessary to obtain a robust scene…

Robotics · Computer Science 2022-03-16 Jorge Beltrán , Carlos Guindel , Arturo de la Escalera , Fernando García

Virtual testing is a crucial task to ensure safety in autonomous driving, and sensor simulation is an important task in this domain. Most current LiDAR simulations are very simplistic and are mainly used to perform initial tests, while the…

Computer Vision and Pattern Recognition · Computer Science 2022-08-08 Richard Marcus , Niklas Knoop , Bernhard Egger , Marc Stamminger

Deep learning models for self-driving cars require a diverse training dataset to manage critical driving scenarios on public roads safely. This includes having data from divergent trajectories, such as the oncoming traffic lane or…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Jonathan Schmidt , Qadeer Khan , Daniel Cremers

Properly-calibrated sensors are the prerequisite for a dependable autonomous driving system. However, most prior methods focus on extrinsic calibration between sensors, and few focus on the misalignment between the sensors and the vehicle…

Robotics · Computer Science 2023-05-19 Guohang Yan , Zhaotong Luo , Zhuochun Liu , Yikang Li

Autonomous navigation at high speeds in off-road environments necessitates robots to comprehensively understand their surroundings using onboard sensing only. The extreme conditions posed by the off-road setting can cause degraded camera…

Autonomous driving services rely heavily on sensors such as cameras, LiDAR, radar, and communication modules. A common practice of processing the sensed data is using a high-performance computing unit placed inside the vehicle, which…

Robotics · Computer Science 2025-05-22 Dewant Katare , Diego Perino , Jari Nurmi , Martijn Warnier , Marijn Janssen , Aaron Yi Ding

Scene completion and forecasting are two popular perception problems in research for mobile agents like autonomous vehicles. Existing approaches treat the two problems in isolation, resulting in a separate perception of the two aspects. In…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Xinhao Liu , Moonjun Gong , Qi Fang , Haoyu Xie , Yiming Li , Hang Zhao , Chen Feng

Autonomous driving in urban crowds at unregulated intersections is challenging, where dynamic occlusions and uncertain behaviors of other vehicles should be carefully considered. Traditional methods are heuristic and based on…

Robotics · Computer Science 2021-09-20 Peide Cai , Sukai Wang , Hengli Wang , Ming Liu

Lidar has become an essential sensor for autonomous driving as it provides reliable depth estimation. Lidar is also the primary sensor used in building 3D maps which can be used even in the case of low-cost systems which do not use Lidar.…

Computer Vision and Pattern Recognition · Computer Science 2019-07-08 B Ravi Kiran , Luis Roldão , Benat Irastorza , Renzo Verastegui , Sebastian Suss , Senthil Yogamani , Victor Talpaert , Alexandre Lepoutre , Guillaume Trehard

LiDAR sensors are widely used in autonomous driving due to the reliable 3D spatial information. However, the data of LiDAR is sparse and the frequency of LiDAR is lower than that of cameras. To generate denser point clouds spatially and…

Computer Vision and Pattern Recognition · Computer Science 2021-12-09 Xudong Huang , Chunyu Lin , Haojie Liu , Lang Nie , Yao Zhao

This work proposes a novel motion guided method for target-less self-calibration of a LiDAR and camera and use the re-projection of LiDAR points onto the image reference frame for real-time depth upsampling. The calibration parameters are…

Computer Vision and Pattern Recognition · Computer Science 2020-07-06 Juan Castorena , Gint Puskorius , Gaurav Pandey

Autonomous vehicles rely on a variety of sensors to gather information about their surrounding. The vehicle's behavior is planned based on the environment perception, making its reliability crucial for safety reasons. The active LiDAR…

Robotics · Computer Science 2023-06-07 Mariella Dreissig , Dominik Scheuble , Florian Piewak , Joschka Boedecker

Today's autonomous vehicles rely extensively on high-definition 3D maps to navigate the environment. While this approach works well when these maps are completely up-to-date, safe autonomous vehicles must be able to corroborate the map's…

Computer Vision and Pattern Recognition · Computer Science 2016-12-09 Ari Seff , Jianxiong Xiao

To assure that an autonomous car is driving safely on public roads, its object detection module should not only work correctly, but show its prediction confidence as well. Previous object detectors driven by deep learning do not explicitly…

Robotics · Computer Science 2018-09-10 Di Feng , Lars Rosenbaum , Klaus Dietmayer

We present a novel multi-modal extrinsic calibration framework designed to simultaneously estimate the relative poses between event cameras, LiDARs, and RGB cameras, with particular focus on the challenging event camera calibration. Core of…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Andrea Bertogalli , Giacomo Boracchi , Luca Magri

Autonomous vehicles rely heavily on sensors such as camera and LiDAR, which provide real-time information about their surroundings for the tasks of perception, planning and control. Typically a LiDAR can only provide sparse point cloud…

Image and Video Processing · Electrical Eng. & Systems 2020-07-07 Lin Bai , Yiming Zhao , Mahdi Elhousni , Xinming Huang