English
Related papers

Related papers: LiDAR-as-Camera for End-to-End Driving

200 papers

Robust road segmentation in all road conditions is required for safe autonomous driving and advanced driver assistance systems. Supervised deep learning methods provide accurate road segmentation in the domain of their training data but…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Eerik Alamikkotervo , Henrik Toikka , Kari Tammi , Risto Ojala

End-to-end autonomous driving is a fully differentiable machine learning system that takes raw sensor input data and other metadata as prior information and directly outputs the ego vehicle's control signals or planned trajectories. This…

Robotics · Computer Science 2023-12-01 Apoorv Singh

Perception technologies in Autonomous Driving are experiencing their golden age due to the advances in Deep Learning. Yet, most of these systems rely on the semantically rich information of RGB images. Deep Learning solutions applied to the…

Computer Vision and Pattern Recognition · Computer Science 2018-08-31 Victor Vaquero , Alberto Sanfeliu , Francesc Moreno-Noguer

Reliable operation in inclement weather is essential to the deployment of safe autonomous vehicles (AVs). Robustness and reliability can be achieved by fusing data from the standard AV sensor suite (i.e., lidars, cameras) with weather…

Robotics · Computer Science 2021-11-18 Emmett Wise , Juraj Peršić , Christopher Grebe , Ivan Petrović , Jonathan Kelly

In recent years, computer vision has transformed fields such as medical imaging, object recognition, and geospatial analytics. One of the fundamental tasks in computer vision is semantic image segmentation, which is vital for precise object…

Computer Vision and Pattern Recognition · Computer Science 2023-11-09 Dinar Sharafutdinov , Stanislav Kuskov , Saian Protasov , Alexey Voropaev

With the advent of autonomous vehicles, LiDAR and cameras have become an indispensable combination of sensors. They both provide rich and complementary data which can be used by various algorithms and machine learning to sense and make…

Robotics · Computer Science 2017-05-30 Ankit Dhall , Kunal Chelani , Vishnu Radhakrishnan , K. M. Krishna

Localization is an essential technique in mobile robotics. In a complex environment, it is necessary to fuse different localization modules to obtain more robust results, in which the error model plays a paramount role. However,…

Robotics · Computer Science 2020-03-31 Xiaoliang Ju , Donghao Xu , Huijing Zhao

Focusing on the task of point-to-point navigation for an autonomous driving vehicle, we propose a novel deep learning model trained with end-to-end and multi-task learning manners to perform both perception and control tasks simultaneously.…

Robotics · Computer Science 2022-06-23 Oskar Natan , Jun Miura

Cameras and LiDARs are both important sensors for autonomous driving, playing critical roles in 3D object detection. Camera-LiDAR Fusion has been a prevalent solution for robust and accurate driving perception. In contrast to the vast…

Robotics · Computer Science 2024-03-05 Ye Li , Hanjiang Hu , Zuxin Liu , Xiaohao Xu , Xiaonan Huang , Ding Zhao

Higher level functionality in autonomous driving depends strongly on a precise motion estimate of the vehicle. Powerful algorithms have been developed. However, their great majority focuses on either binocular imagery or pure LIDAR…

Robotics · Computer Science 2018-07-20 Johannes Graeter , Alexander Wilczynski , Martin Lauer

A safe and robust on-road navigation system is a crucial component of achieving fully automated vehicles. NVIDIA recently proposed an End-to-End algorithm that can directly learn steering commands from raw pixels of a front camera by using…

Computer Vision and Pattern Recognition · Computer Science 2018-12-20 Yilun Chen , Praveen Palanisamy , Priyantha Mudalige , Katharina Muelling , John M. Dolan

Current autonomous driving systems are composed of a perception system and a decision system. Both of them are divided into multiple subsystems built up with lots of human heuristics. An end-to-end approach might clean up the system and…

Computer Vision and Pattern Recognition · Computer Science 2020-10-12 Jianyu Chen , Zhuo Xu , Masayoshi Tomizuka

This work aims to address the challenges in autonomous driving by focusing on the 3D perception of the environment using roadside LiDARs. We design a 3D object detection model that can detect traffic participants in roadside LiDARs in…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Walter Zimmer , Jialong Wu , Xingcheng Zhou , Alois C. Knoll

Steering a car through traffic is a complex task that is difficult to cast into algorithms. Therefore, researchers turn to training artificial neural networks from front-facing camera data stream along with the associated steering angles.…

Machine Learning · Computer Science 2017-11-23 Hesham M. Eraqi , Mohamed N. Moustafa , Jens Honer

High-definition (HD) semantic map generation of the environment is an essential component of autonomous driving. Existing methods have achieved good performance in this task by fusing different sensor modalities, such as LiDAR and camera.…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Hao Dong , Weihao Gu , Xianjing Zhang , Jintao Xu , Rui Ai , Huimin Lu , Juho Kannala , Xieyuanli Chen

Autonomous robots that assist humans in day to day living tasks are becoming increasingly popular. Autonomous mobile robots operate by sensing and perceiving their surrounding environment to make accurate driving decisions. A combination of…

Computer Vision and Pattern Recognition · Computer Science 2018-08-24 Varuna De Silva , Jamie Roche , Ahmet Kondoz

Perception is a key element for enabling intelligent autonomous navigation. Understanding the semantics of the surrounding environment and accurate vehicle pose estimation are essential capabilities for autonomous vehicles, including…

Computer Vision and Pattern Recognition · Computer Science 2024-03-06 Mohamed Afifi , Mohamed ElHelw

Vehicle odometry is an essential component of an automated driving system as it computes the vehicle's position and orientation. The odometry module has a higher demand and impact in urban areas where the global navigation satellite system…

Robotics · Computer Science 2021-09-14 Nikhil Jonnavithula , Yecheng Lyu , Ziming Zhang

End-to-end autonomous driving systems promise stronger performance through unified optimization of perception, motion forecasting, and planning. However, vision-based approaches face fundamental limitations in adverse weather conditions,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Philipp Wolters , Johannes Gilg , Torben Teepe , Gerhard Rigoll

Self-driving vehicles have the potential to reduce accidents and fatalities on the road. Many production vehicles already come equipped with basic self-driving capabilities, but have trouble following lanes in adverse lighting and weather…

Robotics · Computer Science 2024-06-12 Michael Khalfin , Jack Volgren , Matthew Jones , Luke LeGoullon , Joshua Siegel , Chan-Jin Chung