English
Related papers

Related papers: End-to-end sensor modeling for LiDAR Point Cloud

200 papers

End-to-end autonomous driving is a fully differentiable machine learning system that takes raw sensor input data and other metadata as prior information and directly outputs the ego vehicle's control signals or planned trajectories. This…

Robotics · Computer Science 2023-12-01 Apoorv Singh

For an autonomous vehicle, the ability to sense its surroundings and to build an overall representation of the environment by fusing different sensor data streams is fundamental. To this end, the poses of all sensors need to be accurately…

Robotics · Computer Science 2022-11-07 Brahayam Ponton , Magda Ferri , Lars Koenig , Marcus Bartels

Autonomous vehicles are equipped with a multi-modal sensor setup to enable the car to drive safely. The initial calibration of such perception sensors is a highly matured topic and is routinely done in an automated factory environment.…

Computer Vision and Pattern Recognition · Computer Science 2023-05-01 Arya Rachman , Jürgen Seiler , André Kaup

Over the past few years, there has been remarkable progress in research on 3D point clouds and their use in autonomous driving scenarios has become widespread. However, deep learning methods heavily rely on annotated data and often face…

Computer Vision and Pattern Recognition · Computer Science 2024-03-06 Jin Fang , Dingfu Zhou , Jingjing Zhao , Chenming Wu , Chulin Tang , Cheng-Zhong Xu , Liangjun Zhang

Focusing on the task of point-to-point navigation for an autonomous driving vehicle, we propose a novel deep learning model trained with end-to-end and multi-task learning manners to perform both perception and control tasks simultaneously.…

Robotics · Computer Science 2022-06-23 Oskar Natan , Jun Miura

In this paper we propose a real-time, calibration-agnostic and effective localization system for self-driving cars. Our method learns to embed the online LiDAR sweeps and intensity map into a joint deep embedding space. Localization is then…

Computer Vision and Pattern Recognition · Computer Science 2020-12-22 Ioan Andrei Bârsan , Shenlong Wang , Andrei Pokrovsky , Raquel Urtasun

Current deep learning based autonomous driving approaches yield impressive results also leading to in-production deployment in certain controlled scenarios. One of the most popular and fascinating approaches relies on learning vehicle…

Computer Vision and Pattern Recognition · Computer Science 2020-06-08 Luca Cultrera , Lorenzo Seidenari , Federico Becattini , Pietro Pala , Alberto Del Bimbo

In recent years, considerable progress has been made towards a vehicle's ability to operate autonomously. An end-to-end approach attempts to achieve autonomous driving using a single, comprehensive software component. Recent breakthroughs…

Robotics · Computer Science 2019-05-17 Hege Haavaldsen , Max Aasboe , Frank Lindseth

LiDAR sensors are a key modality for 3D perception, yet they are typically designed independently of downstream tasks such as point cloud registration. Conventional registration operates on pre-acquired datasets with fixed LiDAR…

Computer Vision and Pattern Recognition · Computer Science 2026-02-12 Siddhant Katyan , Marc-André Gardner , Jean-François Lalonde

In this paper, we present a novel end-to-end deep neural network model for autonomous driving that takes monocular image sequence as input, and directly generates the steering control angle. Firstly, we model the end-to-end driving problem…

Robotics · Computer Science 2021-03-11 Peng Wan , Zhenbo Song , Jianfeng Lu

Radar is a key component of the suite of perception sensors used for safe and reliable navigation of autonomous vehicles. Its unique capabilities include high-resolution velocity imaging, detection of agents in occlusion and over long…

Computer Vision and Pattern Recognition · Computer Science 2023-09-29 Arvind Srivastav , Soumyajit Mandal

Perception and localization are essential for autonomous delivery vehicles, mostly estimated from 3D LiDAR sensors due to their precise distance measurement capability. This paper presents a strategy to obtain the real-time pseudo point…

Computer Vision and Pattern Recognition · Computer Science 2022-05-18 Sabir Hossain , Xianke Lin

Due to its robust and precise distance measurements, LiDAR plays an important role in scene understanding for autonomous driving. Training deep neural networks (DNNs) on LiDAR data requires large-scale point-wise annotations, which are…

Computer Vision and Pattern Recognition · Computer Science 2021-02-24 Sicheng Zhao , Yezhen Wang , Bo Li , Bichen Wu , Yang Gao , Pengfei Xu , Trevor Darrell , Kurt Keutzer

We present an end-to-end imitation learning system for agile, off-road autonomous driving using only low-cost sensors. By imitating a model predictive controller equipped with advanced sensors, we train a deep neural network control policy…

Robotics · Computer Science 2019-08-12 Yunpeng Pan , Ching-An Cheng , Kamil Saigol , Keuntaek Lee , Xinyan Yan , Evangelos Theodorou , Byron Boots

We tackle the problem of producing realistic simulations of LiDAR point clouds, the sensor of preference for most self-driving vehicles. We argue that, by leveraging real data, we can simulate the complex world more realistically compared…

Computer Vision and Pattern Recognition · Computer Science 2020-06-17 Sivabalan Manivasagam , Shenlong Wang , Kelvin Wong , Wenyuan Zeng , Mikita Sazanovich , Shuhan Tan , Bin Yang , Wei-Chiu Ma , Raquel Urtasun

In recent studies, numerous previous works emphasize the importance of semantic segmentation of LiDAR data as a critical component to the development of driver-assistance systems and autonomous vehicles. However, many state-of-the-art…

Self-driving vehicles have the potential to reduce accidents and fatalities on the road. Many production vehicles already come equipped with basic self-driving capabilities, but have trouble following lanes in adverse lighting and weather…

Robotics · Computer Science 2024-06-12 Michael Khalfin , Jack Volgren , Matthew Jones , Luke LeGoullon , Joshua Siegel , Chan-Jin Chung

In Autonomous Driving (AD), detection and tracking of obstacles on the roads is a critical task. Deep-learning based methods using annotated LiDAR data have been the most widely adopted approach for this. Unfortunately, annotating 3D point…

Computer Vision and Pattern Recognition · Computer Science 2021-07-02 Jin Fang , Dingfu Zhou , Feilong Yan , Tongtong Zhao , Feihu Zhang , Yu Ma , Liang Wang , Ruigang Yang

This study aims to improve the performance and generalization capability of end-to-end autonomous driving with scene understanding leveraging deep learning and multimodal sensor fusion techniques. The designed end-to-end deep neural network…

Robotics · Computer Science 2020-08-04 Zhiyu Huang , Chen Lv , Yang Xing , Jingda Wu

One key vertical application that will be enabled by 6G is the automation of the processes with the increased use of robots. As a result, sensing and localization of the surrounding environment becomes a crucial factor for these robots to…

Signal Processing · Electrical Eng. & Systems 2021-02-23 Madhushanka Padmal , Dileepa Marasinghe , Vijitha Isuru , Nalin Jayaweera , Samad Ali , Nandana Rajatheva