English
Related papers

Related papers: Agile Autonomous Driving using End-to-End Deep Imi…

200 papers

Connected and Automated Hybrid Electric Vehicles have the potential to reduce fuel consumption and travel time in real-world driving conditions. The eco-driving problem seeks to design optimal speed and power usage profiles based upon…

Machine Learning · Computer Science 2022-02-01 Zhaoxuan Zhu , Nicola Pivaro , Shobhit Gupta , Abhishek Gupta , Marcello Canova

Most existing approaches to autonomous driving fall into one of two categories: modular pipelines, that build an extensive model of the environment, and imitation learning approaches, that map images directly to control outputs. A recently…

Robotics · Computer Science 2018-11-06 Axel Sauer , Nikolay Savinov , Andreas Geiger

This work presents an online learning-based control method for improved trajectory tracking of unmanned aerial vehicles using both deep learning and expert knowledge. The proposed method does not require the exact model of the system to be…

Robotics · Computer Science 2019-05-28 Andriy Sarabakha , Erdal Kayacan

Numerous groups have applied a variety of deep learning techniques to computer vision problems in highway perception scenarios. In this paper, we presented a number of empirical evaluations of recent deep learning advances. Computer vision,…

Autonomous micro-mobility platforms face challenges from the perspective of the typical deployment environment: large indoor spaces or urban areas that are potentially crowded and highly dynamic. While social navigation algorithms have…

Robotics · Computer Science 2025-11-10 Sahar Salimpour , Iacopo Catalano , Tomi Westerlund , Mohsen Falahi , Jorge Peña Queralta

The training of many existing end-to-end steering angle prediction models heavily relies on steering angles as the supervisory signal. Without learning from much richer contexts, these methods are susceptible to the presence of sharp road…

Computer Vision and Pattern Recognition · Computer Science 2018-11-08 Yuenan Hou , Zheng Ma , Chunxiao Liu , Chen Change Loy

Offline Reinforcement Learning (RL) addresses the problem of sequential decision-making by learning optimal policy through pre-collected data, without interacting with the environment. As yet, it has remained somewhat impractical, because…

Machine Learning · Computer Science 2024-10-07 Maksim Bobrin , Nazar Buzun , Dmitrii Krylov , Dmitry V. Dylov

Today's autonomous vehicles rely extensively on high-definition 3D maps to navigate the environment. While this approach works well when these maps are completely up-to-date, safe autonomous vehicles must be able to corroborate the map's…

Computer Vision and Pattern Recognition · Computer Science 2016-12-09 Ari Seff , Jianxiong Xiao

End-to-end autonomous driving has emerged as a compelling alternative to traditional modular pipelines by directly mapping raw sensor data to driving actions. While recent approaches achieve strong performance on single-domain datasets,…

Robotics · Computer Science 2026-05-20 Hoonhee Cho , Giwon Lee , Jae-Young Kang , Hyemin Yang , Heejun Park , Kuk-Jin Yoon

End-to-end trained neural networks (NNs) are a compelling approach to autonomous vehicle control because of their ability to learn complex tasks without manual engineering of rule-based decisions. However, challenging road conditions,…

Artificial Intelligence · Computer Science 2021-11-24 Alexander Amini , Ava Soleimany , Sertac Karaman , Daniela Rus

We present research using the latest reinforcement learning algorithm for end-to-end driving without any mediated perception (object recognition, scene understanding). The newly proposed reward and learning strategies lead together to…

Computer Vision and Pattern Recognition · Computer Science 2018-09-03 Maximilian Jaritz , Raoul de Charette , Marin Toromanoff , Etienne Perot , Fawzi Nashashibi

In this paper, we investigate the problem of enabling a drone to fly through a tilted narrow gap, without a traditional planning and control pipeline. To this end, we propose an end-to-end policy network, which imitates from the traditional…

Robotics · Computer Science 2019-08-06 Jiarong Lin , Luqi Wang , Fei Gao , Shaojie Shen , Fu Zhang

Recent works in end-to-end control for autonomous driving have investigated the use of vision-based exteroceptive perception. Inspired by such results, we propose a new end-to-end memory-based neural architecture for robot steering and…

Robotics · Computer Science 2022-05-25 Sergio Paniego Blanco , Sakshay Mahna , Utkarsh A. Mishra , JoseMaria Canas

In this work we propose a novel end-to-end imitation learning approach which combines natural language, vision, and motion information to produce an abstract representation of a task, which in turn is used to synthesize specific motion…

Robotics · Computer Science 2019-11-27 Simon Stepputtis , Joseph Campbell , Mariano Phielipp , Chitta Baral , Heni Ben Amor

Learning robust driving policies from large-scale, real-world datasets is a central challenge in autonomous driving, as online data collection is often unsafe and impractical. While Behavioral Cloning (BC) offers a straightforward approach…

Machine Learning · Computer Science 2025-08-28 Antonio Guillen-Perez

Autonomous offroad driving is essential for applications like emergency rescue, military operations, and agriculture. Despite progress, systems struggle with high-speed vehicles exceeding 10m/s due to the need for accurate long-range (>…

Robotics · Computer Science 2024-10-15 Eric Chen , Cherie Ho , Mukhtar Maulimov , Chen Wang , Sebastian Scherer

The common approach for local navigation on challenging environments with legged robots requires path planning, path following and locomotion, which usually requires a locomotion control policy that accurately tracks a commanded velocity.…

Robotics · Computer Science 2022-09-27 Nikita Rudin , David Hoeller , Marko Bjelonic , Marco Hutter

It is doubtful that animals have perfect inverse models of their limbs (e.g., what muscle contraction must be applied to every joint to reach a particular location in space). However, in robot control, moving an arm's end-effector to a…

Robotics · Computer Science 2022-09-19 Justus Huebotter , Serge Thill , Marcel van Gerven , Pablo Lanillos

This paper presents to the best of our knowledge the first end-to-end object tracking approach which directly maps from raw sensor input to object tracks in sensor space without requiring any feature engineering or system identification in…

Machine Learning · Computer Science 2016-03-10 Peter Ondruska , Ingmar Posner

Advanced sensors are a key to enable self-driving cars technology. Laser scanner sensors (LiDAR, Light Detection And Ranging) became a fundamental choice due to its long-range and robustness to low light driving conditions. The problem of…

Image and Video Processing · Electrical Eng. & Systems 2019-07-19 Khaled Elmadawi , Moemen Abdelrazek , Mohamed Elsobky , Hesham M. Eraqi , Mohamed Zahran