English
Related papers

Related papers: End to End Vehicle Lateral Control Using a Single …

200 papers

End-to-end (E2E) autonomous driving models that take only camera images as input and directly predict a future trajectory are appealing for their computational efficiency and potential for improved generalization via unified optimization;…

Robotics · Computer Science 2026-04-10 Chihiro Noguchi , Takaki Yamamoto

We present an end-to-end imitation learning system for agile, off-road autonomous driving using only low-cost sensors. By imitating a model predictive controller equipped with advanced sensors, we train a deep neural network control policy…

Robotics · Computer Science 2019-08-12 Yunpeng Pan , Ching-An Cheng , Kamil Saigol , Keuntaek Lee , Xinyan Yan , Evangelos Theodorou , Byron Boots

End-to-end trained neural networks (NNs) are a compelling approach to autonomous vehicle control because of their ability to learn complex tasks without manual engineering of rule-based decisions. However, challenging road conditions,…

Artificial Intelligence · Computer Science 2021-11-24 Alexander Amini , Ava Soleimany , Sertac Karaman , Daniela Rus

The development in the field of autonomous driving goes hand in hand with ever new developments in the field of image processing and machine learning methods. In order to fully exploit the advantages of deep learning, it is necessary to…

Computer Vision and Pattern Recognition · Computer Science 2020-11-12 Tobias Scheck , Adarsh Mallandur , Christian Wiede , Gangolf Hirtz

A safe and robust on-road navigation system is a crucial component of achieving fully automated vehicles. NVIDIA recently proposed an End-to-End algorithm that can directly learn steering commands from raw pixels of a front camera by using…

Computer Vision and Pattern Recognition · Computer Science 2018-12-20 Yilun Chen , Praveen Palanisamy , Priyantha Mudalige , Katharina Muelling , John M. Dolan

Cameras are a crucial exteroceptive sensor for self-driving cars as they are low-cost and small, provide appearance information about the environment, and work in various weather conditions. They can be used for multiple purposes such as…

Computer Vision and Pattern Recognition · Computer Science 2017-09-01 Christian Häne , Lionel Heng , Gim Hee Lee , Friedrich Fraundorfer , Paul Furgale , Torsten Sattler , Marc Pollefeys

Autonomous vehicle (AV) stacks have traditionally relied on decomposed approaches, with separate modules handling perception, prediction, and planning. However, this design introduces information loss during inter-module communication,…

End-to-end autonomous driving methods aim to directly map raw sensor inputs to future driving actions such as planned trajectories, bypassing traditional modular pipelines. While these approaches have shown promise, they often operate under…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Bozhou Zhang , Nan Song , Jingyu Li , Xiatian Zhu , Jiankang Deng , Li Zhang

In this work, we consider the problem of learning end to end perception to control for ground vehicles solely from aerial imagery. Photogrammetric simulators allow the synthesis of novel views through the transformation of pre-generated…

Robotics · Computer Science 2024-10-21 Varun Murali , Guy Rosman , Sertac Karaman , Daniela Rus

Safety-critical corner cases, difficult to collect in the real world, are crucial for evaluating end-to-end autonomous driving. Adversarial interaction is an effective method to generate such safety-critical corner cases. While existing…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Jiaheng Geng , Jiatong Du , Xinyu Zhang , Ye Li , Panqu Wang , Yanjun Huang

Autonomous driving presents many challenges due to the large number of scenarios the autonomous vehicle (AV) may encounter. End-to-end deep learning models are comparatively simplistic models that can handle a broad set of scenarios.…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Zhongying CuiZhu , Francois Charette , Amin Ghafourian , Debo Shi , Matthew Cui , Anjali Krishnamachar , Iman Soltani

Autonomous driving is challenging in adverse road and weather conditions in which there might not be lane lines, the road might be covered in snow and the visibility might be poor. We extend the previous work on end-to-end learning for…

Computer Vision and Pattern Recognition · Computer Science 2021-06-30 Jyri Maanpää , Josef Taher , Petri Manninen , Leo Pakola , Iaroslav Melekhov , Juha Hyyppä

The core task of any autonomous driving system is to transform sensory inputs into driving commands. In end-to-end driving, this is achieved via a neural network, with one or multiple cameras as the most commonly used input and low-level…

Artificial Intelligence · Computer Science 2022-07-01 Ardi Tampuu , Romet Aidla , Jan Are van Gent , Tambet Matiisen

This paper proposes an efficient autonomous valet parking system utilizing only cameras which are the most widely used sensor. To capture more information instantaneously and respond rapidly to changes in the surrounding environment,…

Computer Vision and Pattern Recognition · Computer Science 2021-04-28 Young Gon Jo , Seok Hyeon Hong , Sung Soo Hwang , Jeong Mok Ha

Autonomous race cars require perception, estimation, planning, and control modules which work together asynchronously while driving at the limit of a vehicle's handling capability. A fundamental challenge encountered in designing these…

Robotics · Computer Science 2020-11-17 Achin Jain , Matthew O'Kelly , Pratik Chaudhari , Manfred Morari

In recent years, autonomous driving algorithms using low-cost vehicle-mounted cameras have attracted increasing endeavors from both academia and industry. There are multiple fronts to these endeavors, including object detection on roads,…

Computer Vision and Pattern Recognition · Computer Science 2017-08-15 Lu Chi , Yadong Mu

Machine learning models, which are frequently used in self-driving cars, are trained by matching the captured images of the road and the measured angle of the steering wheel. The angle of the steering wheel is generally fetched from…

Computer Vision and Pattern Recognition · Computer Science 2019-01-31 Kemal Alkin Gunbay , Mert Arikan , Mehmet Turkan

In this paper, we provide a survey on automotive surround-view fisheye optics, with an emphasis on the impact of optical artifacts on computer vision tasks in autonomous driving and ADAS. The automotive industry has advanced in applying…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Daniel Jakab , Brian Michael Deegan , Sushil Sharma , Eoin Martino Grua , Jonathan Horgan , Enda Ward , Pepijn Van De Ven , Anthony Scanlan , Ciarán Eising

We propose an image based end-to-end learning framework that helps lane-change decisions for human drivers and autonomous vehicles. The proposed system, Safe Lane-Change Aid Network (SLCAN), trains a deep convolutional neural network to…

Computer Vision and Pattern Recognition · Computer Science 2017-06-27 Seong-Gyun Jeong , Jiwon Kim , Sujung Kim , Jaesik Min

The hype around self-driving cars has been growing over the past years and has sparked much research. Several modules in self-driving cars are thoroughly investigated to ensure safety, comfort, and efficiency, among which the controller is…

Robotics · Computer Science 2024-10-17 Jilan Samiuddin , Benoit Boulet , Di Wu