English
Related papers

Related papers: End to End Learning for Self-Driving Cars

200 papers

We introduce Ignition: an end-to-end neural network architecture for training unconstrained self-driving vehicles in simulated environments. The model is a ResNet-18 variant, which is fed in images from the front of a simulated F1 car, and…

Computer Vision and Pattern Recognition · Computer Science 2018-07-02 Rooz Mahdavian , Richard Diehl Martinez

End-to-end autonomous driving has drawn tremendous attention recently. Many works focus on using modular deep neural networks to construct the end-to-end archi-tecture. However, whether using powerful large language models (LLM), especially…

Computer Vision and Pattern Recognition · Computer Science 2025-09-04 Zilong Guo , Yi Luo , Long Sha , Dongxu Wang , Panqu Wang , Chenyang Xu , Yi Yang

Autonomous driving is of great interest to industry and academia alike. The use of machine learning approaches for autonomous driving has long been studied, but mostly in the context of perception. In this paper we take a deeper look on the…

Artificial Intelligence · Computer Science 2021-03-03 Ardi Tampuu , Maksym Semikin , Naveed Muhammad , Dmytro Fishman , Tambet Matiisen

Autonomous driving technology is progressing rapidly, largely due to complex End To End systems based on deep neural networks. While these systems are effective, their complexity can make it difficult to understand their behavior, raising…

Robotics · Computer Science 2024-12-24 Iqra Aslam , Igor Anpilogov , Andreas Rausch

This paper aims to investigate direct imitation learning from human drivers for the task of lane keeping assistance in highway and country roads using grayscale images from a single front view camera. The employed method utilizes…

Machine Learning · Computer Science 2017-09-13 Christopher Innocenti , Henrik Lindén , Ghazaleh Panahandeh , Lennart Svensson , Nasser Mohammadiha

Imitation learning for end-to-end autonomous driving has drawn attention from academic communities. Current methods either only use images as the input which is ambiguous when a car approaches an intersection, or use additional command…

Computer Vision and Pattern Recognition · Computer Science 2018-05-22 Qing Wang , Long Chen , Wei Tian

Autonomous systems require identifying the environment and it has a long way to go before putting it safely into practice. In autonomous driving systems, the detection of obstacles and traffic lights are of importance as well as lane…

Robotics · Computer Science 2021-06-30 Namig Aliyev , Oguzhan Sezer , Mehmet Turan Guzel

Deep learning is a fast-growing machine learning approach to perceive and understand large amounts of data. In this paper, general information about the deep learning approach which is attracted much attention in the field of machine…

Image and Video Processing · Electrical Eng. & Systems 2018-08-28 Çağrı Kaymak , Ayşegül Uçar

In this paper we propose a number of tested ways in which a low-budget demo car could be made to navigate an indoor environment. Canny Edge Detection, Supervised Floor Detection and Imitation Learning were used separately and are contrasted…

Robotics · Computer Science 2020-11-30 Michael Muratov , Sachkiran Kaur , Michael Szpakowicz

We present a novel approach to modern car control utilizing a combination of Deep Convolutional Neural Networks and Long Short-Term Memory Systems: Both of which are a subsection of Hierarchical Representations Learning, more commonly known…

Robotics · Computer Science 2018-07-24 Surya Dantuluri

Classifying and counting vehicles in road traffic has numerous applications in the transportation engineering domain. However, the wide variety of vehicles (two-wheelers, three-wheelers, cars, buses, trucks etc.) plying on roads of…

Computer Vision and Pattern Recognition · Computer Science 2019-01-21 Mayank Singh Chauhan , Arshdeep Singh , Mansi Khemka , Arneish Prateek , Rijurekha Sen

Imitation learning is a promising approach to end-to-end training of autonomous vehicle controllers. Typically the driving process with such approaches is entirely automatic and black-box, although in practice it is desirable to control the…

Robotics · Computer Science 2020-11-23 Renhao Wang , Adam Scibior , Frank Wood

A map, as crucial information for downstream applications of an autonomous driving system, is usually represented in lanelines or centerlines. However, existing literature on map learning primarily focuses on either detecting geometry-based…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Tianyu Li , Peijin Jia , Bangjun Wang , Li Chen , Kun Jiang , Junchi Yan , Hongyang Li

Autonomous driving is a challenging topic that requires complex solutions in perception tasks such as recognition of road, lanes, traffic signs or lights, vehicles and pedestrians. Through years of research, computer vision has grown…

Computer Vision and Pattern Recognition · Computer Science 2016-07-05 Eduardo Romera , Luis M. Bergasa , Roberto Arroyo

Autonomous driving is a challenging task that has gained broad attention from both academia and industry. Current solutions using convolutional neural networks require large amounts of computational resources, leading to high power…

Computer Vision and Pattern Recognition · Computer Science 2025-02-12 Xuelei Chen , Sotirios Spanogianopoulos

Latency-accuracy tradeoffs are fundamental in real-time applications of deep neural networks (DNNs) for cyber-physical systems. In autonomous driving, in particular, safety depends on both prediction quality and the end-to-end delay from…

Robotics · Computer Science 2026-05-29 Qitao Weng , Heechul Yun

This study aims to improve the performance and generalization capability of end-to-end autonomous driving with scene understanding leveraging deep learning and multimodal sensor fusion techniques. The designed end-to-end deep neural network…

Robotics · Computer Science 2020-08-04 Zhiyu Huang , Chen Lv , Yang Xing , Jingda Wu

Policy search methods can allow robots to learn control policies for a wide range of tasks, but practical applications of policy search often require hand-engineered components for perception, state estimation, and low-level control. In…

Machine Learning · Computer Science 2016-04-20 Sergey Levine , Chelsea Finn , Trevor Darrell , Pieter Abbeel

End-to-end trained neural networks (NNs) are a compelling approach to autonomous vehicle control because of their ability to learn complex tasks without manual engineering of rule-based decisions. However, challenging road conditions,…

Artificial Intelligence · Computer Science 2021-11-24 Alexander Amini , Ava Soleimany , Sertac Karaman , Daniela Rus

Over recent years, deep learning-based computer vision systems have been applied to images at an ever-increasing pace, oftentimes representing the only type of consumption for those images. Given the dramatic explosion in the number of…

Computer Vision and Pattern Recognition · Computer Science 2021-08-31 Nam Le , Honglei Zhang , Francesco Cricri , Ramin Ghaznavi-Youvalari , Esa Rahtu