English
Related papers

Related papers: The NVIDIA PilotNet Experiments

200 papers

Predicting driver intentions is a difficult and crucial task for advanced driver assistance systems. Traditional confidence measures on predictions often ignore the way predicted trajectories affect downstream decisions for safe driving. In…

The main control tasks in autonomous vehicles are steering (lateral) and speed (longitudinal) control. PID controllers are widely used in the industry because of their simplicity and good performance, but they are difficult to tune and need…

Optimization and Control · Mathematics 2025-09-23 Yassine Kebbati , Naima Ait-Oufroukh , Vincent Vigneron , Dalil Ichalal , Dominique Gruyer

Recent success suggests that deep neural control networks are likely to be a key component of self-driving vehicles. These networks are trained on large datasets to imitate human actions, but they lack semantic understanding of image…

Computer Vision and Pattern Recognition · Computer Science 2019-11-19 Jinkyu Kim , Teruhisa Misu , Yi-Ting Chen , Ashish Tawari , John Canny

This paper describes the evolution of controllers for racing a simulated radio-controlled car around a track, modelled on a real physical track. Five different controller architectures were compared, based on neural networks, force fields…

Neural and Evolutionary Computing · Computer Science 2007-05-23 Julian Togelius , Simon M. Lucas

This paper explores the capability of deep neural networks to capture key characteristics of vehicle dynamics, and their ability to perform coupled longitudinal and lateral control of a vehicle. To this extent, two different artificial…

Machine Learning · Computer Science 2018-10-23 Guillaume Devineau , Philip Polack , Florent Altché , Fabien Moutarde

Among several road hazards that are present in any paved way in the world, potholes are one of the most annoying and also involving higher maintenance costs. There exists an increasing interest on the automated detection of these hazards…

Computer Vision and Pattern Recognition · Computer Science 2021-05-19 J. Javier Yebes , David Montero , Ignacio Arriola

Deep convolutional neural networks (CNNs) have been shown to perform extremely well at a variety of tasks including subtasks of autonomous driving such as image segmentation and object classification. However, networks designed for these…

Computer Vision and Pattern Recognition · Computer Science 2017-11-21 Yiqi Hou , Sascha Hornauer , Karl Zipser

Autonomous vehicles are increasingly introduced into our lives. Yet, people's misunderstanding and mistrust have become the major obstacles to the use of these technologies. In response to this problem, proper work must be done to increase…

Human-Computer Interaction · Computer Science 2023-02-20 Zhijie Qiao , Xiatao Sun , Helen Loeb , Rahul Mangharam

Little innovation has been made to low-level attitude flight control used by uncrewed aerial vehicles (UAVs), which still predominantly uses the classical PID controller. In this work we introduce Neuroflight, the first open source…

Robotics · Computer Science 2019-09-18 William Koch , Renato Mancuso , Azer Bestavros

The advancement of autonomous driving systems hinges on the ability to achieve low-latency and high-accuracy perception. To address this critical need, this paper introduces Dynamic Routing Network (DyRoNet), a low-rank enhanced dynamic…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Xiang Huang , Zhi-Qi Cheng , Jun-Yan He , Chenyang Li , Wangmeng Xiang , Baigui Sun

Driving in dynamically changing traffic is a highly challenging task for autonomous vehicles, especially in crowded urban roadways. The Artificial Intelligence (AI) system of a driverless car must be able to arbitrate between different…

Artificial Intelligence · Computer Science 2019-11-11 Bogdan Trasnea , Claudiu Pozna , Sorin Grigorescu

Traditional path-planning techniques treat humans as obstacles. This has changed since robots started to enter human environments. On modern robots, social navigation has become an important aspect of navigation systems. To use…

Robotics · Computer Science 2024-04-18 Yigit Yildirim , Emre Ugur

In this work, we aim to predict the future motion of vehicles in a traffic scene by explicitly modeling their pairwise interactions. Specifically, we propose a graph neural network that jointly predicts the discrete interaction modes and…

Machine Learning · Statistics 2019-12-18 Donsuk Lee , Yiming Gu , Jerrick Hoang , Micol Marchetti-Bowick

Automated vehicles' neural networks suffer from overfit, poor generalizability, and untrained edge cases due to limited data availability. Researchers synthesize randomized edge-case scenarios to assist in the training process, though…

Machine Learning · Computer Science 2023-07-27 Piyush Gupta , Demetris Coleman , Joshua E. Siegel

Deep neural networks (DNNs) are increasingly used in safety-critical autonomous systems as perception components processing high-dimensional image data. Formal analysis of these systems is particularly challenging due to the complexity of…

Computer Vision and Pattern Recognition · Computer Science 2023-02-13 Corina S. Pasareanu , Ravi Mangal , Divya Gopinath , Sinem Getir Yaman , Calum Imrie , Radu Calinescu , Huafeng Yu

Prior research has demonstrated the effectiveness of end-to-end deep learning for robotic navigation, where the control signals are directly derived from raw sensory data. However, the majority of existing end-to-end navigation solutions…

Robotics · Computer Science 2024-10-11 Mohammed Misbah Zarrar , Qitao Weng , Bakhbyergyen Yerjan , Ahmet Soyyigit , Heechul Yun

This paper explores the emerging knowledge-driven autonomous driving technologies. Our investigation highlights the limitations of current autonomous driving systems, in particular their sensitivity to data bias, difficulty in handling…

This research project presents the implementation of a Deep Q-Learning Network (DQN) for a self-driving car on a 2-dimensional (2D) custom track, with the objective of enhancing the DQN network's performance. It encompasses the development…

Artificial Intelligence · Computer Science 2026-04-17 Sagar Pathak , Bidhya Shrestha

Modern autonomous driving algorithms often rely on learning the mapping from visual inputs to steering actions from human driving data in a variety of scenarios and visual scenes. The required data collection is not only labor intensive,…

Robotics · Computer Science 2018-03-20 Sascha Hornauer , Karl Zipser , Stella X. Yu

Cooperative autonomous driving plays a pivotal role in improving road capacity and safety within intelligent transportation systems, particularly through the deployment of autonomous vehicles on urban streets. By enabling vehicle-to-vehicle…

Robotics · Computer Science 2023-12-13 Ahmed Abdelrahman , Omar M. Shehata , Yarah Basyoni , Elsayed I. Morgan