English
Related papers

Related papers: Learning On-Road Visual Control for Self-Driving V…

200 papers

Current autonomous driving systems are composed of a perception system and a decision system. Both of them are divided into multiple subsystems built up with lots of human heuristics. An end-to-end approach might clean up the system and…

Computer Vision and Pattern Recognition · Computer Science 2020-10-12 Jianyu Chen , Zhuo Xu , Masayoshi Tomizuka

Today's autonomous vehicles rely extensively on high-definition 3D maps to navigate the environment. While this approach works well when these maps are completely up-to-date, safe autonomous vehicles must be able to corroborate the map's…

Computer Vision and Pattern Recognition · Computer Science 2016-12-09 Ari Seff , Jianxiong Xiao

Autonomous driving technology is progressing rapidly, largely due to complex End To End systems based on deep neural networks. While these systems are effective, their complexity can make it difficult to understand their behavior, raising…

Robotics · Computer Science 2024-12-24 Iqra Aslam , Igor Anpilogov , Andreas Rausch

A promising approach to autonomous driving is machine learning. In such systems, training datasets are created that capture the sensory input to a vehicle as well as the desired response. A disadvantage of using a learned navigation system…

Robotics · Computer Science 2016-06-28 Artem Provodin , Liila Torabi , Beat Flepp , Yann LeCun , Michael Sergio , L. D. Jackel , Urs Muller , Jure Zbontar

In recent years, autonomous driving algorithms using low-cost vehicle-mounted cameras have attracted increasing endeavors from both academia and industry. There are multiple fronts to these endeavors, including object detection on roads,…

Computer Vision and Pattern Recognition · Computer Science 2017-08-15 Lu Chi , Yadong Mu

This work focuses on the design of a deep learning-based autonomous driving system deployed and tested on the real-world MIT Racecar to assess its effectiveness in driving scenarios. The Deep Neural Network (DNN) translates raw image inputs…

Robotics · Computer Science 2025-04-29 Hidayet Ersin Dursun , Yusuf Güven , Tufan Kumbasar

Deep Neural Networks (DNNs) which are trained end-to-end have been successfully applied to solve complex problems that we have not been able to solve in past decades. Autonomous driving is one of the most complex problems which is yet to be…

Multi-task convolutional neural networks (CNNs) have shown impressive results for certain combinations of tasks, such as single-image depth estimation (SIDE) and semantic segmentation. This is achieved by pushing the network towards…

Computer Vision and Pattern Recognition · Computer Science 2018-11-05 Lukas Liebel , Marco Körner

This work explores the feasibility of steering a drone with a (recurrent) neural network, based on input from a forward looking camera, in the context of a high-level navigation task. We set up a generic framework for training a network to…

Computer Vision and Pattern Recognition · Computer Science 2017-02-27 Klaas Kelchtermans , Tinne Tuytelaars

As part of a complete software stack for autonomous driving, NVIDIA has created a neural-network-based system, known as PilotNet, which outputs steering angles given images of the road ahead. PilotNet is trained using road images paired…

Computer Vision and Pattern Recognition · Computer Science 2017-04-27 Mariusz Bojarski , Philip Yeres , Anna Choromanska , Krzysztof Choromanski , Bernhard Firner , Lawrence Jackel , Urs Muller

In autonomous driving, navigation through unsignaled intersections with many traffic participants moving around is a challenging task. To provide a solution to this problem, we propose a novel branched network G-CIL for the navigation…

Robotics · Computer Science 2021-02-02 Xiaodong Mei , Yuxiang Sun , Yuying Chen , Congcong Liu , Ming Liu

We present a control approach for autonomous vehicles based on deep reinforcement learning. A neural network agent is trained to map its estimated state to acceleration and steering commands given the objective of reaching a specific target…

Robotics · Computer Science 2020-03-16 Andreas Folkers , Matthias Rick , Christof Büskens

Fully autonomous driving has been widely studied and is becoming increasingly feasible. However, such autonomous driving has yet to be achieved on public roads, because of various uncertainties due to surrounding human drivers and…

Robotics · Computer Science 2023-05-19 Shunsuke Aoki , Issei Yamamoto , Daiki Shiotsuka , Yuichi Inoue , Kento Tokuhiro , Keita Miwa

Traditional methods for autonomous driving are implemented with many building blocks from perception, planning and control, making them difficult to generalize to varied scenarios due to complex assumptions and interdependencies. Recently,…

Computer Vision and Pattern Recognition · Computer Science 2020-11-03 Peide Cai , Yuxiang Sun , Hengli Wang , Ming Liu

A novel hierarchical Deep Neural Network (DNN) model is presented to address the task of end-to-end driving. The model consists of a master classifier network which determines the driving task required from an input stereo image and directs…

Machine Learning · Computer Science 2020-12-03 Jose Solomon , Francois Charette

Imitation learning is a promising approach to end-to-end training of autonomous vehicle controllers. Typically the driving process with such approaches is entirely automatic and black-box, although in practice it is desirable to control the…

Robotics · Computer Science 2020-11-23 Renhao Wang , Adam Scibior , Frank Wood

Current deep learning based autonomous driving approaches yield impressive results also leading to in-production deployment in certain controlled scenarios. One of the most popular and fascinating approaches relies on learning vehicle…

Computer Vision and Pattern Recognition · Computer Science 2020-06-08 Luca Cultrera , Lorenzo Seidenari , Federico Becattini , Pietro Pala , Alberto Del Bimbo

Obstacle avoidance is crucial for mobile robots' navigation in both known and unknown environments. This research designs, trains, and tests two custom Convolutional Neural Networks (CNNs), using color and depth images from a depth camera…

Robotics · Computer Science 2025-07-14 Lamiaa H. Zain , Hossam H. Ammar , Raafat E. Shalaby

Vehicle taillight recognition is an important application for automated driving, especially for intent prediction of ado vehicles and trajectory planning of the ego vehicle. In this work, we propose an end-to-end deep learning framework to…

Computer Vision and Pattern Recognition · Computer Science 2019-06-11 Kuan-Hui Lee , Takaaki Tagawa , Jia-En M. Pan , Adrien Gaidon , Bertrand Douillard

Collaborative navigation becomes essential in situations of occluded scenarios in autonomous driving where independent driving policies are likely to lead to collisions. One promising approach to address this issue is through the use of…

Robotics · Computer Science 2024-12-12 Leandro Parada , Hanlin Tian , Jose Escribano , Panagiotis Angeloudis