English
Related papers

Related papers: Explaining Autonomous Driving by Learning End-to-E…

200 papers

Deep Neural Networks (DNNs) which are trained end-to-end have been successfully applied to solve complex problems that we have not been able to solve in past decades. Autonomous driving is one of the most complex problems which is yet to be…

Deep networks trained on demonstrations of human driving have learned to follow roads and avoid obstacles. However, driving policies trained via imitation learning cannot be controlled at test time. A vehicle trained end-to-end to imitate…

Robotics · Computer Science 2018-03-05 Felipe Codevilla , Matthias Müller , Antonio López , Vladlen Koltun , Alexey Dosovitskiy

Human drivers produce a vast amount of data which could, in principle, be used to improve autonomous driving systems. Unfortunately, seemingly straightforward approaches for creating end-to-end driving models that map sensor data directly…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Yi Xiao , Felipe Codevilla , Christopher Pal , Antonio M. Lopez

Autonomous driving systems need to handle complex scenarios such as lane following, avoiding collisions, taking turns, and responding to traffic signals. In recent years, approaches based on end-to-end behavioral cloning have demonstrated…

Robotics · Computer Science 2021-04-23 Keishi Ishihara , Anssi Kanervisto , Jun Miura , Ville Hautamäki

Tactical decision making and strategic motion planning for autonomous highway driving are challenging due to the complication of predicting other road users' behaviors, diversity of environments, and complexity of the traffic interactions.…

Robotics · Computer Science 2020-11-30 Majid Moghadam , Ali Alizadeh , Engin Tekin , Gabriel Hugh Elkaim

Precise parking requires an end-to-end system where perception adaptively provides policy-relevant details - especially in critical areas where fine control decisions are essential. End-to-end learning offers a unified framework by directly…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Chao Chen , Shunyu Yao , Yuanwu He , Feng Tao , Ruojing Song , Yuliang Guo , Xinyu Huang , Chenxu Wu , Liu Ren , Chen Feng

Autonomous driving is of great interest to industry and academia alike. The use of machine learning approaches for autonomous driving has long been studied, but mostly in the context of perception. In this paper we take a deeper look on the…

Artificial Intelligence · Computer Science 2021-03-03 Ardi Tampuu , Maksym Semikin , Naveed Muhammad , Dmytro Fishman , Tambet Matiisen

Learning to drive faithfully in highly stochastic urban settings remains an open problem. To that end, we propose a Multi-task Learning from Demonstration (MT-LfD) framework which uses supervised auxiliary task prediction to guide the main…

Machine Learning · Computer Science 2018-08-31 Ashish Mehta , Adithya Subramanian , Anbumani Subramanian

The challenges presented in an autonomous racing situation are distinct from those faced in regular autonomous driving and require faster end-to-end algorithms and consideration of a longer horizon in determining optimal current actions…

Robotics · Computer Science 2021-12-01 Praveen Venkatesh , Rwik Rana , Harish PM

Fully autonomous driving has been widely studied and is becoming increasingly feasible. However, such autonomous driving has yet to be achieved on public roads, because of various uncertainties due to surrounding human drivers and…

Robotics · Computer Science 2023-05-19 Shunsuke Aoki , Issei Yamamoto , Daiki Shiotsuka , Yuichi Inoue , Kento Tokuhiro , Keita Miwa

In recent years, autonomous driving algorithms using low-cost vehicle-mounted cameras have attracted increasing endeavors from both academia and industry. There are multiple fronts to these endeavors, including object detection on roads,…

Computer Vision and Pattern Recognition · Computer Science 2017-08-15 Lu Chi , Yadong Mu

While learning visuomotor skills in an end-to-end manner is appealing, deep neural networks are often uninterpretable and fail in surprising ways. For robotics tasks, such as autonomous driving, models that explicitly represent objects may…

Artificial Intelligence · Computer Science 2019-03-04 Dequan Wang , Coline Devin , Qi-Zhi Cai , Fisher Yu , Trevor Darrell

Autonomous driving in multi-agent dynamic traffic scenarios is challenging: the behaviors of road users are uncertain and are hard to model explicitly, and the ego-vehicle should apply complicated negotiation skills with them, such as…

Robotics · Computer Science 2022-06-22 Peide Cai , Hengli Wang , Yuxiang Sun , Ming Liu

End-to-end autonomous driving aims to build a fully differentiable system that takes raw sensor data as inputs and directly outputs the planned trajectory or control signals of the ego vehicle. State-of-the-art methods usually follow the…

Robotics · Computer Science 2023-08-29 Xiaosong Jia , Yulu Gao , Li Chen , Junchi Yan , Patrick Langechuan Liu , Hongyang Li

Deep learning-based models are widely deployed in autonomous driving areas, especially the increasingly noticed end-to-end solutions. However, the black-box property of these models raises concerns about their trustworthiness and safety for…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Jiankun Li , Hao Li , Jiangjiang Liu , Zhikang Zou , Xiaoqing Ye , Fan Wang , Jizhou Huang , Hua Wu , Haifeng Wang

This research aims to explore the application of deep learning in autonomous driving computer vision technology and its impact on improving system performance. By using advanced technologies such as convolutional neural networks (CNN),…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Jingyu Zhang , Jin Cao , Jinghao Chang , Xinjin Li , Houze Liu , Zhenglin Li

This paper investigates how end-to-end driving models can be improved to drive more accurately and human-like. To tackle the first issue we exploit semantic and visual maps from HERE Technologies and augment the existing Drive360 dataset…

Computer Vision and Pattern Recognition · Computer Science 2020-07-15 Simon Hecker , Dengxin Dai , Alexander Liniger , Luc Van Gool

With the advent of universal function approximators in the domain of reinforcement learning, the number of practical applications leveraging deep reinforcement learning (DRL) has exploded. Decision-making in autonomous vehicles (AVs) has…

Robotics · Computer Science 2024-06-14 Hanxi Wan , Pei Li , Arpan Kusari

In the field of Autonomous Driving, the system controlling the vehicle can be seen as an agent acting in a complex environment and thus naturally fits into the modern framework of Reinforcement Learning. However, learning to drive can be a…

Artificial Intelligence · Computer Science 2018-11-26 Patrick Klose , Rudolf Mester

Navigating through intersections is one of the main challenging tasks for an autonomous vehicle. However, for the majority of intersections regulated by traffic lights, the problem could be solved by a simple rule-based method in which the…

Robotics · Computer Science 2021-05-04 Alessandro Paolo Capasso , Paolo Maramotti , Anthony Dell'Eva , Alberto Broggi