English
Related papers

Related papers: Explaining Autonomous Driving by Learning End-to-E…

200 papers

Robust and efficient learning remains a challenging problem in robotics, in particular with complex visual inputs. Inspired by human attention mechanism, with which we quickly process complex visual scenes and react to changes in the…

Robotics · Computer Science 2023-08-30 Daniel Scheuchenstuhl , Stefan Ulmer , Felix Resch , Luigi Berducci , Radu Grosu

Autonomous driving involves complex decision-making in highly interactive environments, requiring thoughtful negotiation with other traffic participants. While reinforcement learning provides a way to learn such interaction behavior,…

Robotics · Computer Science 2023-08-16 Raphael Trumpp , Martin Büchner , Abhinav Valada , Marco Caccamo

There are two main algorithmic approaches to autonomous driving systems: (1) An end-to-end system in which a single deep neural network learns to map sensory input directly into appropriate warning and driving responses. (2) A mediated…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Kyongsik Yun , Thomas Lu , Alexander Huyen , Patrick Hammer , Pei Wang

Autonomous driving systems require a deep understanding of human driving behaviors to achieve higher intelligence and safety.Despite advancements in deep learning, challenges such as long-tail distribution due to scarce samples and…

Artificial Intelligence · Computer Science 2025-03-19 Yilin Wang

Despite the advent of autonomous cars, it's likely - at least in the near future - that human attention will still maintain a central role as a guarantee in terms of legal responsibility during the driving task. In this paper we study the…

Computer Vision and Pattern Recognition · Computer Science 2017-05-10 Andrea Palazzi , Francesco Solera , Simone Calderara , Stefano Alletto , Rita Cucchiara

Deep learning and computer vision techniques have become increasingly important in the development of self-driving cars. These techniques play a crucial role in enabling self-driving cars to perceive and understand their surroundings,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Kanishkha Jaisankar , Pranav M. Pawar , Diana Susane Joseph , Raja Muthalagu , Mithun Mukherjee

Vehicle taillight recognition is an important application for automated driving, especially for intent prediction of ado vehicles and trajectory planning of the ego vehicle. In this work, we propose an end-to-end deep learning framework to…

Computer Vision and Pattern Recognition · Computer Science 2019-06-11 Kuan-Hui Lee , Takaaki Tagawa , Jia-En M. Pan , Adrien Gaidon , Bertrand Douillard

Overtaking on two-lane roads is a great challenge for autonomous vehicles, as oncoming traffic appearing on the opposite lane may require the vehicle to change its decision and abort the overtaking. Deep reinforcement learning (DRL) has…

Robotics · Computer Science 2023-08-21 Jinxiong Lu , Gokhan Alcan , Ville Kyrki

Modeling driver behavior provides several advantages in the automotive industry, including prediction of electric vehicle energy consumption. Studies have shown that aggressive driving can consume up to 30% more energy than moderate…

Machine Learning · Computer Science 2024-05-24 Federica Comuni , Christopher Mészáros , Niklas Åkerblom , Morteza Haghir Chehreghani

Urban autonomous driving is an open and challenging problem to solve as the decision-making system has to account for several dynamic factors like multi-agent interactions, diverse scene perceptions, complex road geometries, and other…

Artificial Intelligence · Computer Science 2021-08-30 Arjit Sharma , Sahil Sharma

Simulation-to-simulation and simulation-to-real world transfer of neural network models have been a difficult problem. To close the reality gap, prior methods to simulation-to-real world transfer focused on domain adaptation, decoupling…

Machine Learning · Computer Science 2020-01-06 Sahika Genc , Sunil Mallya , Sravan Bodapati , Tao Sun , Yunzhe Tao

Attention mechanism is effective in both focusing the deep learning models on relevant features and interpreting them. However, attentions may be unreliable since the networks that generate them are often trained in a weakly-supervised…

Machine Learning · Statistics 2020-06-11 Jay Heo , Hae Beom Lee , Saehoon Kim , Juho Lee , Kwang Joon Kim , Eunho Yang , Sung Ju Hwang

Highly automated driving requires precise models of traffic participants. Many state of the art models are currently based on machine learning techniques. Among others, the required amount of labeled data is one major challenge. An…

Artificial Intelligence · Computer Science 2018-03-12 Maarten Bieshaar , Günther Reitberger , Viktor Kreß , Stefan Zernetsch , Konrad Doll , Erich Fuchs , Bernhard Sick

Active vision is inherently attention-driven: The agent actively selects views to attend in order to fast achieve the vision task while improving its internal representation of the scene being observed. Inspired by the recent success of…

Computer Vision and Pattern Recognition · Computer Science 2022-01-12 Min Liu , Yifei Shi , Lintao Zheng , Kai Xu , Hui Huang , Dinesh Manocha

Although numerous recent tracking approaches have made tremendous advances in the last decade, achieving high-performance visual tracking remains a challenge. In this paper, we propose an end-to-end network model to learn reinforced…

Computer Vision and Pattern Recognition · Computer Science 2020-01-03 Peng Gao , Qiquan Zhang , Fei Wang , Liyi Xiao , Hamido Fujita , Yan Zhang

Despite impressive advancements in Autonomous Driving Systems (ADS), navigation in complex road conditions remains a challenging problem. There is considerable evidence that evaluating the subjective risk level of various decisions can…

Computer Vision and Pattern Recognition · Computer Science 2020-09-15 Shih-Yuan Yu , Arnav V. Malawade , Deepan Muthirayan , Pramod P. Khargonekar , Mohammad A. Al Faruque

End-to-end driving systems have made rapid progress, but have so far not been applied to the challenging new CARLA Leaderboard 2.0. Further, while there is a large body of literature on end-to-end architectures and training strategies, the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-16 Julian Zimmerlin , Jens Beißwenger , Bernhard Jaeger , Andreas Geiger , Kashyap Chitta

The primary focus of autonomous driving research is to improve driving accuracy. While great progress has been made, state-of-the-art algorithms still fail at times. Such failures may have catastrophic consequences. It therefore is…

Computer Vision and Pattern Recognition · Computer Science 2018-05-07 Simon Hecker , Dengxin Dai , Luc Van Gool

Recent applications of deep learning to navigation have generated end-to-end navigation solutions whereby visual sensor input is mapped to control signals or to motion primitives. The resulting visual navigation strategies work very well at…

Robotics · Computer Science 2018-01-17 Justin S. Smith , Jin-Ha Hwang , Fu-Jen Chu , Patricio A. Vela

Our research investigates the challenges Deep Reinforcement Learning (DRL) faces in complex, Partially Observable Markov Decision Processes (POMDP) such as autonomous driving (AD), and proposes a solution for vision-based navigation in…

Computer Vision and Pattern Recognition · Computer Science 2024-09-18 Shawan Mohammed , Alp Argun , Nicolas Bonnotte , Gerd Ascheid