English
Related papers

Related papers: Safer End-to-End Autonomous Driving via Conditiona…

200 papers

Current autonomous driving systems are composed of a perception system and a decision system. Both of them are divided into multiple subsystems built up with lots of human heuristics. An end-to-end approach might clean up the system and…

Computer Vision and Pattern Recognition · Computer Science 2020-10-12 Jianyu Chen , Zhuo Xu , Masayoshi Tomizuka

To ensure user acceptance of autonomous vehicles (AVs), control systems are being developed to mimic human drivers from demonstrations of desired driving behaviors. Imitation learning (IL) algorithms serve this purpose, but struggle to…

Robotics · Computer Science 2022-06-27 Flavia Sofia Acerbo , Jan Swevers , Tinne Tuytelaars , Tong Duy Son

Most existing approaches to autonomous driving fall into one of two categories: modular pipelines, that build an extensive model of the environment, and imitation learning approaches, that map images directly to control outputs. A recently…

Robotics · Computer Science 2018-11-06 Axel Sauer , Nikolay Savinov , Andreas Geiger

Trustworthy AI is mandatory for the broad deployment of autonomous vehicles. Although end-to-end approaches derive control commands directly from raw data, interpreting these decisions remains challenging, especially in complex urban…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Mona Mirzaie , Bodo Rosenhahn

In this paper we present a complete study of an end-to-end imitation learning system for speed control of a real car, based on a neural network with a Long Short Term Memory (LSTM). To achieve robustness and generalization from expert…

Computer Vision and Pattern Recognition · Computer Science 2018-12-17 Laurent George , Thibault Buhet , Emilie Wirbel , Gaetan Le-Gall , Xavier Perrotton

In this work, we propose a method for learning driver models that account for variables that cannot be observed directly. When trained on a synthetic dataset, our models are able to learn encodings for vehicle trajectories that distinguish…

Machine Learning · Computer Science 2017-04-20 Jeremy Morton , Mykel J. Kochenderfer

Imitation learning (IL) is a learning paradigm which can be used to synthesize controllers for complex systems that mimic behavior demonstrated by an expert (user or control algorithm). Despite their popularity, IL methods generally lack…

Systems and Control · Electrical Eng. & Systems 2022-12-23 Ryan K. Cosner , Yisong Yue , Aaron D. Ames

Imitation learning is a powerful approach for learning autonomous driving policy by leveraging data from expert driver demonstrations. However, driving policies trained via imitation learning that neglect the causal structure of expert…

Obstacle avoidance is a fundamental vision-based task essential for enabling quadrotors to perform advanced applications. When planning the trajectory, existing approaches both on optimization and learning typically regard quadrotor as a…

Robotics · Computer Science 2026-04-17 Fanxing Li , Shengyang Wang , Yuxiang Huang , Fangyu Sun , Shuyu Wu , Yufei Yan , Danping Zou , Wenxian Yu

In contemporary autonomous driving testing, virtual simulation has become an important approach due to its efficiency and cost effectiveness. However, existing methods usually rely on reinforcement learning to generate risky scenarios,…

Robotics · Computer Science 2026-03-24 Chen Xiong , Cheng Wang , Yuhang Liu , Zirui Wu , Ye Tian

End-to-end vision-based imitation learning has demonstrated promising results in autonomous driving by learning control commands directly from expert demonstrations. However, traditional approaches rely on either regressionbased models,…

Robotics · Computer Science 2025-03-04 Elahe Delavari , Aws Khalil , Jaerock Kwon

Vision-based end-to-end driving models trained by imitation learning can lead to affordable solutions for autonomous driving. However, training these well-performing models usually requires a huge amount of data, while still lacking…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Diego Porres , Yi Xiao , Gabriel Villalonga , Alexandre Levy , Antonio M. López

The utilization of Large Language Models (LLMs) within the realm of reinforcement learning, particularly as planners, has garnered a significant degree of attention in recent scholarly literature. However, a substantial proportion of…

Robotics · Computer Science 2024-07-30 Yiqun Duan , Qiang Zhang , Renjing Xu

Success in racing requires a unique combination of vehicle setup, understanding of the racetrack, and human expertise. Since building and testing many different vehicle configurations in the real world is prohibitively expensive,…

Robotics · Computer Science 2024-12-06 John Subosits , Jenna Lee , Shawn Manuel , Paul Tylkin , Avinash Balachandran

The use of neural networks and reinforcement learning has become increasingly popular in autonomous vehicle control. However, the opaqueness of the resulting control policies presents a significant barrier to deploying neural network-based…

Machine Learning · Computer Science 2021-03-18 Sampo Kuutti , Richard Bowden , Saber Fallah

We propose the use of latent space generative world models to address the covariate shift problem in autonomous driving. A world model is a neural network capable of predicting an agent's next state given past states and actions. By…

For safe and efficient planning and control in autonomous driving, we need a driving policy which can achieve desirable driving quality in long-term horizon with guaranteed safety and feasibility. Optimization-based approaches, such as…

Artificial Intelligence · Computer Science 2017-07-11 Liting Sun , Cheng Peng , Wei Zhan , Masayoshi Tomizuka

In recent years, great efforts have been devoted to deep imitation learning for autonomous driving control, where raw sensory inputs are directly mapped to control actions. However, navigating through densely populated intersections remains…

Robotics · Computer Science 2022-02-22 Zeyu Zhu , Huijing Zhao

This paper presents a novel approach to Autonomous Vehicle (AV) control through the application of active inference, a theory derived from neuroscience that conceptualizes the brain as a predictive machine. Traditional autonomous driving…

Robotics · Computer Science 2025-03-17 Elahe Delavari , John Moore , Junho Hong , Jaerock Kwon

Imitation learning is becoming more and more successful for autonomous driving. End-to-end (raw signal to command) performs well on relatively simple tasks (lane keeping and navigation). Mid-to-mid (environment abstraction to mid-level…

Artificial Intelligence · Computer Science 2019-09-04 Thibault Buhet , Emilie Wirbel , Xavier Perrotton