English
Related papers

Related papers: LEAD: Minimizing Learner-Expert Asymmetry in End-t…

200 papers

End-to-end planning systems for autonomous driving are rapidly improving, especially in closed-loop simulation environments like CARLA. Many such driving systems either do not consider uncertainty as part of the plan itself or obtain it by…

Robotics · Computer Science 2026-05-25 Florian Wintel , Sigmund H. Høeg , Gabriel Kiss , Frank Lindseth

Current autonomous driving (AD) simulations are critically limited by their inadequate representation of realistic and diverse human behavior, which is essential for ensuring safety and reliability. Existing benchmarks often simplify…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Mohan Ramesh , Mark Azer , Fabian B. Flohr

We present an integrated approach for perception and control for an autonomous vehicle and demonstrate this approach in a high-fidelity urban driving simulator. Our approach first builds a model for the environment, then trains a policy…

Systems and Control · Electrical Eng. & Systems 2020-03-19 Ali Baheri , Ilya Kolmanovsky , Anouck Girard , H. Eric Tseng , Dimitar Filev

With the rise of vision-language models (VLM), their application for autonomous driving (VLM4AD) has gained significant attention. Meanwhile, in autonomous driving, closed-loop evaluation has become widely recognized as a more reliable…

Robotics · Computer Science 2026-04-03 Xiaosong Jia , Yuqian Shao , Zhenjie Yang , Qifeng Li , Zhiyuan Zhang , Junchi Yan

Sidewalk micromobility is a promising solution for last-mile transportation, but current learning-based control methods struggle in complex urban environments. Imitation learning (IL) learns policies from human demonstrations, yet its…

Robotics · Computer Science 2026-03-25 Honglin He , Yukai Ma , Brad Squicciarini , Wayne Wu , Bolei Zhou

The development of Autonomous Driving (AD) systems in simulated environments like CARLA is crucial for advancing real-world automotive technologies. To drive innovation, CARLA introduced Leaderboard 2.0, significantly more challenging than…

Robotics · Computer Science 2024-06-13 Daniel Coelho , Miguel Oliveira , Vitor Santos , Antonio M. Lopez

In recent years, imitation learning (IL) has been widely used in industry as the core of autonomous vehicle (AV) planning modules. However, previous IL works show sample inefficiency and low generalisation in safety-critical scenarios, on…

Robotics · Computer Science 2023-04-04 Yurui Du , Flavia Sofia Acerbo , Jens Kober , Tong Duy Son

Imitation learning trains control policies by mimicking pre-recorded expert demonstrations. In partially observable settings, imitation policies must rely on observation histories, but many seemingly paradoxical results show better…

Machine Learning · Computer Science 2021-06-14 Chuan Wen , Jierui Lin , Jianing Qian , Yang Gao , Dinesh Jayaraman

In autonomous driving, the end-to-end (E2E) driving approach that predicts vehicle control signals directly from sensor data is rapidly gaining attention. To learn a safe E2E driving system, one needs an extensive amount of driving data and…

Robotics · Computer Science 2025-05-12 Jin Bok Park , Jinkyu Lee , Muhyun Back , Hyunmin Han , David T. Ma , Sang Min Won , Sung Soo Hwang , Il Yong Chun

This paper presents a safe imitation learning approach for autonomous vehicle driving, with attention on real-life human driving data and experimental validation. In order to increase occupant's acceptance and gain drivers' trust, the…

Systems and Control · Electrical Eng. & Systems 2021-10-11 Flavia Sofia Acerbo , Mohsen Alirezaei , Herman Van der Auweraer , Tong Duy Son

We introduce DreamerAD, the first latent world model framework that enables efficient reinforcement learning for autonomous driving by compressing diffusion sampling from 100 steps to 1 - achieving 80x speedup while maintaining visual…

End to end (E2E) autonomous driving trajectory prediction is often trained with camera frames sampled at the highest available temporal frequency, assuming that denser sampling improves performance. We question this assumption by treating…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Yumao Liu , Tao Liu , Xiangyu Li , Jiaxiang Li , Ke Ma

Imitation learning (IL) is a simple and powerful way to use high-quality human driving data, which can be collected at scale, to produce human-like behavior. However, policies based on imitation learning alone often fail to sufficiently…

End-to-end (E2E) models in autonomous driving aim to directly map sensor inputs to control commands, but their ability to generalize to novel and complex scenarios remains a key challenge. The common practice of fully fine-tuning the vision…

Computer Vision and Pattern Recognition · Computer Science 2026-01-08 Zeyu Dong , Yimin Zhu , Yu Wu , Yu Sun

End-to-end Transformers have demonstrated an impressive success rate for Embodied Instruction Following when the environment has been seen in training. However, they tend to struggle when deployed in an unseen environment. This lack of…

Computation and Language · Computer Science 2023-10-20 Cheng-Fu Yang , Yen-Chun Chen , Jianwei Yang , Xiyang Dai , Lu Yuan , Yu-Chiang Frank Wang , Kai-Wei Chang

Learning robot policies using imitation learning requires collecting large amounts of costly action-labeled expert demonstrations, which fundamentally limits the scale of training data. A promising approach to address this bottleneck is to…

Robotics · Computer Science 2025-05-12 Anthony Liang , Pavel Czempin , Matthew Hong , Yutai Zhou , Erdem Biyik , Stephen Tu

Planning is a critical component of end-to-end autonomous driving. However, prevailing imitation learning methods often suffer from mode collapse, failing to produce diverse trajectory hypotheses. Meanwhile, existing generative approaches…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Lin Liu , Guanyi Yu , Ziying Song , Junqiao Li , Caiyan Jia , Feiyang Jia , Peiliang Wu , Yandan Luo

The role of simulation in autonomous driving is becoming increasingly important due to the need for rapid prototyping and extensive testing. The use of physics-based simulation involves multiple benefits and advantages at a reasonable cost…

On end-to-end driving, human driving demonstrations are used to train perception-based driving models by imitation learning. This process is supervised on vehicle signals (e.g., steering angle, acceleration) but does not require extra…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Yi Xiao , Felipe Codevilla , Diego Porres , Antonio M. Lopez

Generative diffusion models for end-to-end autonomous driving often suffer from mode collapse, tending to generate conservative and homogeneous behaviors. While DiffusionDrive employs predefined anchors representing different driving…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Jialv Zou , Shaoyu Chen , Bencheng Liao , Zhiyu Zheng , Yuehao Song , Lefei Zhang , Qian Zhang , Wenyu Liu , Xinggang Wang