English
Related papers

Related papers: Bench2Drive: Towards Multi-Ability Benchmarking of…

200 papers

Modern autonomous driving systems are typically divided into three main tasks: perception, prediction, and planning. The planning task involves predicting the trajectory of the ego vehicle based on inputs from both internal intention and…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Jiang-Tian Zhai , Ze Feng , Jinhao Du , Yongqiang Mao , Jiang-Jiang Liu , Zichang Tan , Yifu Zhang , Xiaoqing Ye , Jingdong Wang

Focusing on the task of point-to-point navigation for an autonomous driving vehicle, we propose a novel deep learning model trained with end-to-end and multi-task learning manners to perform both perception and control tasks simultaneously.…

Robotics · Computer Science 2022-06-23 Oskar Natan , Jun Miura

End-to-end (E2E) autonomous driving (AD) models require diverse, high-quality data to perform well across various driving scenarios. However, collecting large-scale real-world data is expensive and time-consuming, making high-fidelity…

Robotics · Computer Science 2025-03-25 Junhao Ge , Zuhong Liu , Longteng Fan , Yifan Jiang , Jiaqi Su , Yiming Li , Zhejun Zhang , Siheng Chen

This paper presents a pioneering exploration into the integration of fine-grained human supervision within the autonomous driving domain to enhance system performance. The current advances in End-to-End autonomous driving normally are…

Robotics · Computer Science 2024-08-21 Yiqun Duan , Zhuoli Zhuang , Jinzhao Zhou , Yu-Cheng Chang , Yu-Kai Wang , Chin-Teng Lin

Human drivers adeptly navigate complex scenarios by utilizing rich attentional semantics, but the current autonomous systems struggle to replicate this ability, as they often lose critical semantic information when converting 2D…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Pei Liu , Haipeng Liu , Haichao Liu , Xin Liu , Jinxin Ni , Jun Ma

Vision-language models (VLMs) enhance the planning capability of end-to-end (E2E) driving policy by leveraging high-level semantic reasoning. However, existing approaches often overlook the dual-system consistency between VLM's high-level…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Yuehao Song , Shaoyu Chen , Hao Gao , Yifan Zhu , Weixiang Yue , Jialv Zou , Bo Jiang , Zihao Lu , Yu Wang , Qian Zhang , Xinggang Wang

With the advancement of deep learning technology, data-driven methods are increasingly used in the decision-making of autonomous driving, and the quality of datasets greatly influenced the model performance. Although current datasets have…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Zehong Ke , Yanbo Jiang , Yuning Wang , Hao Cheng , Jinhao Li , Jianqiang Wang

Safety-critical corner cases, difficult to collect in the real world, are crucial for evaluating end-to-end autonomous driving. Adversarial interaction is an effective method to generate such safety-critical corner cases. While existing…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Jiaheng Geng , Jiatong Du , Xinyu Zhang , Ye Li , Panqu Wang , Yanjun Huang

Deploying reinforcement learning policies trained in simulation to real autonomous vehicles remains a fundamental challenge, particularly for VLM-guided RL frameworks whose policies are typically learned with simulator-native observations…

Robotics · Computer Science 2026-04-07 Zilin Huang , Zhengyang Wan , Zihao Sheng , Boyue Wang , Junwei You , Yue Leng , Sikai Chen

We present an overview of recently developed data-driven tools for safety analysis of autonomous vehicles and advanced driver assist systems. The core algorithms combine model-based, hybrid system reachability analysis with sensitivity…

Systems and Control · Computer Science 2017-04-24 Chuchu Fan , Bolun Qi , Sayan Mitra

In recent years, vision-based end-to-end autonomous driving has emerged as a new paradigm. However, popular end-to-end approaches typically rely on visual feature extraction networks trained under label supervision. This limited supervision…

Robotics · Computer Science 2025-11-04 Ling Niu , Xiaoji Zheng , Han Wang , Chen Zheng , Ziyuan Yang , Bokui Chen , Jiangtao Gong

End-to-end autonomous driving has advanced significantly, offering benefits such as system simplicity and stronger driving performance in both open-loop and closed-loop settings than conventional pipelines. However, existing frameworks…

Robotics · Computer Science 2025-06-04 Wei Liu , Jiyuan Zhang , Binxiong Zheng , Yufeng Hu , Yingzhan Lin , Zengfeng Zeng

Recent advancements in deep learning and the availability of high-quality real-world driving datasets have propelled end-to-end autonomous driving. Despite this progress, relying solely on real-world data limits the variety of driving…

Robotics · Computer Science 2025-10-29 Jongsuk Kim , Jaeyoung Lee , Gyojin Han , Dongjae Lee , Minki Jeong , Junmo Kim

Simulators can generate virtually unlimited driving data, yet imitation learning policies in simulation still struggle to achieve robust closed-loop performance. Motivated by this gap, we empirically study how misalignment between…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Long Nguyen , Micha Fauth , Bernhard Jaeger , Daniel Dauner , Maximilian Igl , Andreas Geiger , Kashyap Chitta

End-to-End autonomous driving (E2E-AD) systems face challenges in lifelong learning, including catastrophic forgetting, difficulty in knowledge transfer across diverse scenarios, and spurious correlations between unobservable confounders…

Machine Learning · Computer Science 2026-03-31 Jiayuan Du , Yuebing Song , Yiming Zhao , Xianghui Pan , Jiawei Lian , Yuchu Lu , Liuyi Wang , Chengju Liu , Qijun Chen

Most recent work in autonomous driving has prioritized benchmark performance and methodological innovation over in-depth analysis of model failures, biases, and shortcut learning. This has led to incremental improvements without a deep…

Robotics · Computer Science 2025-11-11 Simon Gerstenecker , Andreas Geiger , Katrin Renz

V2X cooperation, through the integration of sensor data from both vehicles and infrastructure, is considered a pivotal approach to advancing autonomous driving technology. Current research primarily focuses on enhancing perception accuracy,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-08 Zhiwei Li , Bozhen Zhang , Lei Yang , Tianyu Shen , Nuo Xu , Ruosen Hao , Weiting Li , Tao Yan , Huaping Liu

End-to-End Autonomous Driving (E2E-AD) systems are typically grouped by the nature of their outputs: (i) waypoint-based models that predict a future trajectory, and (ii) action-based models that directly output throttle, steer and brake.…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Jorge Daniel Rodríguez-Vidal , Gabriel Villalonga , Diego Porres , Antonio M. López Peña

In the field of autonomous driving, end-to-end deep learning models show great potential by learning driving decisions directly from sensor data. However, training these models requires large amounts of labeled data, which is time-consuming…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Wenhao Jiang , Duo Li , Menghan Hu , Chao Ma , Ke Wang , Zhipeng Zhang

End-to-end (E2E) autonomous driving methods still struggle to make correct decisions in interactive closed-loop evaluation due to limited causal reasoning capability. Current methods attempt to leverage the powerful understanding and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Haoyu Fu , Diankun Zhang , Zongchuang Zhao , Jianfeng Cui , Dingkang Liang , Chong Zhang , Dingyuan Zhang , Hongwei Xie , Bing Wang , Xiang Bai