English
Related papers

Related papers: Bench2Drive: Towards Multi-Ability Benchmarking of…

200 papers

Autonomous driving remains a highly active research domain that seeks to enable vehicles to perceive dynamic environments, predict the future trajectories of traffic agents such as vehicles, pedestrians, and cyclists and plan safe and…

Owing to the merits of early safety and reliability guarantee, autonomous driving virtual testing has recently gains increasing attention compared with closed-loop testing in real scenarios. Although the availability and quality of…

Robotics · Computer Science 2021-07-01 Pengliang Ji , Li Ruan , Yunzhi Xue , Limin Xiao , Qian Dong

Autonomous driving policies are typically trained via open-loop behavior cloning of human demonstrations. However, such policies suffer from covariate shift when deployed in closed loop, leading to compounding errors. We introduce Rollouts…

The tremendous hype around autonomous driving is eagerly calling for emerging and novel technologies to support advanced mobility use cases. As car manufactures keep developing SAE level 3+ systems to improve the safety and comfort of…

Vision-Language Models (VLMs) have demonstrated significant potential for end-to-end autonomous driving. However, the field still lacks a practical platform that enables dynamic model updates, rapid validation, fair comparison, and…

Robotics · Computer Science 2025-09-16 Zhijie Qiao , Haowei Li , Zhong Cao , Henry X. Liu

End-to-end (E2E) autonomous driving systems offer a promising alternative to traditional modular pipelines by reducing information loss and error accumulation, with significant potential to enhance both mobility and safety. However, most…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Ke Guo , Haochen Liu , Xiaojun Wu , Jia Pan , Chen Lv

Safe and scalable deployment of end-to-end (E2E) autonomous driving requires extensive and diverse data, particularly safety-critical events. Existing data are mostly generated from simulators with a significant sim-to-real gap or collected…

Robotics · Computer Science 2025-09-18 Jiawei Wang , Haowei Sun , Xintao Yan , Shuo Feng , Jun Gao , Henry X. Liu

Recent advances in Vision-Language-Action (VLA) models have shown promising capabilities in autonomous driving by leveraging the understanding and reasoning strengths of Large Language Models(LLMs).However, our empirical analysis reveals…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Zihan You , Hongwei Liu , Chenxu Dang , Zhe Wang , Sining Ang , Aoqi Wang , Yan Wang

We formulate long-context language modeling as a problem in continual learning rather than architecture design. Under this formulation, we only use a standard architecture -- a Transformer with sliding-window attention. However, our model…

Since the advent of Multimodal Large Language Models (MLLMs), they have made a significant impact across a wide range of real-world applications, particularly in Autonomous Driving (AD). Their ability to process complex visual data and…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Shuo Xing , Chengyuan Qian , Yuping Wang , Hongyuan Hua , Kexin Tian , Yang Zhou , Zhengzhong Tu

To ensure safe autonomous driving in urban environments with complex vehicle-pedestrian interactions, it is critical for Autonomous Vehicles (AVs) to have the ability to predict pedestrians' short-term and immediate actions in real-time. In…

Robotics · Computer Science 2023-05-23 Jia Huang , Alvika Gautam , Srikanth Saripalli

In end-to-end autonomous driving,the motion prediction plays a pivotal role in ego-vehicle planning. However, existing methods often rely on globally aggregated motion features, ignoring the fact that planning decisions are primarily…

Artificial Intelligence · Computer Science 2026-05-12 Bin Sun , Boao Zhang , Jiayi Lu , Xinjie Feng , Jiachen Shang , Rui Cao , Mengchao Zheng , Chuanye Wang , Shichun Yang , Yaoguang Cao , Ziying Song

Multi-modal end-to-end autonomous driving has shown promising advancements in recent work. By embedding more modalities into end-to-end networks, the system's understanding of both static and dynamic aspects of the driving environment is…

Robotics · Computer Science 2025-05-15 Ziang Guo , Xinhao Lin , Zakhar Yagudin , Artem Lykov , Yong Wang , Yanqiang Li , Dzmitry Tsetserukou

Current autonomous driving (AD) simulations are critically limited by their inadequate representation of realistic and diverse human behavior, which is essential for ensuring safety and reliability. Existing benchmarks often simplify…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Mohan Ramesh , Mark Azer , Fabian B. Flohr

The recent advancements in wireless technology enable connected autonomous vehicles (CAVs) to gather data via vehicle-to-vehicle (V2V) communication, such as processed LIDAR and camera data from other vehicles. In this work, we design an…

Robotics · Computer Science 2023-02-16 Songyang Han , Shanglin Zhou , Lynn Pepin , Jiangwei Wang , Caiwen Ding , Fei Miao

Multimodal image fusion and object detection are crucial for autonomous driving. While current methods have advanced the fusion of texture details and semantic information, their complex training processes hinder broader applications.…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Jiaqing Zhang , Mingxiang Cao , Weiying Xie , Jie Lei , Daixun Li , Wenbo Huang , Yunsong Li , Xue Yang

Most autonomous driving safety benchmarks use time-to-collision (TTC) to assess risk and guide safe behaviour. However, TTC-based methods treat risk as a one-dimensional closing problem, despite the inherently two-dimensional nature of…

Autonomous vehicles must be comprehensively evaluated before deployed in cities and highways. However, most existing evaluation approaches for autonomous vehicles are static and lack adaptability, so they are usually inefficient in…

Robotics · Computer Science 2020-11-25 Baiming Chen , Xiang Chen , Wu Qiong , Liang Li

Autonomous car racing is a challenging task, as it requires precise applications of control while the vehicle is operating at cornering speeds. Traditional autonomous pipelines require accurate pre-mapping, localization, and planning which…

Robotics · Computer Science 2023-03-07 Dvij Kalaria , Qin Lin , John M. Dolan

Precise parking requires an end-to-end system where perception adaptively provides policy-relevant details - especially in critical areas where fine control decisions are essential. End-to-end learning offers a unified framework by directly…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Chao Chen , Shunyu Yao , Yuanwu He , Feng Tao , Ruojing Song , Yuliang Guo , Xinyu Huang , Chenxu Wu , Liu Ren , Chen Feng