English
Related papers

Related papers: Bench2Drive: Towards Multi-Ability Benchmarking of…

200 papers

The aspiration of the next generation's autonomous driving (AD) technology relies on the dedicated integration and interaction among intelligent perception, prediction, planning, and low-level control. There has been a huge bottleneck…

Robotics · Computer Science 2024-01-29 Lincan Li , Wei Shao , Wei Dong , Yijun Tian , Qiming Zhang , Kaixiang Yang , Wenjie Zhang

Vehicles equipped with automated driving capabilities have shown potential to improve safety and operations. Advanced driver assistance systems (ADAS) and automated driving systems (ADS) have been widely developed to support vehicular…

Applications · Statistics 2024-10-15 Shengxuan Ding , Mohamed Abdel-Aty , Natalia Barbour , Dongdong Wang , Zijin Wang , Ou Zheng

While recent developments in autonomous vehicle (AV) technology highlight substantial progress, we lack tools for rigorous and scalable testing. Real-world testing, the $\textit{de facto}$ evaluation environment, places the public in…

Machine Learning · Computer Science 2019-01-15 Matthew O'Kelly , Aman Sinha , Hongseok Namkoong , John Duchi , Russ Tedrake

The challenges presented in an autonomous racing situation are distinct from those faced in regular autonomous driving and require faster end-to-end algorithms and consideration of a longer horizon in determining optimal current actions…

Robotics · Computer Science 2021-12-01 Praveen Venkatesh , Rwik Rana , Harish PM

We present a flow-matching planner for autonomous driving that directly outputs actionable control trajectories defined by acceleration and curvature profiles. The model is conditioned on a bird's-eye-view (BEV) raster of the surrounding…

End-to-end autonomous driving, which directly maps raw sensor inputs to low-level vehicle controls, is an important part of Embodied AI. Despite successes in applying Multimodal Large Language Models (MLLMs) for high-level traffic scene…

Computer Vision and Pattern Recognition · Computer Science 2025-02-24 Rui Zhao , Qirui Yuan , Jinyu Li , Haofeng Hu , Yun Li , Chengyuan Zheng , Fei Gao

The field of Embodied AI is witnessing a rapid evolution toward general-purpose robotic systems, fueled by high-fidelity simulation and large-scale data collection. However, this scaling capability remains severely bottlenecked by a…

Artificial Intelligence · Computer Science 2026-01-30 Zixing Lei , Genjia Liu , Yuanshuo Zhang , Qipeng Liu , Chuan Wen , Shanghang Zhang , Wenzhao Lian , Siheng Chen

F1Tenth is a widely adopted reduced-scale platform for developing and testing autonomous racing algorithms, hosting annual competitions worldwide. With high operating speeds, dynamic environments, and head-to-head interactions, autonomous…

Robotics · Computer Science 2025-09-23 Zhijie Qiao , Haowei Li , Zhong Cao , Henry X. Liu

Safety is a long-standing and the final pursuit in the development of autonomous driving systems, with a significant portion of safety challenge arising from perception. How to effectively evaluate the safety as well as the reliability of…

Edge intelligence autonomous driving (EIAD) offers computing resources in autonomous vehicles for training deep neural networks. However, wireless channels between the edge server and the autonomous vehicles are time-varying due to the…

Signal Processing · Electrical Eng. & Systems 2022-12-08 Xinrao Li , Tong Zhang , Shuai Wang , Guangxu Zhu , Rui Wang , Tsung-Hui Chang

This paper presents Edge-based Mixture of Experts (MoE) Collaborative Computing (EMC2), an optimal computing system designed for autonomous vehicles (AVs) that simultaneously achieves low-latency and high-accuracy 3D object detection.…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Linshen Liu , Boyan Su , Junyue Jiang , Guanlin Wu , Cong Guo , Ceyu Xu , Hao Frank Yang

End-to-end autonomous driving has drawn tremendous attention recently. Many works focus on using modular deep neural networks to construct the end-to-end archi-tecture. However, whether using powerful large language models (LLM), especially…

Computer Vision and Pattern Recognition · Computer Science 2025-09-04 Zilong Guo , Yi Luo , Long Sha , Dongxu Wang , Panqu Wang , Chenyang Xu , Yi Yang

Large language models are increasingly deployed as autonomous agents for multi-step workflows in real-world software environments. However, existing agent benchmarks are limited by trajectory-opaque grading, underspecified safety and…

Artificial Intelligence · Computer Science 2026-05-08 Bowen Ye , Rang Li , Qibin Yang , Yuanxin Liu , Linli Yao , Hanglong Lv , Zhihui Xie , Chenxin An , Lei Li , Lingpeng Kong , Qi Liu , Zhifang Sui , Tong Yang

End-to-end autonomous driving faces persistent challenges in both generating diverse, rule-compliant trajectories and robustly selecting the optimal path from these options via learned, multi-faceted evaluation. To address these challenges,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Bin Wang , Pingjun Li , Jinkun Liu , Jun Cheng , Hailong Lei , Yinze Rong , Huan-ang Gao , Kangliang Chen , Xing Pan , Weihao Gu

Although end-to-end (E2E) learning has led to impressive progress on a variety of visual understanding tasks, it is often impeded by hardware constraints (e.g., GPU memory) and is prone to overfitting. When it comes to video captioning, one…

Computer Vision and Pattern Recognition · Computer Science 2019-01-03 Lijun Li , Boqing Gong

Tactical decision making and strategic motion planning for autonomous highway driving are challenging due to the complication of predicting other road users' behaviors, diversity of environments, and complexity of the traffic interactions.…

Robotics · Computer Science 2020-11-30 Majid Moghadam , Ali Alizadeh , Engin Tekin , Gabriel Hugh Elkaim

Assessing the safety of autonomous driving (AD) systems against security threats, particularly backdoor attacks, is a stepping stone for real-world deployment. However, existing works mainly focus on pixel-level triggers that are…

Cryptography and Security · Computer Science 2025-10-14 Xuan Chen , Shiwei Feng , Zikang Xiong , Shengwei An , Yunshu Mao , Lu Yan , Guanhong Tao , Wenbo Guo , Xiangyu Zhang

Autonomous driving requires reliable perception and safe decision-making in complex scenarios. Recent vision-language models (VLMs) demonstrate reasoning and generalization abilities, opening new possibilities for autonomous driving;…

Artificial Intelligence · Computer Science 2026-05-27 Zecong Tang , Zixu Wang , Yifei Wang , Weitong Lian , Tianjian Gao , Haoran Li , Tengju Ru , Lingyi Meng , Zhejun Cui , Yichen Zhu , Qi Kang , Kaixuan Wang , Yu Zhang

Motion planning in complex scenarios is a core challenge in autonomous driving. Conventional methods apply predefined rules or learn from driving data to generate trajectories, while recent approaches leverage large language models (LLMs)…

Machine Learning · Computer Science 2025-10-14 Kanishkha Jaisankar , Sunidhi Tandel

End-to-end autonomous driving demonstrates strong planning capabilities with large-scale data but still struggles in complex, rare scenarios due to limited commonsense. In contrast, Large Vision-Language Models (LVLMs) excel in scene…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Bo Jiang , Shaoyu Chen , Bencheng Liao , Xingyu Zhang , Wei Yin , Qian Zhang , Chang Huang , Wenyu Liu , Xinggang Wang