English
Related papers

Related papers: ADriver-I: A General World Model for Autonomous Dr…

200 papers

Vision-language models (VLMs) serve as general-purpose end-to-end models in autonomous driving, performing subtasks such as prediction, planning, and perception through question-and-answer interactions. However, most existing methods rely…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Enming Zhang , Xingyuan Dai , Min Huang , Yisheng Lv , Qinghai Miao

Although multi-modal large language models (MLLMs) have shown strong capabilities across diverse domains, their application in generating fine-grained 3D perception and prediction outputs in autonomous driving remains underexplored. In this…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Zhe Liu , Runhui Huang , Rui Yang , Siming Yan , Zining Wang , Lu Hou , Di Lin , Xiang Bai , Hengshuang Zhao

End-to-end autonomous driving has advanced significantly, offering benefits such as system simplicity and stronger driving performance in both open-loop and closed-loop settings than conventional pipelines. However, existing frameworks…

Robotics · Computer Science 2025-06-04 Wei Liu , Jiyuan Zhang , Binxiong Zheng , Yufeng Hu , Yingzhan Lin , Zengfeng Zeng

Autonomous Vehicles (AVs) are poised to revolutionize emergency services by enabling faster, safer, and more efficient responses. This transformation is driven by advances in Artificial Intelligence (AI), particularly Reinforcement Learning…

Artificial Intelligence · Computer Science 2026-02-23 Yousef Emami , Radha Reddy , Azadeh Pourkabirian , Miguel Gutierrez Gaitan

Prevalent Vision-Language-Action (VLA) models are typically built upon Multimodal Large Language Models (MLLMs) and demonstrate exceptional proficiency in semantic understanding, but they inherently lack the capability to deduce physical…

Traditionally, prediction and planning in autonomous driving (AD) have been treated as separate, sequential modules. Recently, there has been a growing shift towards tighter integration of these components, known as Integrated Prediction…

Deploying learned decision-making systems often requires transferring to new sites where the sensing pipeline differs. In such cases, observations can change in semantics and dimensionality even when action primitives and objectives remain…

Machine Learning · Computer Science 2026-04-28 Zherui Huang , Yicheng Liu , Chumeng Liang , Guanjie Zheng

Large Vision Language Models (LVLMs) have shown strong capabilities in understanding and analyzing visual scenes across various domains. However, in the context of autonomous driving, their limited comprehension of 3D environments restricts…

Computer Vision and Pattern Recognition · Computer Science 2025-05-02 Jannik Lübberstedt , Esteban Rivera , Nico Uhlemann , Markus Lienkamp

Recent advancements in open-source Visual Language Models (VLMs) such as LLaVA, Qwen-VL, and Llama have catalyzed extensive research on their integration with diverse systems. The internet-scale general knowledge encapsulated within these…

Robotics · Computer Science 2025-07-03 Cristian Gariboldi , Hayato Tokida , Ken Kinjo , Yuki Asada , Alexander Carballo

World models can foresee the outcomes of different actions, which is of paramount importance for autonomous driving. Nevertheless, existing driving world models still have limitations in generalization to unseen environments, prediction…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Shenyuan Gao , Jiazhi Yang , Li Chen , Kashyap Chitta , Yihang Qiu , Andreas Geiger , Jun Zhang , Hongyang Li

Vision-language models (VLMs) have become a promising approach to enhancing perception and decision-making in autonomous driving. The gap remains in applying VLMs to understand complex scenarios interacting with pedestrians and efficient…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Haoxiang Gao , Li Zhang , Yu Zhao , Zhou Yang , Jinghan Cao

Model-based reinforcement learning (MBRL) techniques have recently yielded promising results for real-world autonomous racing using high-dimensional observations. MBRL agents, such as Dreamer, solve long-horizon tasks by building a world…

Robotics · Computer Science 2023-05-09 Elena Shrestha , Chetan Reddy , Hanxi Wan , Yulun Zhuang , Ram Vasudevan

Autonomous driving has made significant strides through data-driven techniques, achieving robust performance in standardized tasks. However, existing methods frequently overlook user-specific preferences, offering limited scope for…

Robotics · Computer Science 2025-05-13 Chengkai Xu , Jiaqi Liu , Yicheng Guo , Yuhang Zhang , Peng Hang , Jian Sun

End-to-end autonomous driving has received increasing attention due to its potential to learn from large amounts of data. However, most existing methods are still open-loop and suffer from weak scalability, lack of high-order interactions,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Wenzhao Zheng , Zetian Xia , Yuanhui Huang , Sicheng Zuo , Jie Zhou , Jiwen Lu

Autonomous driving technology can improve traffic safety and reduce traffic accidents. In addition, it improves traffic flow, reduces congestion, saves energy and increases travel efficiency. In the relatively mature automatic driving…

Robotics · Computer Science 2024-03-13 Wenjian Sun , Linying Pan , Jingyu Xu , Weixiang Wan , Yong Wang

Data-driven learning has advanced autonomous driving, yet task-specific models struggle with out-of-distribution scenarios due to their narrow optimization objectives and reliance on costly annotated data. We present DriveX, a…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Chen Shi , Shaoshuai Shi , Kehua Sheng , Bo Zhang , Li Jiang

Vision-language models (VLMs) have emerged as a promising direction for end-to-end autonomous driving (AD) by jointly modeling visual observations, driving context, and language-based reasoning. However, existing VLM-based systems face a…

Robotics · Computer Science 2026-03-10 Ximeng Tao , Pardis Taghavi , Dimitar Filev , Reza Langari , Gaurav Pandey

To plan safe maneuvers and act with foresight, autonomous vehicles must be capable of accurately predicting the uncertain future. In the context of autonomous driving, deep neural networks have been successfully applied to learning…

Robotics · Computer Science 2022-08-02 Salar Arbabi , Davide Tavernini , Saber Fallah , Richard Bowden

Human-level driving is an ultimate goal of autonomous driving. Conventional approaches formulate autonomous driving as a perception-prediction-planning framework, yet their systems do not capitalize on the inherent reasoning ability and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Jiageng Mao , Junjie Ye , Yuxi Qian , Marco Pavone , Yue Wang

Most automated driving systems comprise a diverse sensor set, including several cameras, Radars, and LiDARs, ensuring a complete 360\deg coverage in near and far regions. Unlike Radar and LiDAR, which measure directly in 3D, cameras capture…