English
Related papers

Related papers: An interactive enhanced driving dataset for autono…

200 papers

Executing language-conditioned tasks in dynamic visual environments remains a central challenge in embodied AI. Existing Vision-Language-Action (VLA) models predominantly adopt reactive state-to-action mappings, often leading to…

Robotics · Computer Science 2025-09-10 Qi Lv , Weijie Kong , Hao Li , Jia Zeng , Zherui Qiu , Delin Qu , Haoming Song , Qizhi Chen , Xiang Deng , Jiangmiao Pang

End-to-end autonomous driving has evolved from the conventional paradigm based on sparse perception into vision-language-action (VLA) models, which focus on learning language descriptions as an auxiliary task to facilitate planning. In this…

Computer Vision and Pattern Recognition · Computer Science 2026-04-27 Sicheng Zuo , Zixun Xie , Wenzhao Zheng , Shaoqing Xu , Fang Li , Hanbing Li , Long Chen , Zhi-Xin Yang , Jiwen Lu

Urban transportation systems face growing safety challenges that require scalable intelligence for emerging smart mobility infrastructures. While recent advances in foundation models and large-scale multimodal datasets have strengthened…

Computer Vision and Pattern Recognition · Computer Science 2026-04-27 Wenhui Huang , Songyan Zhang , Collister Chua , Yang Liang , Zhiqi Mao , Heng Yang , Chen Lv

Human drivers adeptly navigate complex scenarios by utilizing rich attentional semantics, but the current autonomous systems struggle to replicate this ability, as they often lose critical semantic information when converting 2D…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Pei Liu , Haipeng Liu , Haichao Liu , Xin Liu , Jinxin Ni , Jun Ma

Large Language Models (LLMs) and Vision-Language Models (VLMs) have emerged as promising candidates for end-to-end autonomous driving. However, these models typically face challenges in inference latency, action precision, and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Jiaru Zhang , Manav Gagvani , Can Cui , Juntong Peng , Ruqi Zhang , Ziran Wang

Pedestrian intention and trajectory prediction are critical for the safe deployment of autonomous driving systems, directly influencing navigation decisions in complex traffic environments. Recent advances in large vision-language models…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Naman Mishra , Shankar Gangisetty , C. V. Jawahar

Despite remarkable progress in Vision--Language--Action (VLA) models, a central bottleneck remains underexamined: the data infrastructure that underlies embodied learning. In this survey, we argue that future advances in VLA will depend…

Vision-Language-Action (VLA) models have recently emerged in autonomous driving, with the promise of leveraging rich world knowledge to improve the cognitive capabilities of driving systems. However, adapting such models for driving tasks…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Yongkang Li , Lijun Zhou , Sixu Yan , Bencheng Liao , Tianyi Yan , Kaixin Xiong , Long Chen , Hongwei Xie , Bing Wang , Guang Chen , Hangjun Ye , Wenyu Liu , Haiyang Sun , Xinggang Wang

Driver visual attention prediction is a critical task in autonomous driving and human-computer interaction (HCI) research. Most prior studies focus on estimating attention allocation at a single moment in time, typically using static RGB…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Kaiser Hamid , Khandakar Ashrafi Akbar , Nade Liang

The autonomous driving community is increasingly focused on addressing the challenges posed by out-of-distribution (OOD) driving scenarios. A dominant research trend seeks to enhance end-to-end (E2E) driving systems by integrating…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Yingzi Ma , Yulong Cao , Wenhao Ding , Shuibai Zhang , Yan Wang , Boris Ivanovic , Ming Jiang , Marco Pavone , Chaowei Xiao

Interaction-aware Autonomous Driving (IAAD) is a rapidly growing field of research that focuses on the development of autonomous vehicles (AVs) that are capable of interacting safely and efficiently with human road users. This is a…

Human-Computer Interaction · Computer Science 2023-11-01 Luca Crosato , Kai Tian , Hubert P. H Shum , Edmond S. L. Ho , Yafei Wang , Chongfeng Wei

Semantic segmentation is key in autonomous driving. Using deep visual learning architectures is not trivial in this context, because of the challenges in creating suitable large scale annotated datasets. This issue has been traditionally…

Computer Vision and Pattern Recognition · Computer Science 2021-10-25 Emanuele Alberti , Antonio Tavera , Carlo Masone , Barbara Caputo

Vision-Language-Action (VLA) models are emerging as a promising paradigm for end-to-end autonomous driving, valued for their potential to leverage world knowledge and reason about complex driving scenes. However, existing methods suffer…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Xinyang Wang , Qian Liu , Wenjie Ding , Zhao Yang , Wei Li , Chang Liu , Bailin Li , Kun Zhan , Xianpeng Lang , Wei Chen

Vision-language models (VLMs) serve as general-purpose end-to-end models in autonomous driving, performing subtasks such as prediction, planning, and perception through question-and-answer interactions. However, most existing methods rely…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Enming Zhang , Xingyuan Dai , Min Huang , Yisheng Lv , Qinghai Miao

End-to-end autonomous driving requires models to understand traffic scenes, infer driving intent, and generate executable motion plans. Recent vision-language-action (VLA) models inherit semantic priors from large-scale vision-language…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Rui Zhao , Jianlin Yu , Zhenhai Gao , Jiaqiao Liu , Fei Gao

Autonomous driving has progressed from modular pipelines toward end-to-end unification, and Vision-Language-Action (VLA) models are a natural extension of this journey beyond Vision-to-Action (VA). In practice, driving VLAs have often…

The end-to-end learning ability of self-driving vehicles has achieved significant milestones over the last decade owing to rapid advances in deep learning and computer vision algorithms. However, as autonomous driving technology is a…

Computer Vision and Pattern Recognition · Computer Science 2023-07-21 Shahin Atakishiyev , Mohammad Salameh , Housam Babiker , Randy Goebel

Conventional end-to-end (E2E) driving models are effective at generating physically plausible trajectories, but often fail to generalize to long-tail scenarios due to the lack of essential world knowledge to understand and reason about…

Robotics · Computer Science 2025-11-05 Yu Gao , Anqing Jiang , Yiru Wang , Wang Jijun , Hao Jiang , Zhigang Sun , Heng Yuwen , Wang Shuo , Hao Zhao , Sun Hao

Vision-Language-Action (VLA) models have recently attracted growing attention in end-to-end autonomous driving for their strong reasoning capabilities and rich world knowledge. However, existing VLAs often suffer from limited numerical…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Zhaohui Wang , Tengbo Yu , Hao Tang

Autonomous vehicles (AVs) need to share the road with multiple, heterogeneous road users in a variety of driving scenarios. It is overwhelming and unnecessary to carefully interact with all observed agents, and AVs need to determine whether…

Artificial Intelligence · Computer Science 2020-11-05 Xiaosong Jia , Liting Sun , Masayoshi Tomizuka , Wei Zhan