English
Related papers

Related papers: KnowVal: A Knowledge-Augmented and Value-Guided Au…

200 papers

The integration of Vision-Language Models (VLMs) into autonomous driving systems has shown promise in addressing key challenges such as learning complexity, interpretability, and common-sense reasoning. However, existing approaches often…

Computer Vision and Pattern Recognition · Computer Science 2025-05-23 Xuesong Chen , Linjiang Huang , Tao Ma , Rongyao Fang , Shaoshuai Shi , Hongsheng Li

Personalized driving refers to an autonomous vehicle's ability to adapt its driving behavior or control strategies to match individual users' preferences and driving styles while maintaining safety and comfort standards. However, existing…

Accurately understanding and deciding high-level meta-actions is essential for ensuring reliable and safe autonomous driving systems. While vision-language models (VLMs) have shown significant potential in various autonomous driving tasks,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Yujin Wang , Quanfeng Liu , Zhengxin Jiang , Tianyi Wang , Junfeng Jiao , Hongqing Chu , Bingzhao Gao , Hong Chen

Vision-Language-Action (VLA) models have recently shown strong decision-making capabilities in autonomous driving. However, existing VLAs often struggle with achieving efficient inference and generalizing to novel autonomous vehicle…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Dapeng Zhang , Zhenlong Yuan , Zhangquan Chen , Chih-Ting Liao , Yinda Chen , Fei Shen , Qingguo Zhou , Tat-Seng Chua

Autonomous vehicles (AVs) are poised to redefine transportation by enhancing road safety, minimizing human error, and optimizing traffic efficiency. The success of AVs depends on their ability to interpret complex, dynamic environments…

Multimedia · Computer Science 2025-07-11 Abolfazl Zarghani , Amirhossein Ebrahimi , Amir Malekesfandiari

Vision Language Action (VLA) models promise an open-vocabulary interface that can translate perceptual ambiguity into semantically grounded driving decisions, yet they still treat language as a static prior fixed at inference time. As a…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-30 Ziang Guo , Feng Yang , Xuefeng Zhang , Jiaqi Guo , Kun Zhao , Yixiao Zhou , Peng Lu , Sifa Zheng , Zufeng Zhang

Vision-Language-Action (VLA) models have emerged as a promising paradigm for end-to-end autonomous driving, yet their reliance on implicit parametric knowledge limits generalization in long-tail scenarios. While Retrieval-Augmented…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Rui Zhao , Haofeng Hu , Zhenhai Gao , Jiaqiao Liu , Gao Fei

Vision-Language Models (VLM) exhibit strong reasoning capabilities, showing promise for end-to-end autonomous driving systems. Chain-of-Thought (CoT), as VLM's widely used reasoning strategy, is facing critical challenges. Existing textual…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Lingjun Zhang , Yujian Yuan , Changjie Wu , Xinyuan Chang , Xin Cai , Shuang Zeng , Linzhe Shi , Sijin Wang , Hang Zhang , Mu Xu

Autonomous driving technology has the potential to transform transportation, but its wide adoption depends on the development of interpretable and transparent decision-making systems. Scene captioning, which generates natural language…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Felix Brandstaetter , Erik Schuetz , Katharina Winter , Fabian Flohr

Vehicle-to-everything (V2X) cooperation has emerged as a promising paradigm to overcome the perception limitations of classical autonomous driving by leveraging information from both ego-vehicle and infrastructure sensors. However,…

Robotics · Computer Science 2025-06-23 Junwei You , Haotian Shi , Zhuoyu Jiang , Zilin Huang , Rui Gan , Keshu Wu , Xi Cheng , Xiaopeng Li , Bin Ran

Large vision-language models (VLMs) for autonomous driving (AD) are evolving beyond perception and cognition tasks toward motion planning. However, we identify two critical challenges in this direction: (1) VLMs tend to learn shortcuts by…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Yue Li , Meng Tian , Dechang Zhu , Jiangtong Zhu , Zhenyu Lin , Zhiwei Xiong , Xinhai Zhao

Understanding and adhering to traffic regulations is essential for autonomous vehicles to ensure safety and trustworthiness. However, traffic regulations are complex, context-dependent, and differ between regions, posing a major challenge…

Artificial Intelligence · Computer Science 2025-11-20 Tianhui Cai , Yifan Liu , Zewei Zhou , Haoxuan Ma , Seth Z. Zhao , Zhiwen Wu , Xu Han , Zhiyu Huang , Jiaqi Ma

This study addresses the critical need for enhanced situational awareness in autonomous driving (AD) by leveraging the contextual reasoning capabilities of large language models (LLMs). Unlike traditional perception systems that rely on…

Artificial Intelligence · Computer Science 2025-01-09 Xuewen Luo , Fan Ding , Fengze Yang , Yang Zhou , Junnyong Loo , Hwa Hui Tew , Chenxi Liu

End-to-end autonomous driving frameworks face persistent challenges in generalization, training efficiency, and interpretability. While recent methods leverage Vision-Language Models (VLMs) through supervised learning on large-scale…

Robotics · Computer Science 2025-12-11 Lin Li , Yuxin Cai , Jianwu Fang , Jianru Xue , Chen Lv

Recent advancements in autonomous driving (AD) have explored the use of vision-language models (VLMs) within visual question answering (VQA) frameworks for direct driving decision-making. However, these approaches often depend on…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Xin Hu , Taotao Jing , Renran Tian , Zhengming Ding

Autonomous driving systems remain brittle in rare, ambiguous, and out-of-distribution scenarios, where human driver succeed through contextual reasoning. Shared autonomy has emerged as a promising approach to mitigate such failures by…

Robotics · Computer Science 2025-11-07 Phat Nguyen , Erfan Aasi , Shiva Sreeram , Guy Rosman , Andrew Silva , Sertac Karaman , Daniela Rus

The recent surge in interest in autonomous driving stems from its rapidly developing capacity to enhance safety, efficiency, and convenience. A pivotal aspect of autonomous driving technology is its perceptual systems, where core algorithms…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Qi Zhang , Siyuan Gou , Wenbin Li

Current autonomous driving vehicles rely mainly on their individual sensors to understand surrounding scenes and plan for future trajectories, which can be unreliable when the sensors are malfunctioning or occluded. To address this problem,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Hsu-kuang Chiu , Ryo Hachiuma , Chien-Yi Wang , Stephen F. Smith , Yu-Chiang Frank Wang , Min-Hung Chen

The rapid progress of multimodal large language models (MLLM) has paved the way for Vision-Language-Action (VLA) paradigms, which integrate visual perception, natural language understanding, and control within a single policy. Researchers…

Vision-Language-Action (VLA) models in autonomous driving systems have recently demonstrated transformative potential by integrating multimodal perception with decision-making capabilities. However, the interpretability and coherence of the…