中文
相关论文

相关论文: VECTOR-Drive: Tightly Coupled Vision-Language and …

200 篇论文

In autonomous driving, dynamic environment and corner cases pose significant challenges to the robustness of ego vehicle's state understanding and decision making. We introduce VDRive, a novel pipeline for end-to-end autonomous driving that…

机器人学 · 计算机科学 2026-02-11 Ziang Guo , Zufeng Zhang

Vision Language Models (VLMs) bridge visual perception and linguistic reasoning. In Autonomous Driving (AD), this synergy has enabled Vision Language Action (VLA) models, which translate high-level multimodal understanding into driving…

机器人学 · 计算机科学 2026-03-11 Yuan Gao , Dengyuan Hua , Mattia Piccinini , Finn Rasmus Schäfer , Korbinian Moller , Lin Li , Johannes Betz

Recent advancements in Vision-Language-Action (VLA) models have shown promise for end-to-end autonomous driving by leveraging world knowledge and reasoning capabilities. However, current VLA models often struggle with physically infeasible…

计算机视觉与模式识别 · 计算机科学 2025-11-07 Zewei Zhou , Tianhui Cai , Seth Z. Zhao , Yun Zhang , Zhiyu Huang , Bolei Zhou , Jiaqi Ma

Autonomous driving has long relied on modular "Perception-Decision-Action" pipelines, where hand-crafted interfaces and rule-based components often break down in complex or long-tailed scenarios. Their cascaded design further propagates…

We present OpenDriveVLA, a Vision Language Action model designed for end-to-end autonomous driving, built upon open-source large language models. OpenDriveVLA generates spatially grounded driving actions by leveraging multimodal inputs,…

计算机视觉与模式识别 · 计算机科学 2025-11-24 Xingcheng Zhou , Xuyuan Han , Feng Yang , Yunpu Ma , Volker Tresp , Alois Knoll

Vision-Language Models(VLMs) excel at autoregressive text generation, yet end-to-end autonomous driving requires multi-task learning with structured outputs and heterogeneous decoding behaviors, such as autoregressive language generation,…

计算机视觉与模式识别 · 计算机科学 2026-04-21 Yiwei Zhang , Xuesong Chen , Jin Gao , Hanshi Wang , Fudong Ge , Weiming Hu , Shaoshuai Shi , Zhipeng Zhang

Vision Language Action (VLA) models promise an open-vocabulary interface that can translate perceptual ambiguity into semantically grounded driving decisions, yet they still treat language as a static prior fixed at inference time. As a…

音频与语音处理 · 电气工程与系统科学 2026-01-30 Ziang Guo , Feng Yang , Xuefeng Zhang , Jiaqi Guo , Kun Zhao , Yixiao Zhou , Peng Lu , Sifa Zheng , Zufeng Zhang

Vision-Language-Action (VLA) models are emerging as a promising paradigm for end-to-end autonomous driving, valued for their potential to leverage world knowledge and reason about complex driving scenes. However, existing methods suffer…

计算机视觉与模式识别 · 计算机科学 2026-03-03 Xinyang Wang , Qian Liu , Wenjie Ding , Zhao Yang , Wei Li , Chang Liu , Bailin Li , Kun Zhan , Xianpeng Lang , Wei Chen

Vision-Language-Action (VLA) models have emerged as a promising paradigm for end-to-end autonomous driving. However, existing reasoning mechanisms still struggle to provide planning-oriented intermediate representations: textual…

计算机视觉与模式识别 · 计算机科学 2026-05-14 Minqing Huang , Yujiao Xiang , Zihan Liang , Jiajie Huang , Jingqi Wang , Zhi Xu , Feiyang Tan , Hangning Zhou , Mu Yang , Gong Che

Conventional end-to-end (E2E) driving models are effective at generating physically plausible trajectories, but often fail to generalize to long-tail scenarios due to the lack of essential world knowledge to understand and reason about…

机器人学 · 计算机科学 2025-11-05 Yu Gao , Anqing Jiang , Yiru Wang , Wang Jijun , Hao Jiang , Zhigang Sun , Heng Yuwen , Wang Shuo , Hao Zhao , Sun Hao

Exploring open-world situations in an end-to-end manner is a promising yet challenging task due to the need for strong generalization capabilities. In particular, end-to-end autonomous driving in unstructured outdoor environments often…

计算机视觉与模式识别 · 计算机科学 2025-11-18 Hyunki Seong , Seongwoo Moon , Hojin Ahn , Jehun Kang , David Hyunchul Shim

Vision-Language-Action (VLA) driving augments end-to-end (E2E) planning with language-enabled backbones, yet it remains unclear what changes beyond the usual accuracy--cost trade-off. We revisit this question with 3--RQ analysis in…

机器人学 · 计算机科学 2026-02-12 Sining Ang , Yuguang Yang , Chenxu Dang , Canyu Chen , Cheng Chi , Haiyan Liu , Xuanyao Mao , Jason Bao , Xuliang , Bingchuan Sun , Yan Wang

Vision-Language-Action (VLA) models have emerged as a promising framework for end-to-end autonomous driving. However, existing VLAs typically rely on sparse action supervision, which underutilizes their powerful scene understanding and…

计算机视觉与模式识别 · 计算机科学 2026-05-22 Xiaodong Mei , Diankun Zhang , Hongwei Xie , Guang Chen , Hangjun Ye , Dan Xu

Vision-Language-Action (VLA) models have recently shown strong decision-making capabilities in autonomous driving. However, existing VLAs often struggle with achieving efficient inference and generalizing to novel autonomous vehicle…

计算机视觉与模式识别 · 计算机科学 2025-11-26 Dapeng Zhang , Zhenlong Yuan , Zhangquan Chen , Chih-Ting Liao , Yinda Chen , Fei Shen , Qingguo Zhou , Tat-Seng Chua

Autonomous driving requires generating safe and reliable trajectories from complex multimodal inputs. Traditional modular pipelines separate perception, prediction, and planning, while recent end-to-end (E2E) systems learn them jointly.…

计算机视觉与模式识别 · 计算机科学 2026-03-02 Qihang Peng , Xuesong Chen , Chenye Yang , Shaoshuai Shi , Hongsheng Li

The rapid progress of multimodal large language models (MLLM) has paved the way for Vision-Language-Action (VLA) paradigms, which integrate visual perception, natural language understanding, and control within a single policy. Researchers…

The integration of Vision-Language Models (VLMs) into autonomous driving systems has shown promise in addressing key challenges such as learning complexity, interpretability, and common-sense reasoning. However, existing approaches often…

计算机视觉与模式识别 · 计算机科学 2025-05-23 Xuesong Chen , Linjiang Huang , Tao Ma , Rongyao Fang , Shaoshuai Shi , Hongsheng Li

Recent advances in vision language action (VLA) models have shown remarkable potential for autonomous driving by directly mapping multimodal inputs to control signals. However, previous VLA-based methods have not explicitly exploited the…

计算机视觉与模式识别 · 计算机科学 2026-05-01 Lijin Yang , Jianing Huang , Zhongzhan Huang , Shu Liu , Hao Yang

Vision-Language-Action (VLA) models have recently attracted growing attention in end-to-end autonomous driving for their strong reasoning capabilities and rich world knowledge. However, existing VLAs often suffer from limited numerical…

计算机视觉与模式识别 · 计算机科学 2025-12-01 Zhaohui Wang , Tengbo Yu , Hao Tang

Understanding how Vision-Language-Action (VLA) models transform multimodal knowledge into embodied control remains an open challenge. We present VLA-Trace, a progressive diagnostic framework that analyzes VLA models through a unified…

‹ 上一页 1 2 3 10 下一页 ›