中文
相关论文

相关论文: CognitiveDrone: A VLA Model and Evaluation Benchma…

200 篇论文

Effective autonomous driving hinges on robust reasoning across perception, prediction, planning, and behavior. However, conventional end-to-end models fail to generalize in complex scenarios due to the lack of structured reasoning. While…

计算机视觉与模式识别 · 计算机科学 2026-01-14 Muxi Diao , Lele Yang , Hongbo Yin , Zhexu Wang , Yejie Wang , Daxin Tian , Kongming Liang , Zhanyu Ma

Vision Language Models (VLMs) bridge visual perception and linguistic reasoning. In Autonomous Driving (AD), this synergy has enabled Vision Language Action (VLA) models, which translate high-level multimodal understanding into driving…

机器人学 · 计算机科学 2026-03-11 Yuan Gao , Dengyuan Hua , Mattia Piccinini , Finn Rasmus Schäfer , Korbinian Moller , Lin Li , Johannes Betz

UAV vision-language navigation (VLN) requires an agent to navigate complex 3D environments from an egocentric perspective while following ambiguous multi-step instructions over long horizons. Existing zero-shot methods remain limited, as…

计算机视觉与模式识别 · 计算机科学 2026-04-20 Dian Shao , Zhengzheng Xu , Peiyang Wang , Like Liu , Yule Wang , Jieqi Shi , Jing Huo

Existing UAV vision-language navigation (VLN) benchmarks have enabled language-guided flight, but they largely focus on long, step-wise route descriptions with goal-centric evaluation, making them less diagnostic for real operations where…

计算机视觉与模式识别 · 计算机科学 2026-03-23 Jingyu Guo , Ziye Chen , Ziwen Li , Zhengqing Gao , Jiaxin Huang , Hanlue Zhang , Fengming Huang , Yu Yao , Tongliang Liu , Mingming Gong

Conventional end-to-end (E2E) driving models are effective at generating physically plausible trajectories, but often fail to generalize to long-tail scenarios due to the lack of essential world knowledge to understand and reason about…

机器人学 · 计算机科学 2025-11-05 Yu Gao , Anqing Jiang , Yiru Wang , Wang Jijun , Hao Jiang , Zhigang Sun , Heng Yuwen , Wang Shuo , Hao Zhao , Sun Hao

Vision-Language-Action (VLA) models have shown promising capabilities for embodied intelligence, but most existing approaches rely on text-based chain-of-thought reasoning where visual inputs are treated as static context. This limits the…

计算机视觉与模式识别 · 计算机科学 2026-03-17 Chaoyang Wang , Wenrui Bao , Sicheng Gao , Bingxin Xu , Yu Tian , Yogesh S. Rawat , Yunhao Ge , Yuzhang Shang

We introduce iFlyBot-VLA, a large-scale Vision-Language-Action (VLA) model trained under a novel framework. The main contributions are listed as follows: (1) a latent action model thoroughly trained on large-scale human and robotic…

计算机视觉与模式识别 · 计算机科学 2025-11-05 Yuan Zhang , Chenyu Xue , Wenjie Xu , Chao Ji , Jiajia wu , Jia Pan

Vision-Language-Action (VLA) models map visual observations and language instructions directly to robotic actions. While effective for simple tasks, standard VLA models often struggle with complex, multi-step tasks requiring logical…

计算机视觉与模式识别 · 计算机科学 2026-03-24 Zhide Zhong , Junfeng Li , Junjie He , Haodong Yan , Xin Gong , Guanyi Zhao , Yingjie Cai , Jiantao Gao , Xu Yan , Bingbing Liu , Yingcong Chen , Liuqing Yang , Haoang Li

Aerial Vision-and-Language Navigation (VLN) aims to enable unmanned aerial vehicles (UAVs) to interpret natural language instructions and navigate complex urban environments using onboard visual observation. This task holds promise for…

计算机视觉与模式识别 · 计算机科学 2026-04-16 Huilin Xu , Zhuoyang Liu , Yixiang Luomei , Feng Xu

End-to-end autonomous driving requires models to understand traffic scenes, infer driving intent, and generate executable motion plans. Recent vision-language-action (VLA) models inherit semantic priors from large-scale vision-language…

计算机视觉与模式识别 · 计算机科学 2026-05-20 Rui Zhao , Jianlin Yu , Zhenhai Gao , Jiaqiao Liu , Fei Gao

This paper introduces VLN-Pilot, a novel framework in which a large Vision-and-Language Model (VLLM) assumes the role of a human pilot for indoor drone navigation. By leveraging the multimodal reasoning abilities of VLLMs, VLN-Pilot…

In this work, we present CollabVLA, a self-reflective vision-language-action framework that transforms a standard visuomotor policy into a collaborative assistant. CollabVLA tackles key limitations of prior VLAs, including domain…

机器人学 · 计算机科学 2025-09-19 Nan Sun , Yongchang Li , Chenxu Wang , Huiying Li , Huaping Liu

Recent reasoning-augmented Vision-Language-Action (VLA) models have improved the interpretability of end-to-end autonomous driving by generating intermediate reasoning traces. Yet these models primarily describe what they perceive and…

Vision-language-action models (VLAs) have garnered significant attention for their potential in advancing robotic manipulation. However, previous approaches predominantly rely on the general comprehension capabilities of vision-language…

计算机视觉与模式识别 · 计算机科学 2025-06-25 Yuqi Wang , Xinghang Li , Wenxuan Wang , Junbo Zhang , Yingyan Li , Yuntao Chen , Xinlong Wang , Zhaoxiang Zhang

Vision-Language-Action (VLA) models have recently emerged, demonstrating strong generalization in robotic scene understanding and manipulation. However, when confronted with long-horizon tasks that require defined goal states, such as LEGO…

To build a generalizable Vision-Language-Action (VLA) model with strong reasoning ability, a common strategy is to first train a specialist VLA on robot demonstrations to acquire reliable manipulation skills, and then incorporate mixed…

计算机视觉与模式识别 · 计算机科学 2025-12-01 Zhen Fang , Zhuoyang Liu , Jiaming Liu , Hao Chen , Yu Zeng , Shiting Huang , Zehui Chen , Lin Chen , Shanghang Zhang , Feng Zhao

A fundamental objective of manipulation policy design is to endow robots to comprehend human instructions, reason about scene cues, and execute generalized actions in dynamic environments. Recent autoregressive vision-language-action (VLA)…

Vision-Language-Action (VLA) models have emerged as a powerful paradigm for general-purpose robot control through natural language instructions. However, their high inference cost-stemming from large-scale token computation and…

计算机视觉与模式识别 · 计算机科学 2025-05-28 Xudong Tan , Yaoxin Yang , Peng Ye , Jialin Zheng , Bizhe Bai , Xinyi Wang , Jia Hao , Tao Chen

We present ProgVLA, a compact vision-language-action (VLA) model designed for reliable robot manipulation under tight compute and memory budgets. The model specifically focuses on efficiently processing long multi-modal sequences by…

机器人学 · 计算机科学 2026-05-28 Seungsu Kim , Jinyoung Choi , Seungmin Baek , Jean-Michel Renders

Vision-Language-Action (VLA) models have emerged as a promising framework for end-to-end autonomous driving. However, existing VLAs typically rely on sparse action supervision, which underutilizes their powerful scene understanding and…

计算机视觉与模式识别 · 计算机科学 2026-05-22 Xiaodong Mei , Diankun Zhang , Hongwei Xie , Guang Chen , Hangjun Ye , Dan Xu