中文
相关论文

相关论文: CognitiveDrone: A VLA Model and Evaluation Benchma…

200 篇论文

In autonomous driving, dynamic environment and corner cases pose significant challenges to the robustness of ego vehicle's state understanding and decision making. We introduce VDRive, a novel pipeline for end-to-end autonomous driving that…

机器人学 · 计算机科学 2026-02-11 Ziang Guo , Zufeng Zhang

A fundamental challenge in autonomous driving is the integration of high-level, semantic reasoning for long-tail events with low-level, reactive control for robust driving. While large vision-language models (VLMs) trained on web-scale data…

Vision Language Models (VLMs) have recently been leveraged to generate robotic actions, forming Vision-Language-Action (VLA) models. However, directly adapting a pretrained VLM for robotic control remains challenging, particularly when…

Vision-and-language navigation (VLN) is a long-standing challenge in autonomous robotics, aiming to empower agents with the ability to follow human instructions while navigating complex environments. Two key bottlenecks remain in this…

机器人学 · 计算机科学 2025-06-13 Yuhang Zhang , Haosheng Yu , Jiaping Xiao , Mir Feroskhan

Autonomous driving has progressed from modular pipelines toward end-to-end unification, and Vision-Language-Action (VLA) models are a natural extension of this journey beyond Vision-to-Action (VA). In practice, driving VLAs have often…

Vision-Language-Action (VLA) models advance robotic control via strong visual-linguistic priors. However, existing VLAs predominantly frame pretraining as supervised behavior cloning, overlooking the fundamental nature of robot learning as…

Recent advancements in multimodal large language models have driven breakthroughs in visual question answering. Yet, a critical gap persists, `conceptualization'-the ability to recognize and reason about the same concept despite variations…

计算机视觉与模式识别 · 计算机科学 2025-06-09 Zahra Babaiee , Peyman M. Kiasari , Daniela Rus , Radu Grosu

Autonomous navigation for Unmanned Aerial Vehicles faces key challenges from limited onboard computational resources, which restrict deployed deep neural networks to shallow architectures incapable of handling complex environments.…

机器人学 · 计算机科学 2025-12-25 Pengyu Chen , Tao Ouyang , Ke Luo , Weijie Hong , Xu Chen

Developing agents capable of navigating to a target location based on language instructions and visual information, known as vision-language navigation (VLN), has attracted widespread interest. Most research has focused on ground-based…

计算机视觉与模式识别 · 计算机科学 2024-10-11 Xiangyu Wang , Donglin Yang , Ziqin Wang , Hohin Kwan , Jinyu Chen , Wenjun Wu , Hongsheng Li , Yue Liao , Si Liu

Vision-Language Models have achieved strong progress in ground-view visual understanding, yet they remain brittle in high-altitude Unmanned Aerial Vehicle scenes, where objects are tiny and densely packed, textures are repetitive, and…

计算机视觉与模式识别 · 计算机科学 2026-05-08 Jintao Sun , Gangyi Ding , Donglin Di , Hu Zhang , Zhedong Zheng

In this work, we introduce HoloBrain-0, a comprehensive Vision-Language-Action (VLA) framework that bridges the gap between foundation model research and reliable real-world robot deployment. The core of our system is a novel VLA…

Existing Vision-Language Navigation (VLN) methods primarily focus on single-stage navigation, limiting their effectiveness in multi-stage and long-horizon tasks within complex and dynamic environments. To address these limitations, we…

计算机视觉与模式识别 · 计算机科学 2025-03-20 Xinshuai Song , Weixing Chen , Yang Liu , Weikai Chen , Guanbin Li , Liang Lin

Developing robust and general-purpose manipulation policies represents a fundamental objective in robotics research. While Vision-Language-Action (VLA) models have demonstrated promising capabilities for end-to-end robot control, existing…

Robot foundation models, particularly Vision-Language-Action (VLA) models, have garnered significant attention for their ability to enhance robot policy learning, greatly improving robot's generalization and robustness. OpenAI's recent…

机器人学 · 计算机科学 2025-08-01 Jinming Li , Yichen Zhu , Zhibin Tang , Junjie Wen , Minjie Zhu , Xiaoyu Liu , Chengmeng Li , Ran Cheng , Yaxin Peng , Yan Peng , Feifei Feng

Recent advances in Vision-Language-Action (VLA) models have opened new avenues for robot manipulation, yet existing methods exhibit limited efficiency and a lack of high-level knowledge and spatial awareness. To address these challenges, we…

While Vision-Language-Action (VLA) models have revolutionized autonomous driving by unifying perception and planning, their reliance on explicit textual Chain-of-Thought (CoT) leads to semantic-perceptual decoupling and perceptual-symbolic…

计算机视觉与模式识别 · 计算机科学 2026-03-13 Yuechen Luo , Fang Li , Shaoqing Xu , Yang Ji , Zehan Zhang , Bing Wang , Yuannan Shen , Jianwei Cui , Long Chen , Guang Chen , Hangjun Ye , Zhi-Xin Yang , Fuxi Wen

Real-world embodied agents face long-horizon tasks, characterized by high-level goals demanding multi-step solutions beyond single actions. Successfully navigating these requires both high-level task planning (i.e., decomposing goals into…

机器人学 · 计算机科学 2025-06-03 Yi Yang , Jiaxuan Sun , Siqi Kou , Yihan Wang , Zhijie Deng

VLA models have shown promising potential in embodied navigation by unifying perception and planning while inheriting the strong generalization abilities of large VLMs. However, most existing VLA models rely on reactive mappings directly…

机器人学 · 计算机科学 2026-01-14 Shaoan Wang , Yuanfei Luo , Xingyu Chen , Aocheng Luo , Dongyue Li , Chang Liu , Sheng Chen , Yangang Zhang , Junzhi Yu

Vision-language-action (VLA) reasoning tasks require agents to interpret multimodal instructions, perform long-horizon planning, and act adaptively in dynamic environments. Existing approaches typically train VLA models in an end-to-end…

计算机视觉与模式识别 · 计算机科学 2025-09-19 Chi-Pin Huang , Yueh-Hua Wu , Min-Hung Chen , Yu-Chiang Frank Wang , Fu-En Yang

Vision-Language-Action (VLA) models have recently achieved notable progress in end-to-end autonomous driving by integrating perception, reasoning, and control within a unified multimodal framework. However, they often lack explicit modeling…

计算机视觉与模式识别 · 计算机科学 2026-04-13 Guoqing Wang , Pin Tang , Xiangxuan Ren , Guodongfang Zhao , Bailan Feng , Chao Ma