中文
相关论文

相关论文: TriVLA: A Triple-System-Based Unified Vision-Langu…

200 篇论文

Temporal context is essential for robotic manipulation because such tasks are inherently non-Markovian, yet mainstream VLA models typically overlook it and struggle with long-horizon, temporally dependent tasks. Cognitive science suggests…

机器人学 · 计算机科学 2026-02-02 Hao Shi , Bin Xie , Yingfei Liu , Lin Sun , Fengrong Liu , Tiancai Wang , Erjin Zhou , Haoqiang Fan , Xiangyu Zhang , Gao Huang

While end-to-end Vision-Language-Action (VLA) models offer a promising paradigm for robotic manipulation, fine-tuning them on narrow control data often compromises the profound reasoning capabilities inherited from their base…

计算机视觉与模式识别 · 计算机科学 2026-05-12 Tianshuo Yang , Guanyu Chen , Yutian Chen , Zhixuan Liang , Yitian Liu , Zanxin Chen , Chunpu Xu , Haotian Liang , Jiangmiao Pang , Yao Mu , Ping Luo

Vision-Language-Action (VLA) models have recently shown impressive generalization and language-guided manipulation capabilities. However, their performance degrades on tasks requiring precise spatial reasoning due to limited spatial…

计算机视觉与模式识别 · 计算机科学 2025-10-16 Tianyuan Yuan , Yicheng Liu , Chenhao Lu , Zhuoguang Chen , Tao Jiang , Hang Zhao

Vision-Language-Action models have achieved remarkable progress in robotic manipulation, yet they suffer from a critical limitation: a lack of 3D scene understanding. This deficiency manifests as three intertwined challenges: weak…

机器人学 · 计算机科学 2026-05-29 Zhongyu Xia , Yousen Tang , Bingqing Wei , Yongtao Wang

Autonomous driving requires reasoning about how the environment evolves and planning actions accordingly. Existing world-model-based approaches typically predict future scenes first and plan afterwards, resulting in open-loop imagination…

机器人学 · 计算机科学 2026-03-31 Qiqi Liu , Huan Xu , Jingyu Li , Bin Sun , Zhihui Hao , Dangen She , Xiatian Zhu , Li Zhang

Vision-Language-Action (VLA) models extend vision-language models to embodied control by mapping natural-language instructions and visual observations to robot actions. Despite their capabilities, VLA systems face significant challenges due…

机器人学 · 计算机科学 2025-10-24 Weifan Guan , Qinghao Hu , Aosheng Li , Jian Cheng

Vision-Language-Action (VLA) models are a promising path toward embodied intelligence, yet they often overlook the predictive and temporal-causal structure underlying visual dynamics. World-model VLAs address this by predicting future…

计算机视觉与模式识别 · 计算机科学 2026-03-04 Fuxiang Yang , Donglin Di , Lulu Tang , Xuancheng Zhang , Lei Fan , Hao Li , Chen Wei , Tonghua Su , Baorui Ma

In this paper, we propose GTA-VLA(Guide, Think, Act), an interactive Vision-Language-Action (VLA) framework that enables spatially steerable embodied reasoning by allowing users to guide robot policies with explicit visual cues. Existing…

机器人学 · 计算机科学 2026-05-14 Yiran Ling , Qing Lian , Jinghang Li , Qing Jiang , Tianming Zhang , Xiaoke Jiang , Chuanxiu Liu , Jie Liu , Lei Zhang

In robotics, Vision-Language-Action (VLA) models that integrate diverse multimodal signals from multi-view inputs have emerged as an effective approach. However, most prior work adopts static fusion that processes all visual inputs…

机器人学 · 计算机科学 2026-02-18 Young-Chae Son , Jung-Woo Lee , Yoon-Ji Choi , Dae-Kwan Ko , Soo-Chul Lim

Prevalent Vision-Language-Action (VLA) models are typically built upon Multimodal Large Language Models (MLLMs) and demonstrate exceptional proficiency in semantic understanding, but they inherently lack the capability to deduce physical…

Vision-language-action models have emerged as a crucial paradigm in robotic manipulation. However, existing VLA models exhibit notable limitations in handling ambiguous language instructions and unknown environmental states. Furthermore,…

机器人学 · 计算机科学 2025-08-26 Helong Huang , Min Cen , Kai Tan , Xingyue Quan , Guowei Huang , Hong Zhang

Autonomous driving requires generating safe and reliable trajectories from complex multimodal inputs. Traditional modular pipelines separate perception, prediction, and planning, while recent end-to-end (E2E) systems learn them jointly.…

计算机视觉与模式识别 · 计算机科学 2026-03-02 Qihang Peng , Xuesong Chen , Chenye Yang , Shaoshuai Shi , Hongsheng Li

Manipulating dynamic objects remains an open challenge for Vision-Language-Action (VLA) models, which, despite strong generalization in static manipulation, struggle in dynamic scenarios requiring rapid perception, temporal anticipation,…

机器人学 · 计算机科学 2026-01-30 Haozhe Xie , Beichen Wen , Jiarui Zheng , Zhaoxi Chen , Fangzhou Hong , Haiwen Diao , Ziwei Liu

Vision-Language-Action models (VLAs) are emerging as powerful tools for learning generalizable visuomotor control policies. However, current VLAs are mostly trained on large-scale image-text-action data and remain limited in two key ways:…

计算机视觉与模式识别 · 计算机科学 2026-03-24 Wenqi Liang , Gan Sun , Yao He , Jiahua Dong , Suyan Dai , Ivan Laptev , Salman Khan , Yang Cong

The important manifestation of robot intelligence is the ability to naturally interact and autonomously make decisions. Traditional approaches to robot control often compartmentalize perception, planning, and decision-making, simplifying…

机器人学 · 计算机科学 2025-02-05 Pengxiang Ding , Han Zhao , Wenjie Zhang , Wenxuan Song , Min Zhang , Siteng Huang , Ningxi Yang , Donglin Wang

Amid growing efforts to leverage advances in large language models (LLMs) and vision-language models (VLMs) for robotics, Vision-Language-Action (VLA) models have recently gained significant attention. By unifying vision, language, and…

机器人学 · 计算机科学 2025-10-09 Kento Kawaharazuka , Jihoon Oh , Jun Yamada , Ingmar Posner , Yuke Zhu

Enabling robots to perform diverse tasks across varied environments is a central challenge in robot learning. While vision-language-action (VLA) models have shown promise for generalizable robot skills, realizing their full potential…

机器人学 · 计算机科学 2025-08-12 Junjie Wen , Yichen Zhu , Jinming Li , Zhibin Tang , Chaomin Shen , Feifei Feng

Vision-Language-Action (VLA) models aim to control robots for manipulation from visual observations and natural-language instructions. However, existing hierarchical and autoregressive paradigms often introduce architectural overhead,…

Vision-Language-Action (VLA) models leverage pretrained vision-language models (VLMs) to couple perception with robotic control, offering a promising path toward general-purpose embodied intelligence. However, current SOTA VLAs are…

机器人学 · 计算机科学 2025-10-10 Yandu Chen , Kefan Gu , Yuqing Wen , Yucheng Zhao , Tiancai Wang , Liqiang Nie

Vision-Language-Action Models (VLAs) have shown remarkable progress towards embodied intelligence. While their architecture partially resembles that of Large Language Models (LLMs), VLAs exhibit higher complexity due to their multi-modal…

机器人学 · 计算机科学 2026-03-06 Hugo Buurmeijer , Carmen Amo Alonso , Aiden Swann , Marco Pavone