中文
相关论文

相关论文: TC-IDM: Grounding Video Generation for Executable …

200 篇论文

While end-to-end Vision-Language-Action (VLA) models offer a promising paradigm for robotic manipulation, fine-tuning them on narrow control data often compromises the profound reasoning capabilities inherited from their base…

计算机视觉与模式识别 · 计算机科学 2026-05-12 Tianshuo Yang , Guanyu Chen , Yutian Chen , Zhixuan Liang , Yitian Liu , Zanxin Chen , Chunpu Xu , Haotian Liang , Jiangmiao Pang , Yao Mu , Ping Luo

World-model-based imagine-then-act becomes a promising paradigm for robotic manipulation, yet existing approaches typically support either purely image-based forecasting or reasoning over partial 3D geometry, limiting their ability to…

计算机视觉与模式识别 · 计算机科学 2026-05-27 Jiaxu Wang , Yicheng Jiang , Tianlun He , Jingkai Sun , Qiang Zhang , Junhao He , Jiahang Cao , Zesen Gan , Mingyuan Sun , Qiming Shao , Xiangyu Yue

In this paper, we propose GTA-VLA(Guide, Think, Act), an interactive Vision-Language-Action (VLA) framework that enables spatially steerable embodied reasoning by allowing users to guide robot policies with explicit visual cues. Existing…

机器人学 · 计算机科学 2026-05-14 Yiran Ling , Qing Lian , Jinghang Li , Qing Jiang , Tianming Zhang , Xiaoke Jiang , Chuanxiu Liu , Jie Liu , Lei Zhang

World models are becoming central to robotic planning and control as they enable prediction of future state transitions. Existing approaches often emphasize video generation or natural-language prediction, which are difficult to ground in…

Robotic manipulation, a key frontier in robotics and embodied AI, requires precise motor control and multimodal understanding, yet traditional rule-based methods fail to scale or generalize in unstructured, novel environments. In recent…

机器人学 · 计算机科学 2025-09-04 Rui Shao , Wei Li , Lingsen Zhang , Renshan Zhang , Zhiyang Liu , Ran Chen , Liqiang Nie

The development of Vision-Language-Action (VLA) models has been significantly accelerated by pre-trained Vision-Language Models (VLMs). However, most existing end-to-end VLAs treat the VLM primarily as a multimodal encoder, directly mapping…

机器人学 · 计算机科学 2026-04-29 Yi Chen , Yuying Ge , Hui Zhou , Mingyu Ding , Yixiao Ge , Xihui Liu

Vision-Language-Action (VLA) models show promise for robotic control, yet performance in complex household environments remains sub-optimal. Mobile manipulation requires reasoning about global scene layout, fine-grained geometry, and…

机器人学 · 计算机科学 2026-03-25 Ruisen Tu , Arth Shukla , Sohyun Yoo , Xuanlin Li , Junxi Li , Jianwen Xie , Hao Su , Zhuowen Tu

Vision-Language-Action (VLA) models built upon Chain-of-Thought (CoT) have achieved remarkable success in advancing general-purpose robotic agents, owing to its significant perceptual comprehension. Recently, since text-only CoT struggles…

机器人学 · 计算机科学 2026-01-30 Xiangkai Ma , Lekai Xing , Han Zhang , Wenzhong Li , Sanglu Lu

Inverse Dynamics Models (IDMs) map visual observations to low-level action commands, serving as central components for data labeling and policy execution in embodied AI. However, their performance degrades severely under manipulator…

机器人学 · 计算机科学 2026-04-21 Kerui Li , Zhe Jing , Xiaofeng Wang , Zheng Zhu , Yukun Zhou , Guan Huang , Dongze Li , Qingkai Yang , Huaibo Huang

Vision-Language-Action (VLA) models have recently emerged as powerful generalists for robotic manipulation. However, due to their predominant reliance on visual modalities, they fundamentally lack the physical intuition required for…

机器人学 · 计算机科学 2026-02-02 Yuzhe Huang , Pei Lin , Wanlin Li , Daohan Li , Jiajun Li , Jiaming Jiang , Chenxi Xiao , Ziyuan Jiao

Vision-Language-Action (VLA) models are a promising path toward embodied intelligence, yet they often overlook the predictive and temporal-causal structure underlying visual dynamics. World-model VLAs address this by predicting future…

计算机视觉与模式识别 · 计算机科学 2026-03-04 Fuxiang Yang , Donglin Di , Lulu Tang , Xuancheng Zhang , Lei Fan , Hao Li , Chen Wei , Tonghua Su , Baorui Ma

Recent advances in vision-language-action (VLA) models have shown promise in integrating image generation with action prediction to improve generalization and reasoning in robot manipulation. However, existing methods are limited to…

计算机视觉与模式识别 · 计算机科学 2025-08-27 Wenyao Zhang , Hongsi Liu , Zekun Qi , Yunnan Wang , Xinqiang Yu , Jiazhao Zhang , Runpei Dong , Jiawei He , Fan Lu , He Wang , Zhizheng Zhang , Li Yi , Wenjun Zeng , Xin Jin

Robots in dynamic, human-centric environments must follow language instructions while maintaining real-time reactive control. Vision-language-action (VLA) models offer a promising framework, but they assume temporally aligned reasoning and…

机器人学 · 计算机科学 2026-02-03 Zhiyu Huang , Yun Zhang , Johnson Liu , Rui Song , Chen Tang , Jiaqi Ma

Most existing vision-language-action (VLA) models for robotic manipulation lack progress awareness, typically relying on hand-crafted heuristics for task termination. This limitation is particularly severe in long-horizon tasks involving…

机器人学 · 计算机科学 2026-03-31 Hongyu Yan , Qiwei Li , Jiaolong Yang , Yadong Mu

Embodied Vision-Language Models (VLMs) have demonstrated impressive performance and generalization in robotics, particularly within Vision-Language-Action frameworks. However, a significant gap remains between the high-level semantic focus…

计算机视觉与模式识别 · 计算机科学 2026-05-28 Ruowen Zhao , Bangguo Li , Zuyan Liu , Yinan Liang , Junliang Ye , Fangfu Liu , Diankun Wu , Zhengyi Wang , Xumin Yu , Yongming Rao , Han Hu , Jun Zhu

Vision-Language-Action (VLA) models aim to control robots for manipulation from visual observations and natural-language instructions. However, existing hierarchical and autoregressive paradigms often introduce architectural overhead,…

In dynamic environments such as warehouses, hospitals, and homes, robots must seamlessly transition between gross motion and precise manipulations to complete complex tasks. However, current Vision-Language-Action (VLA) frameworks, largely…

机器人学 · 计算机科学 2026-03-03 Xiongfeng Peng , Jiaqian Yu , Dingzhe Li , Yixiang Jin , Lu Xu , Yamin Mao , Chao Zhang , Weiming Li , Sujin Jang , Dongwook Lee , Daehyun Ji

Generative video models, a leading approach to world modeling, face fundamental limitations. They often violate physical and logical rules, lack interactivity, and operate as opaque black boxes ill-suited for building structured, queryable…

计算机视觉与模式识别 · 计算机科学 2025-12-15 Felix O'Mahony , Roberto Cipolla , Ayush Tewari

Robotic real-world reinforcement learning (RL) with vision-language-action (VLA) models is bottlenecked by sparse, handcrafted rewards and inefficient exploration. We introduce VLAC, a general process reward model built upon InternVL and…

Recent advances in Vision-Language-Action (VLA) models have enabled robotic agents to integrate multimodal understanding with action execution. However, our empirical analysis reveals that current VLAs struggle to allocate visual attention…