中文
相关论文

相关论文: PrimitiveVLA: Learning Reusable Motion Primitives …

200 篇论文

Vision-Language-Action (VLA) models are formulated to ground instructions in visual context and generate action sequences for robotic manipulation. Despite recent progress, VLA models still face challenges in learning related and reusable…

机器人学 · 计算机科学 2026-03-11 Ziyue Zhu , Shangyang Wu , Shuai Zhao , Zhiqiu Zhao , Shengjie Li , Yi Wang , Fang Li , Haoran Luo

Vision-Language-Action (VLA) models typically map visual observations and linguistic instructions directly to control signals. This "black-box" mapping forces a single forward pass to simultaneously handle instruction interpretation,…

机器人学 · 计算机科学 2026-05-12 Zixuan Wang , Yuxin Chen , Yuqi Liu , Jinhui Ye , Pengguang Chen , Changsheng Lu , Shu Liu , Bei Yu , Jiaya Jia

Vision-Language-Action models (VLAs) represent a significant frontier in embodied intelligence, aiming to bridge digital knowledge with physical-world interaction. Despite their remarkable performance, foundational VLAs are hindered by the…

计算机视觉与模式识别 · 计算机科学 2026-02-03 Zhaoshu Yu , Bo Wang , Pengpeng Zeng , Haonan Zhang , Ji Zhang , Zheng Wang , Lianli Gao , Jingkuan Song , Nicu Sebe , Heng Tao Shen

Despite their strong performance in embodied tasks, recent Vision-Language-Action (VLA) models remain highly fragile under multimodal perturbations, where visual corruption and linguistic noise jointly induce distribution shifts that…

机器人学 · 计算机科学 2026-04-15 Yuhan Xie , Yuping Yan , Yunqi Zhao , Handing Wang , Yaochu Jin

Vision-based robotic policies often struggle with even minor viewpoint changes, underscoring the need for view-invariant visual representations. This challenge becomes more pronounced in real-world settings, where viewpoint variability is…

机器人学 · 计算机科学 2026-01-07 Youngjoon Jeong , Junha Chun , Taesup Kim

Vision-Language-Action (VLA) models are emerging as a promising paradigm for end-to-end autonomous driving, valued for their potential to leverage world knowledge and reason about complex driving scenes. However, existing methods suffer…

计算机视觉与模式识别 · 计算机科学 2026-03-03 Xinyang Wang , Qian Liu , Wenjie Ding , Zhao Yang , Wei Li , Chang Liu , Bailin Li , Kun Zhan , Xianpeng Lang , Wei Chen

Vision-Language-Action (VLA) models have emerged as a powerful framework that unifies perception, language, and control, enabling robots to perform diverse tasks through multimodal understanding. However, current VLA models typically…

Recent high-capacity vision-language-action (VLA) models have demonstrated impressive performance on a range of robotic manipulation tasks by imitating human demonstrations. However, exploiting offline data with limited visited states will…

机器人学 · 计算机科学 2025-05-27 Guanxing Lu , Wenkai Guo , Chubin Zhang , Yuheng Zhou , Haonan Jiang , Zifeng Gao , Yansong Tang , Ziwei Wang

In this study, we address the problem of language-guided robotic manipulation, where a robot is required to manipulate a wide range of objects based on visual observations and natural language instructions. This task is essential for…

机器人学 · 计算机科学 2026-03-17 Yusuke Takagi , Motonari Kambara , Daichi Yashima , Koki Seno , Kento Tokura , Komei Sugiura

Learning real-world robotic manipulation is challenging, particularly when limited demonstrations are available. Existing methods for few-shot manipulation often rely on simulation-augmented data or pre-built modules like grasping and pose…

A fundamental requirement for real-world robotic deployment is the ability to understand and respond to natural language instructions. Existing language-conditioned manipulation tasks typically assume that instructions are perfectly aligned…

Vision-Language-Action (VLA) models built on pretrained Vision-Language Models (VLMs) show strong potential but are limited in practicality due to their large parameter counts. To mitigate this issue, using a lightweight VLM has been…

计算机视觉与模式识别 · 计算机科学 2025-12-02 Chaojun Ni , Cheng Chen , Xiaofeng Wang , Zheng Zhu , Wenzhao Zheng , Boyuan Wang , Tianrun Chen , Guosheng Zhao , Haoyun Li , Zhehao Dong , Qiang Zhang , Yun Ye , Yang Wang , Guan Huang , Wenjun Mei

Vision-language-action (VLA) models have shown strong generalization for robotic action prediction through large-scale vision-language pretraining. However, most existing models rely solely on RGB cameras, limiting their perception and,…

计算机视觉与模式识别 · 计算机科学 2026-03-03 Heyu Guo , Shanmu Wang , Ruichun Ma , Shiqi Jiang , Yasaman Ghasempour , Omid Abari , Baining Guo , Lili Qiu

Magnetically actuated microrobots have been used as wireless, non-contact manipulation tools at microscales, making them promising for minimally invasive applications. However, their control remains challenging due to indirect actuation,…

机器人学 · 计算机科学 2026-05-28 Yongchen Wang , Kangyi Lu , Lan Wei , Dandan Zhang

General-purpose robots must master long-horizon manipulation, defined as tasks involving multiple kinematic structure changes (e.g., attaching or detaching objects) in unstructured environments. While Vision-Language-Action (VLA) models…

机器人学 · 计算机科学 2026-02-26 Yue Yang , Shuo Cheng , Yu Fang , Homanga Bharadhwaj , Mingyu Ding , Gedas Bertasius , Daniel Szafir

Vision-Language-Action (VLA) models have shown remarkable progress in embodied tasks recently, but most methods process visual observations independently at each timestep. This history-agnostic design treats robot manipulation as a Markov…

机器学习 · 计算机科学 2026-04-13 Lei Xiao , Jifeng Li , Juntao Gao , Feiyang Ye , Yan Jin , Jingjing Qian , Jing Zhang , Yong Wu , Xiaoyuan Yu

Large vision-language models (VLMs) excel at multimodal understanding but fall short when extended to embodied tasks, where instructions must be transformed into low-level motor actions. We introduce ST4VLA, a dual-system…

The rise of foundation models paves the way for generalist robot policies in the physical world. Existing methods relying on text-only instructions often struggle to generalize to unseen scenarios. We argue that interleaved image-text…

Vision-language-action (VLA) models have emerged as the next generation of models in robotics. However, despite leveraging powerful pre-trained Vision-Language Models (VLMs), existing end-to-end VLA systems often lose key capabilities…

机器人学 · 计算机科学 2025-06-02 Zhongyi Zhou , Yichen Zhu , Junjie Wen , Chaomin Shen , Yi Xu

Visual-Language-Action (VLA) models represent a paradigm shift in embodied AI, yet existing frameworks often struggle with imprecise spatial perception, suboptimal multimodal fusion, and instability in reinforcement learning. To bridge…

机器人学 · 计算机科学 2026-04-27 Haoxiang Jie , Yaoyuan Yan , Xiangyu Wei , Kailin Wang , Hongjie Yan , Zhiyou Heng , Daocheng Chen