English
Related papers

Related papers: MiVLA: Towards Generalizable Vision-Language-Actio…

200 papers

Vision Language Models (VLMs) have recently been leveraged to generate robotic actions, forming Vision-Language-Action (VLA) models. However, directly adapting a pretrained VLM for robotic control remains challenging, particularly when…

While Vision-Language-Action (VLA) models have demonstrated remarkable success in robotic manipulation, their application has largely been confined to low-degree-of-freedom end-effectors performing simple, vision-guided pick-and-place…

Robotics · Computer Science 2026-03-10 Tutian Tang , Xingyu Ji , Wanli Xing , Ce Hao , Wenqiang Xu , Lin Shao , Cewu Lu , Qiaojun Yu , Jiangmiao Pang , Kaifeng Zhang

Vision-Language-Action (VLA) models extend vision-language models to embodied control by mapping natural-language instructions and visual observations to robot actions. Despite their capabilities, VLA systems face significant challenges due…

Robotics · Computer Science 2025-10-24 Weifan Guan , Qinghao Hu , Aosheng Li , Jian Cheng

In contrast to single-skill tasks, long-horizon tasks play a crucial role in our daily life, e.g., a pouring task requires a proper concatenation of reaching, grasping and pouring subtasks. As an efficient solution for transferring human…

Robotics · Computer Science 2024-10-03 Shaokang Wu , Yijin Wang , Yanlong Huang

Vision-Language-Action (VLA) models have become a cornerstone in robotic policy learning, leveraging large-scale multimodal data for robust and scalable control. However, existing VLA frameworks primarily address short-horizon tasks, and…

Vision-language-action (VLA) models have emerged as the next generation of models in robotics. However, despite leveraging powerful pre-trained Vision-Language Models (VLMs), existing end-to-end VLA systems often lose key capabilities…

Robotics · Computer Science 2025-06-02 Zhongyi Zhou , Yichen Zhu , Junjie Wen , Chaomin Shen , Yi Xu

Vision-Language-Action~(VLA) models have shown strong potential for general-purpose robotic manipulation, yet they still struggle to generalize to unseen tasks that necessitate transferring relevant experience across objects, scenes, and…

Robotics · Computer Science 2026-05-29 Shengyu Si , Yuanzhuo Lu , Ruimeng Yang , Ziyi Ye , Zuxuan Wu , Yu-Gang Jiang

Vision-Language-Action (VLA) models have recently shown impressive generalization and language-guided manipulation capabilities. However, their performance degrades on tasks requiring precise spatial reasoning due to limited spatial…

Computer Vision and Pattern Recognition · Computer Science 2025-10-16 Tianyuan Yuan , Yicheng Liu , Chenhao Lu , Zhuoguang Chen , Tao Jiang , Hang Zhao

Vision-Language-Action (VLA) models have recently emerged as powerful generalists for robotic manipulation. However, due to their predominant reliance on visual modalities, they fundamentally lack the physical intuition required for…

Robotics · Computer Science 2026-02-02 Yuzhe Huang , Pei Lin , Wanlin Li , Daohan Li , Jiajun Li , Jiaming Jiang , Chenxi Xiao , Ziyuan Jiao

Vision-Language-Action (VLA) models have recently made significant advance in multi-task, end-to-end robotic control, due to the strong generalization capabilities of Vision-Language Models (VLMs). A fundamental challenge in developing such…

Robotics · Computer Science 2025-06-17 Yuqing Wen , Kefan Gu , Haoxuan Liu , Yucheng Zhao , Tiancai Wang , Haoqiang Fan , Xiaoyan Sun

Prompt-based learning has emerged as a successful paradigm in natural language processing, where a single general-purpose language model can be instructed to perform any task specified by input prompts. Yet task specification in robotics…

Teaching robots dexterous skills from human videos remains challenging due to the reliance on low-level trajectory imitation, which fails to generalize across object types, spatial layouts, and manipulator configurations. We propose…

Robotics · Computer Science 2026-02-10 Shunlei Li , Longsen Gao , Jin Wang , Chang Che , Xi Xiao , Jiuwen Cao , Yingbai Hu , Hamid Reza Karimi

Vision-Language-Action (VLA) models trained via imitation learning suffer from significant performance degradation in data-scarce scenarios due to their reliance on large-scale demonstration datasets. Although reinforcement learning…

Robotics · Computer Science 2026-04-28 Junjin Xiao , Yandan Yang , Xinyuan Chang , Ronghan Chen , Feng Xiong , Mu Xu , Wei-Shi Zheng , Qing Zhang

Embodied intelligence is often studied through specialized models for individual tasks such as manipulation or navigation, resulting in fragmented capabilities and limited generalization across tasks, environments, and robot embodiments. In…

Recent Vision-Language-Action (VLA) models built on pre-trained Vision-Language Models (VLMs) require extensive post-training, resulting in high computational overhead that limits scalability and deployment.We propose CogVLA, a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Wei Li , Renshan Zhang , Rui Shao , Jie He , Liqiang Nie

Robotic manipulation, a key frontier in robotics and embodied AI, requires precise motor control and multimodal understanding, yet traditional rule-based methods fail to scale or generalize in unstructured, novel environments. In recent…

Robotics · Computer Science 2025-09-04 Rui Shao , Wei Li , Lingsen Zhang , Renshan Zhang , Zhiyang Liu , Ran Chen , Liqiang Nie

Vision-Language-Action (VLA) models show promise in embodied reasoning, yet remain far from true generalists-they often require task-specific fine-tuning, incur high compute costs, and generalize poorly to unseen tasks. We propose MetaVLA,…

Artificial Intelligence · Computer Science 2026-01-29 Chen Li , Zhantao Yang , Han Zhang , Fangyi Chen , Chenchen Zhu , Anudeepsekhar Bolimera , Marios Savvides

Vision-Language-Action (VLA) models have emerged as promising solutions for robotic manipulation, yet their robustness to real-world physical variations remains critically underexplored. To bridge this gap, we propose Eva-VLA, the first…

Robotics · Computer Science 2026-03-17 Hanqing Liu , Shouwei Ruan , Jiahuan Long , Junqi Wu , Jiacheng Hou , Huili Tang , Tingsong Jiang , Weien Zhou , Wen Yao

Vision-Language-Action (VLA) models are driving rapid progress in robotics by enabling agents to interpret multimodal inputs and execute complex, long-horizon tasks. However, their safety and robustness against adversarial attacks remain…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Xin Wang , Jie Li , Zejia Weng , Yixu Wang , Yifeng Gao , Tianyu Pang , Chao Du , Yan Teng , Yingchun Wang , Zuxuan Wu , Xingjun Ma , Yu-Gang Jiang

We introduce VIOLA, an object-centric imitation learning approach to learning closed-loop visuomotor policies for robot manipulation. Our approach constructs object-centric representations based on general object proposals from a…

Robotics · Computer Science 2023-03-09 Yifeng Zhu , Abhishek Joshi , Peter Stone , Yuke Zhu