English
Related papers

Related papers: Run-time Observation Interventions Make Vision-Lan…

200 papers

Vision-Language-Action (VLA) models enable embodied decision-making but rely heavily on imitation learning, leading to compounding errors and poor robustness under distribution shift. Reinforcement learning (RL) can mitigate these issues…

Recent progress in Reinforcement Learning (RL) provides a principled approach to optimizing Vision-Language-Action (VLA) models, facilitating a shift from trajectory imitation to active learning in the task environment. Despite improvements…

Robotics · Computer Science 2026-05-19 Sixu Lin , Yunpeng Qing , Litao Liu , Ming Zhou , Ruixing Jin , Xiaoyi Fan , Guiliang Liu

We introduce Being-H0, a dexterous Vision-Language-Action model (VLA) trained on large-scale human videos. Existing VLAs struggle with complex manipulation tasks requiring high dexterity and generalize poorly to novel scenarios and tasks,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Hao Luo , Yicheng Feng , Wanpeng Zhang , Sipeng Zheng , Ye Wang , Haoqi Yuan , Jiazheng Liu , Chaoyi Xu , Qin Jin , Zongqing Lu

Vision-Language-Action (VLA) models have become a cornerstone in robotic policy learning, leveraging large-scale multimodal data for robust and scalable control. However, existing VLA frameworks primarily address short-horizon tasks, and…

Many robotic manipulation tasks require sensing and responding to force signals such as torque to assess whether the task has been successfully completed and to enable closed-loop control. However, current Vision-Language-Action (VLA)…

Robotics · Computer Science 2025-09-10 Zongzheng Zhang , Haobo Xu , Zhuo Yang , Chenghao Yue , Zehao Lin , Huan-ang Gao , Ziwei Wang , Hao Zhao

Vision-Language-Action (VLA) models are increasingly expected to not only complete robot tasks, but also follow human instructions about how those tasks should be executed. However, existing robot datasets usually pair trajectories with…

Vision-Language-Action (VLA) models have recently emerged as a powerful paradigm for robotic manipulation. Despite substantial progress enabled by large-scale pretraining and supervised fine-tuning (SFT), these models face two fundamental…

Current research on Vision-Language-Action (VLA) models predominantly focuses on enhancing generalization through established reasoning techniques. While effective, these improvements invariably increase computational complexity and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Riccardo Andrea Izzo , Gianluca Bardaro , Matteo Matteucci

Vision-Language-Action (VLA) models rely on current observations, including images, language instructions, and robot states, to predict actions and complete tasks. While accurate visual perception is crucial for precise action prediction…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Cheng Yang , Jianhao Jiao , Lingyi Huang , Jinqi Xiao , Zhexiang Tang , Yu Gong , Yibiao Ying , Yang Sui , Jintian Lin , Wen Huang , Bo Yuan

Vision-Language-Action (VLA) models are emerging as a next-generation paradigm for robotics. We introduce dVLA, a diffusion-based VLA that leverages a multimodal chain-of-thought to unify visual perception, language reasoning, and robotic…

Robotics · Computer Science 2025-10-01 Junjie Wen , Minjie Zhu , Jiaming Liu , Zhiyuan Liu , Yicun Yang , Linfeng Zhang , Shanghang Zhang , Yichen Zhu , Yi Xu

Vision-Language-Action (VLA) models offer a pivotal approach to learning robotic manipulation at scale by repurposing large pre-trained Vision-Language-Models (VLM) to output robotic actions. However, adapting VLMs for robotic domains comes…

Robotics · Computer Science 2025-09-30 Rokas Bendikas , Daniel Dijkman , Markus Peschl , Sanjay Haresh , Pietro Mazzaglia

Vision-Language-Action (VLA) models mark a transformative advancement in artificial intelligence, aiming to unify perception, natural language understanding, and embodied action within a single computational framework. This foundational…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Ranjan Sapkota , Yang Cao , Konstantinos I. Roumeliotis , Manoj Karkee

Enabling robots to perform diverse tasks across varied environments is a central challenge in robot learning. While vision-language-action (VLA) models have shown promise for generalizable robot skills, realizing their full potential…

Robotics · Computer Science 2025-08-12 Junjie Wen , Yichen Zhu , Jinming Li , Zhibin Tang , Chaomin Shen , Feifei Feng

Vision-Language Action (VLAs) models promise to extend the remarkable success of vision-language models (VLMs) to robotics. Yet, unlike VLMs in the vision-language domain, VLAs for robotics require finetuning to contend with varying…

Vision-Language-Action (VLA) models enable robots to understand and perform complex tasks from multimodal input. Although recent work explores using reinforcement learning (RL) to automate the laborious data collection process in scaling…

Machine Learning · Computer Science 2026-01-30 Kang Chen , Zhihao Liu , Tonghe Zhang , Zhen Guo , Si Xu , Hao Lin , Hongzhi Zang , Xiang Li , Quanlu Zhang , Zhaofei Yu , Guoliang Fan , Tiejun Huang , Yu Wang , Chao Yu

This paper presents RynnVLA-001, a vision-language-action(VLA) model built upon large-scale video generative pretraining from human demonstrations. We propose a novel two-stage pretraining methodology. The first stage, Ego-Centric Video…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Yuming Jiang , Siteng Huang , Shengke Xue , Yaxi Zhao , Jun Cen , Sicong Leng , Kehan Li , Jiayan Guo , Kexiang Wang , Mingxiu Chen , Fan Wang , Deli Zhao , Xin Li

One promise that Vision-Language-Action (VLA) models hold over traditional imitation learning for robotics is to leverage the broad generalization capabilities of large Vision-Language Models (VLMs) to produce versatile, "generalist" robot…

Robotics · Computer Science 2025-06-12 Irving Fang , Juexiao Zhang , Shengbang Tong , Chen Feng

Current Vision-Language-Action (VLA) models rely primarily on RGB perception, preventing them from capturing modalities such as thermal signals that are imperceptible to conventional visual sensors. Moreover, end-to-end generative policies…

Robotics · Computer Science 2026-03-09 Dian Yu , Qingchuan Zhou , Bingkun Huang , Majid Khadiv , Zewen Yang

Imitation learning has proven to be highly effective in teaching robots dexterous manipulation skills. However, it typically relies on large amounts of human demonstration data, which limits its scalability and applicability in dynamic,…

Robotics · Computer Science 2025-03-03 Minjie Zhu , Yichen Zhu , Jinming Li , Zhongyi Zhou , Junjie Wen , Xiaoyu Liu , Chaomin Shen , Yaxin Peng , Feifei Feng

Vision-language-action (VLA) models have shown strong potential for generalist robot manipulation, yet they remain limited by insufficient spatial reasoning, particularly in determining where to interact in complex visual scenes. While…

Robotics · Computer Science 2026-05-26 Runze Wang , Yuqian Fu , Yu Li , Tao Lin , Tianwen Qian , Mohamed Elhoseiny , Bo Zhao , Yanwei Fu , Yu-Gang Jiang , Xiangyang Xue