English
Related papers

Related papers: ReinboT: Amplifying Robot Visual-Language Manipula…

200 papers

Recent advances in Vision-Language-Action (VLA) models have enabled robotic agents to integrate multimodal understanding with action execution. However, our empirical analysis reveals that current VLAs struggle to allocate visual attention…

Vision-language-action (VLA) models that directly predict multi-step action chunks from current observations face inherent limitations due to constrained scene understanding and weak future anticipation capabilities. In contrast, video…

Vision-Language-Action (VLA) models have recently emerged as a promising paradigm for robotic manipulation, in which reliable action prediction critically depends on accurately interpreting and integrating visual observations conditioned on…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Yulin Luo , Hao Chen , Zhuangzhe Wu , Bowen Sui , Jiaming Liu , Chenyang Gu , Zhuoyang Liu , Qiuxuan Feng , Jiale Yu , Shuo Gu , Peng Jia , Pheng-Ann Heng , Shanghang Zhang

Developing versatile quadruped robots that can smoothly perform various actions and tasks in real-world environments remains a significant challenge. This paper introduces a novel vision-language-action (VLA) model, mixture of robotic…

Robotics · Computer Science 2025-03-12 Han Zhao , Wenxuan Song , Donglin Wang , Xinyang Tong , Pengxiang Ding , Xuelian Cheng , Zongyuan Ge

Recent advances in reinforcement learning (RL) have substantially improved the training of large-scale language models, leading to significant gains in generation quality and reasoning ability. However, most existing research focuses on…

Machine Learning · Computer Science 2026-01-13 Di Zhang , Xun Wu , Shaohan Huang , Lingjie Jiang , Yaru Hao , Li Dong , Zewen Chi , Zhifang Sui , Furu Wei

Visual-Language-Action (VLA) models have demonstrated strong cross-scenario generalization capabilities in various robotic tasks through large-scale pre-training and task-specific fine-tuning. However, their training paradigm mainly relies…

Robotics · Computer Science 2025-09-30 Zengjue Chen , Runliang Niu , He Kong , Qi Wang , Qianli Xing , Zipei Fan

Vision-language-action (VLA) models demonstrate strong generalization in robotic manipulation but face challenges in complex, real-world tasks. While supervised fine-tuning with demonstrations is constrained by data quality, reinforcement…

Robotics · Computer Science 2025-09-18 Piaopiao Jin , Qi Wang , Guokang Sun , Ziwen Cai , Pinjia He , Yangwei You

Improving the reasoning capabilities of embodied agents is crucial for robots to complete complex human instructions in long-view manipulation tasks successfully. Despite the success of large language models and vision language models based…

Artificial Intelligence · Computer Science 2025-10-23 Jinrui Liu , Bingyan Nie , Boyu Li , Yaran Chen , Yuze Wang , Shunsen He , Haoran Li

Visual-Language-Action (VLA) models represent a paradigm shift in embodied AI, yet existing frameworks often struggle with imprecise spatial perception, suboptimal multimodal fusion, and instability in reinforcement learning. To bridge…

Robotics · Computer Science 2026-04-27 Haoxiang Jie , Yaoyuan Yan , Xiangyu Wei , Kailin Wang , Hongjie Yan , Zhiyou Heng , Daocheng Chen

The ability to efficiently and reliably learn new tasks has been a foundational challenge in robotics. Vision-Language-Action (VLA) models have demonstrated strong generalization across diverse manipulation tasks, yet pretrained policies…

Robotics · Computer Science 2026-05-26 Perry Dong , Kuo-Han Hung , Tian Gao , Dorsa Sadigh , Chelsea Finn

Vision-Language-Action (VLA) models have emerged as a powerful paradigm for robotic manipulation. However, existing post-training methods face a dilemma between stability and exploration: Supervised Fine-Tuning (SFT) is constrained by…

Robotics · Computer Science 2026-03-17 Jiashun Li , Xiaoyu Shi , Hong Xie , Mingsheng Shang , Yun Lu

Reinforcement Learning (RL) is a rapidly growing area of machine learning that finds its application in a broad range of domains, from finance and healthcare to robotics and gaming. Compared to other machine learning techniques, RL agents…

Artificial Intelligence · Computer Science 2024-11-14 Geetansh Kalra , Divye Singh , Justin Jose

Understanding real-world videos with complex semantics and long temporal dependencies remains a fundamental challenge in computer vision. Recent progress in multimodal large language models (MLLMs) has demonstrated strong capabilities in…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Hongyu Li , Songhao Han , Yue Liao , Junfeng Luo , Jialin Gao , Shuicheng Yan , Si Liu

In this paper, we explore deep reinforcement learning algorithms for vision-based robotic grasping. Model-free deep reinforcement learning (RL) has been successfully applied to a range of challenging environments, but the proliferation of…

Robotics · Computer Science 2018-03-30 Deirdre Quillen , Eric Jang , Ofir Nachum , Chelsea Finn , Julian Ibarz , Sergey Levine

Recent advancements in large language models (LLMs) have enabled understanding webpage contexts, product details, and human instructions. Utilizing LLMs as the foundational architecture for either reward models or policies in reinforcement…

Machine Learning · Computer Science 2024-08-30 Shuang Feng , Grace Feng

Reinforcement fine-tuning with verifiable rewards (RLVR) has emerged as a powerful paradigm for equipping large vision-language models (LVLMs) with agentic capabilities such as tool use and multi-step reasoning. Despite striking empirical…

Machine Learning · Computer Science 2026-04-23 Carter Adams , Rafael Oliveira , Gabriel Almeida , Sofia Torres

Recent vision-language-action models (VLAs) build upon pretrained vision-language models and leverage diverse robot datasets to demonstrate strong task execution, language following ability, and semantic generalization. Despite these…

Robotics · Computer Science 2025-04-29 Moo Jin Kim , Chelsea Finn , Percy Liang

To operate effectively in the real world, robots should integrate multimodal reasoning with precise action generation. However, existing vision-language-action (VLA) models often sacrifice one for the other, narrow their abilities to…

Robotics · Computer Science 2026-03-04 Shuai Yang , Hao Li , Bin Wang , Yilun Chen , Yang Tian , Tai Wang , Hanqing Wang , Feng Zhao , Yiyi Liao , Jiangmiao Pang

Current Vision-Language-Action (VLA) models typically treat the deepest representation of a vision-language backbone as universally optimal for action prediction. However, robotic manipulation is composed of many frequent closed-loop…

Artificial Intelligence · Computer Science 2026-05-12 Boyang Shen , Kaixiang Yang , Hao Wang , Qiuyu Yu , Qiang Xie , Qiang Li , Zhiwei Wang

Vision-language-action (VLA) models finetuned from vision-language models (VLMs) hold the promise of leveraging rich pretrained representations to build generalist robots across diverse tasks and environments. However, direct fine-tuning on…

Robotics · Computer Science 2025-09-18 Shresth Grover , Akshay Gopalkrishnan , Bo Ai , Henrik I. Christensen , Hao Su , Xuanlin Li