English
Related papers

Related papers: Verifier-free Test-Time Sampling for Vision Langua…

200 papers

Vision-language action (VLA) policies often report strong manipulation benchmark performance with relatively few demonstrations, but it remains unclear whether this reflects robust language-to-object grounding or reliance on…

Robotics · Computer Science 2026-03-02 David Emukpere , Romain Deffayet , Jean-Michel Renders

Vision-Language-Action (VLA) models have demonstrated strong multi-modal reasoning capabilities, enabling direct action generation from visual perception and language instructions in an end-to-end manner. However, their substantial…

Robotics · Computer Science 2025-10-22 Siyu Xu , Yunke Wang , Chenghao Xia , Dihao Zhu , Tao Huang , Chang Xu

Vision-Language-Action (VLA) models aim to unify perception, language understanding, and action generation, offering strong cross-task and cross-scene generalization with broad impact on embodied AI. However, current VLA models often lack…

Computer Vision and Pattern Recognition · Computer Science 2025-10-03 Angen Ye , Zeyu Zhang , Boyuan Wang , Xiaofeng Wang , Dapeng Zhang , Zheng Zhu

Vision-Language-Action (VLA) models show strong potential for general-purpose robotic manipulation, yet their closed-loop reliability often degrades under local deployment conditions. Existing evaluations typically treat test episodes as…

Robotics · Computer Science 2026-05-13 Jianchao Zhao , Huoren Yang , Yusong Hu , Yuyang Gao , Qiguan Ou , Cong Wan , SongLin Dong , Zhiheng Ma , Yihong Gong

Multi-agent reinforcement learning (MARL) commonly relies on a centralized critic to estimate the value function. However, learning such a critic from scratch is highly sample-inefficient and often lacks generalization across environments.…

Robotics · Computer Science 2026-03-17 Shahil Shaik , Aditya Parameshwaran , Anshul Nayak , Jonathon M. Smereka , Yue Wang

Vision-Language-Action (VLA) models show strong generalization for robotic control, but finetuning them with reinforcement learning (RL) is constrained by the high cost and safety risks of real-world interaction. Training VLA models in…

Robotics · Computer Science 2026-03-24 Zhilong Zhang , Haoxiang Ren , Yihao Sun , Yifei Sheng , Haonan Wang , Haoxin Lin , Zhichao Wu , Pierre-Luc Bacon , Yang Yu

Multimodal Large Language Models (MLLMs) excel in understanding complex language and visual data, enabling generalist robotic systems to interpret instructions and perform embodied tasks. Nevertheless, their real-world deployment is…

Robotics · Computer Science 2025-04-15 Rongyu Zhang , Menghang Dong , Yuan Zhang , Liang Heng , Xiaowei Chi , Gaole Dai , Li Du , Yuan Du , Shanghang Zhang

Current Vision-Language-Action (VLA) models predominantly rely on end-to-end fine-tuning. While effective, this paradigm compromises the inherent generalization capabilities of Vision-Language Models (VLMs) and incurs catastrophic…

Vision language models (VLMs) like CLIP show stellar zero-shot capability on classification benchmarks. However, selecting the VLM with the highest performance on the unlabeled downstream task is non-trivial. Existing VLM selection methods…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Yuhe Ding , Bo Jiang , Aihua Zheng , Qin Xu , Jian Liang

Vision-Language-Action (VLA) models show promise for robotic control, yet performance in complex household environments remains sub-optimal. Mobile manipulation requires reasoning about global scene layout, fine-grained geometry, and…

Robotics · Computer Science 2026-03-25 Ruisen Tu , Arth Shukla , Sohyun Yoo , Xuanlin Li , Junxi Li , Jianwen Xie , Hao Su , Zhuowen Tu

Vision-Language-Action (VLA) models have made substantial progress by leveraging the robust capabilities of Visual Language Models (VLMs). However, VLMs' significant parameter size and autoregressive (AR) decoding nature impose considerable…

Machine Learning · Computer Science 2025-09-23 Songsheng Wang , Rucheng Yu , Zhihang Yuan , Chao Yu , Feng Gao , Yu Wang , Derek F. Wong

Leveraging diverse robotic data for pretraining remains a critical challenge. Existing methods typically model the dataset's action distribution using simple observations as inputs. However, these inputs are often incomplete, resulting in a…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Jiahui Zhang , Yurui Chen , Yueming Xu , Ze Huang , Yanpeng Zhou , Yu-Jie Yuan , Xinyue Cai , Guowei Huang , Xingyue Quan , Hang Xu , Li Zhang

Small Vision-Language Models (VLMs) provide a computationally efficient alternative to larger models, at the cost of weaker generalization abilities and downstream task performance. These shortcomings could be addressed by test-time scaling…

Machine Learning · Computer Science 2026-02-17 Mehmet Onurcan Kaya , Desmond Elliott , Dim P. Papadopoulos

Online reinforcement learning in complex tasks is time-consuming, as massive interaction steps are needed to learn the optimal Q-function.Vision-language action (VLA) policies represent a promising direction for solving diverse tasks;…

Machine Learning · Computer Science 2025-09-26 Xiefeng Wu , Jing Zhao , Shu Zhang , Mingyu Hu

One promise that Vision-Language-Action (VLA) models hold over traditional imitation learning for robotics is to leverage the broad generalization capabilities of large Vision-Language Models (VLMs) to produce versatile, "generalist" robot…

Robotics · Computer Science 2025-06-12 Irving Fang , Juexiao Zhang , Shengbang Tong , Chen Feng

Large-scale generative models are shown to be useful for sampling meaningful candidate solutions, yet they often overlook task constraints and user preferences. Their full power is better harnessed when the models are coupled with external…

Artificial Intelligence · Computer Science 2024-08-13 Lin Guan , Yifan Zhou , Denis Liu , Yantian Zha , Heni Ben Amor , Subbarao Kambhampati

While Vision-Language-Action (VLA) models show strong promise for generalist robot control, it remains unclear whether -- and under what conditions -- the standard "scale data" recipe translates to robotics, where training data is…

This study evaluates two leading approaches for teaching construction robots new skills to understand their applicability for construction automation: a Vision-Language-Action (VLA) model and Reinforcement Learning (RL) methods. The goal is…

Robotics · Computer Science 2026-03-02 Zhaofeng Hu , Hongrui Yu , Vaidhyanathan Chandramouli , Ci-Jyun Liang

The rapid advancement of generative AI and multi-modal foundation models has shown significant potential in advancing robotic manipulation. Vision-language-action (VLA) models, in particular, have emerged as a promising approach for…

Software Engineering · Computer Science 2025-05-13 Zhijie Wang , Zhehua Zhou , Jiayang Song , Yuheng Huang , Zhan Shu , Lei Ma

Vision-language-action models (VLAs) have become increasingly popular in robot manipulation for their end-to-end design and remarkable performance. However, existing VLAs rely heavily on vision-language models (VLMs) that only support…

Robotics · Computer Science 2025-02-24 Wei Zhao , Pengxiang Ding , Min Zhang , Zhefei Gong , Shuanghao Bai , Han Zhao , Donglin Wang