English
Related papers

Related papers: STARE-VLA: Progressive Stage-Aware Reinforcement f…

200 papers

Vision-Language-Action (VLA) models remain brittle in long-horizon, contact-rich manipulation because success-only imitation provides little supervision for execution drift, while failed rollouts are often discarded. We introduce RePO-VLA,…

Supervised fine-tuning (SFT) has become the de facto post-training strategy for large vision-language-action (VLA) models, but its reliance on costly human demonstrations limits scalability and generalization. We propose Probe, Learn,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Wenli Xiao , Haotian Lin , Andy Peng , Haoru Xue , Tairan He , Yuqi Xie , Fengyuan Hu , Jimmy Wu , Zhengyi Luo , Linxi "Jim" Fan , Guanya Shi , Yuke Zhu

Large Vision-Language Action (VLA) models have shown significant potential for embodied AI. However, their predominant training via supervised fine-tuning (SFT) limits generalization due to susceptibility to compounding errors under…

Machine Learning · Computer Science 2026-01-15 Jijia Liu , Feng Gao , Bingwen Wei , Xinlei Chen , Qingmin Liao , Yi Wu , Chao Yu , Yu Wang

Vision-Language-Action (VLA) models such as OpenVLA, Octo, and $\pi_0$ have shown strong generalization by leveraging large-scale demonstrations, yet their performance is still fundamentally constrained by the quality and coverage of…

Machine Learning · Computer Science 2025-10-14 Mingyang Lyu , Yinqian Sun , Erliang Lin , Huangrui Li , Ruolin Chen , Feifei Zhao , Yi Zeng

Recent studies have successfully integrated large vision-language models (VLMs) into low-level robotic control by supervised fine-tuning (SFT) with expert robotic datasets, resulting in what we term vision-language-action (VLA) models.…

Robotics · Computer Science 2025-01-29 Yanjiang Guo , Jianke Zhang , Xiaoyu Chen , Xiang Ji , Yen-Jen Wang , Yucheng Hu , Jianyu Chen

Red-teaming Vision-Language Models is essential for identifying vulnerabilities where adversarial image-text inputs trigger toxic outputs. Existing approaches treat image generation as a black box, returning only terminal toxicity scores…

Cryptography and Security · Computer Science 2026-05-08 Xutao Mao , Liangjie Zhao , Tao Liu , Xiang Zheng , Hongying Zan , Cong Wang

Vision-Language-Action (VLA) models show promising ability in language-guided robotic tasks. However, making VLA policies reliable remains challenging, because a manipulation task is completed through closed-loop interaction, where each…

Robotics · Computer Science 2026-05-20 Peizheng Guo , Jingyao Wang , Changwen Zheng , Wenwen Qiang

Reinforcement learning (RL) fine-tuning has shown promise for Vision-Language-Action (VLA) models in robotic manipulation, but deployment-time visual shifts pose practical challenges. A key difficulty is that standard task rewards supervise…

Robotics · Computer Science 2026-05-14 Yuanfang Peng , Jingjing Fu , Chuheng Zhang , Li Zhao , Jiang Bian , Mingyu Liu , Ling Zhang , Jun Zhang , Rui Wang

Achieving truly adaptive embodied intelligence requires agents that learn not just by imitating static demonstrations, but by continuously improving through environmental interaction, which is akin to how humans master skills through…

Robotics · Computer Science 2025-12-17 Zechen Bai , Chen Gao , Mike Zheng Shou

Vision-Language Action (VLAs) models promise to extend the remarkable success of vision-language models (VLMs) to robotics. Yet, unlike VLMs in the vision-language domain, VLAs for robotics require finetuning to contend with varying…

Vision-Language-Action (VLA) models have emerged as a promising approach for general-purpose robot manipulation. However, their generalization is inconsistent: while these models can perform impressively in some settings, fine-tuned…

Robotics · Computer Science 2026-03-20 Aiden Swann , Lachlain McGranahan , Hugo Buurmeijer , Monroe Kennedy , Mac Schwager

Vision-Language-Action (VLA) models have emerged as a promising paradigm for general-purpose robotic control, with test-time scaling (TTS) gaining attention to enhance robustness beyond training. However, existing TTS methods for VLAs…

Robotics · Computer Science 2026-02-05 Hyeonbeom Choi , Daechul Ahn , Youhan Lee , Taewook Kang , Seongwon Cho , Jonghyun Choi

Long-horizon robotic manipulation remains challenging for Vision-Language-Action (VLA) models despite recent progress in zero-shot generalization and simulation-to-real-world transfer. Current VLA models suffer from stage hallucination,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Zeting Liu , Zida Yang , Zeyu Zhang , Hao Tang

Vision-Language-Action (VLA) models enable embodied decision-making but rely heavily on imitation learning, leading to compounding errors and poor robustness under distribution shift. Reinforcement learning (RL) can mitigate these issues…

Vision-Language-Action (VLA) models have recently emerged as a powerful paradigm for robotic manipulation. Despite substantial progress enabled by large-scale pretraining and supervised fine-tuning (SFT), these models face two fundamental…

Flow-based vision-language-action (VLA) models excel in embodied control but suffer from intractable likelihoods during multi-step sampling, hindering online reinforcement learning. We propose \textbf{\textit{$\boldsymbol{\pi}$-StepNFT}}…

Robotics · Computer Science 2026-03-10 Siting Wang , Xiaofeng Wang , Zheng Zhu , Minnan Pei , Xinyu Cui , Cheng Deng , Jian Zhao , Guan Huang , Haifeng Zhang , Jun Wang

Vision-Language-Action (VLA) models have shown promising capabilities for embodied intelligence, but most existing approaches rely on text-based chain-of-thought reasoning where visual inputs are treated as static context. This limits the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Chaoyang Wang , Wenrui Bao , Sicheng Gao , Bingxin Xu , Yu Tian , Yogesh S. Rawat , Yunhao Ge , Yuzhang Shang

Vision-Language-Action (VLA) models excel in robotic manipulation but are constrained by their heavy reliance on expert demonstrations, leading to demonstration bias and limiting performance. Reinforcement learning (RL) is a vital…

Robotics · Computer Science 2025-12-02 Senyu Fei , Siyin Wang , Li Ji , Ao Li , Shiduo Zhang , Liming Liu , Jinlong Hou , Jingjing Gong , Xianzhong Zhao , Xipeng Qiu

Vision-Language-Action (VLA) models, trained via flow-matching or diffusion objectives, excel at learning complex behaviors from large-scale, multi-modal datasets (e.g., human teleoperation, scripted policies). However, since VLAs…

Robotics · Computer Science 2025-12-03 Siyuan Yang , Yang Zhang , Haoran He , Ling Pan , Xiu Li , Chenjia Bai , Xuelong Li

Recent vision-language-action models (VLAs) build upon pretrained vision-language models and leverage diverse robot datasets to demonstrate strong task execution, language following ability, and semantic generalization. Despite these…

Robotics · Computer Science 2025-04-29 Moo Jin Kim , Chelsea Finn , Percy Liang
‹ Prev 1 2 3 10 Next ›