English
Related papers

Related papers: EXPO-FT: Sample-Efficient Reinforcement Learning F…

200 papers

Vision-Language-Action (VLA) models trained on large robot datasets promise general-purpose, robust control across diverse domains and embodiments. However, existing approaches often fail out-of-the-box when deployed in novel environments,…

Robotics · Computer Science 2025-10-21 Ruihan Zhao , Tyler Ingebrand , Sandeep Chinchali , Ufuk Topcu

Current Vision-Language-Action (VLA) models typically treat the deepest representation of a vision-language backbone as universally optimal for action prediction. However, robotic manipulation is composed of many frequent closed-loop…

Artificial Intelligence · Computer Science 2026-05-12 Boyang Shen , Kaixiang Yang , Hao Wang , Qiuyu Yu , Qiang Xie , Qiang Li , Zhiwei Wang

Reinforcement Fine-Tuning (RFT) in Large Reasoning Models like OpenAI o1 learns from feedback on its answers, which is especially useful in applications when fine-tuning data is scarce. Recent open-source work like DeepSeek-R1 demonstrates…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Ziyu Liu , Zeyi Sun , Yuhang Zang , Xiaoyi Dong , Yuhang Cao , Haodong Duan , Dahua Lin , Jiaqi Wang

Vision-Language-Action (VLA) models have recently advanced robotic manipulation by translating natural-language instructions and visual observations into control actions. However, existing VLAs are primarily trained on successful expert…

Robotics · Computer Science 2026-03-24 Zewei Ye , Weifeng Lu , Minghao Ye , Tao Lin , Shuo Yang , Junchi Yan , Bo Zhao

Vision-Language-Action (VLA) models demonstrate remarkable potential for generalizable robotic manipulation. The execution of complex multi-step behaviors in VLA models can be improved by robust instruction grounding, a critical component…

Parameter-efficient fine-tuning (PEFT) techniques such as low-rank adaptation (LoRA) can effectively adapt large pre-trained foundation models to downstream tasks using only a small fraction (0.1%-10%) of the original trainable weights. An…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Samar Khanna , Medhanie Irgau , David B. Lobell , Stefano Ermon

Vision-Language Action (VLAs) models promise to extend the remarkable success of vision-language models (VLMs) to robotics. Yet, unlike VLMs in the vision-language domain, VLAs for robotics require finetuning to contend with varying…

Vision-Language-Action (VLA) models, trained via flow-matching or diffusion objectives, excel at learning complex behaviors from large-scale, multi-modal datasets (e.g., human teleoperation, scripted policies). However, since VLAs…

Robotics · Computer Science 2025-12-03 Siyuan Yang , Yang Zhang , Haoran He , Ling Pan , Xiu Li , Chenjia Bai , Xuelong Li

The recent advancements in Vision Language Models (VLMs) have demonstrated progress toward true intelligence requiring robust reasoning capabilities. Beyond pattern recognition, linguistic reasoning must integrate with visual comprehension,…

Artificial Intelligence · Computer Science 2026-04-06 Yunfei Bai , Amit Dhanda , Shekhar Jain

Vision-Language Models (VLMs) have emerged as a promising approach to address the data scarcity challenge in robotics, enabling the development of generalizable visuomotor control policies. While models like OpenVLA showcase the potential…

Reinforcement learning (RL) has recently shown strong potential in improving the reasoning capabilities of large language models and is now being actively extended to vision-language models (VLMs). However, existing RL applications in VLMs…

Machine Learning · Computer Science 2025-04-07 Yan Ma , Steffi Chern , Xuyang Shen , Yiran Zhong , Pengfei Liu

Vision-Language-Action (VLA) models have demonstrated significant potential in the field of embodied intelligence, enabling agents to follow human instructions to complete complex tasks in physical environments. Existing embodied agents are…

Robotics · Computer Science 2025-05-27 Junyang Shu , Zhiwei Lin , Yongtao Wang

Vision-language-action (VLA) models represent a promising direction for developing general-purpose robotic systems, demonstrating the ability to combine visual understanding, language comprehension, and action generation. However,…

Robotics · Computer Science 2024-12-10 Pranav Guruprasad , Harshvardhan Sikka , Jaewoo Song , Yangyue Wang , Paul Pu Liang

Vision-Language-Action (VLA) models have emerged as a powerful framework that unifies perception, language, and control, enabling robots to perform diverse tasks through multimodal understanding. However, current VLA models typically…

Vision-Language-Action (VLA) models have achieved remarkable success in robotic manipulation. However, their robustness to linguistic nuances remains a critical, under-explored safety concern, posing a significant safety risk to real-world…

Robotics · Computer Science 2026-04-08 Baoshun Tong , Haoran He , Ling Pan , Yang Liu , Liang Lin

Unconstrained fine-tuning of flow-matching Vision-Language-Action (VLA) models drives dense parameter overwrites, degrading pre-trained capabilities. We present Conservative Supervised Fine-Tuning (ConSFT), an optimization objective that…

Robotics · Computer Science 2026-05-20 Tianyi Zhang , Shaopeng Zhai , Haoran Zhang , Fuxian Huang , Qi Zhang

Robotic systems are increasingly expected to operate in human-centered, unstructured environments where safety, adaptability, and generalization are essential. Vision-Language-Action (VLA) models have been proposed as a language guided…

Robotics · Computer Science 2025-10-21 Haochen Su , Cristian Meo , Francesco Stella , Andrea Peirone , Kai Junge , Josie Hughes

Vision-Language-Action (VLA) models are increasingly expected to not only complete robot tasks, but also follow human instructions about how those tasks should be executed. However, existing robot datasets usually pair trajectories with…

Vision-Language-Action (VLA) models rely on current observations, including images, language instructions, and robot states, to predict actions and complete tasks. While accurate visual perception is crucial for precise action prediction…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Cheng Yang , Jianhao Jiao , Lingyi Huang , Jinqi Xiao , Zhexiang Tang , Yu Gong , Yibiao Ying , Yang Sui , Jintian Lin , Wen Huang , Bo Yuan

Vision-Language-Action (VLA) models extend vision-language models to embodied control by mapping natural-language instructions and visual observations to robot actions. Despite their capabilities, VLA systems face significant challenges due…

Robotics · Computer Science 2025-10-24 Weifan Guan , Qinghao Hu , Aosheng Li , Jian Cheng