English
Related papers

Related papers: On-the-Fly VLA Adaptation via Test-Time Reinforcem…

200 papers

Vision-Language-Action (VLA) models advance robotic control via strong visual-linguistic priors. However, existing VLAs predominantly frame pretraining as supervised behavior cloning, overlooking the fundamental nature of robot learning as…

Artificial Intelligence · Computer Science 2026-05-01 Yang Zhang , Jiangyuan Zhao , Chenyou Fan , Fangzheng Yan , Tian Li , Haitong Tang , Sen Fu , Xuan'er Wu , Qizhen Weng , Weinan Zhang , Xiu Li , Chi Zhang , Chenjia Bai , Xuelong Li

Vision-Language-Action (VLA) models offer promising capabilities for autonomous driving through multimodal understanding. However, their utilization in safety-critical scenarios is constrained by inherent limitations, including imprecise…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Yiru Wang , Zichong Gu , Yu Gao , Anqing Jiang , Zhigang Sun , Shuo Wang , Yuwen Heng , Hao Sun

Robotic manipulation, a key frontier in robotics and embodied AI, requires precise motor control and multimodal understanding, yet traditional rule-based methods fail to scale or generalize in unstructured, novel environments. In recent…

Robotics · Computer Science 2025-09-04 Rui Shao , Wei Li , Lingsen Zhang , Renshan Zhang , Zhiyang Liu , Ran Chen , Liqiang Nie

Vision-Language-Action (VLA) models have gained much attention from the research community thanks to their strength in translating multimodal observations with linguistic instructions into desired robotic actions. Despite their…

Vision-Language-Action (VLA) models have recently shown impressive generalization and language-guided manipulation capabilities. However, their performance degrades on tasks requiring precise spatial reasoning due to limited spatial…

Computer Vision and Pattern Recognition · Computer Science 2025-10-16 Tianyuan Yuan , Yicheng Liu , Chenhao Lu , Zhuoguang Chen , Tao Jiang , Hang Zhao

Vision-language-action (VLA) models show potential for general robotic tasks, but remain challenging in spatiotemporally coherent manipulation, which requires fine-grained representations. Typically, existing methods embed 3D positions into…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Hanyu Zhou , Chuanhao Ma , Gim Hee Lee

Despite advances in Vision-Language-Action (VLA) models, robotic manipulation struggles with fine-grained tasks because current models lack mechanisms for active visual attention allocation. Human gaze naturally encodes intent, planning,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Anupam Pani , Yanchao Yang

To teach robots complex manipulation tasks, a common approach is to fine-tune a pre-trained vision-language-action model (VLA) on task-specific data. However, since this recipe updates existing representations, it is unsuitable for…

Robotics · Computer Science 2026-05-18 Ralf Römer , Yi Zhang , Yuming Li , Angela P. Schoellig

Autonomous navigation in highly constrained environments remains challenging for mobile robots. Classical navigation approaches offer safety assurances but require environment-specific parameter tuning; end-to-end learning bypasses…

Robotics · Computer Science 2026-03-11 Yuanjie Lu , Beichen Wang , Zhengqi Wu , Yang Li , Xiaomin Lin , Chengzhi Mao , Xuesu Xiao

Improving embodied reasoning in multimodal-large-language models (MLLMs) is essential for building vision-language-action models (VLAs) on top of them to readily translate multimodal understanding into low-level actions. Accordingly, recent…

Artificial Intelligence · Computer Science 2026-03-24 Dongyoung Kim , Sumin Park , Woomin Song , Seungku Kim , Taeyoung Kim , Huiwon Jang , Jinwoo Shin , Jaehyung Kim , Younggyo Seo

Reinforcement Learning (RL) has shown great potential in refining robotic manipulation policies, yet its efficacy remains strongly bottlenecked by the difficulty of designing generalizable reward functions. In this paper, we propose a…

Robotics · Computer Science 2026-03-24 Yanru Wu , Weiduo Yuan , Ang Qi , Vitor Guizilini , Jiageng Mao , Yue Wang

Reinforcement learning (RL) can enable task-oriented dialogue systems to steer the conversation towards successful task completion. In an end-to-end setting, a response can be constructed in a word-level sequential decision making process…

Computation and Language · Computer Science 2020-11-19 Nurul Lubis , Christian Geishauser , Michael Heck , Hsien-chin Lin , Marco Moresi , Carel van Niekerk , Milica Gašić

Vision-Language Action (VLA) models significantly advance robotic manipulation by leveraging the strong perception capabilities of pretrained vision-language models (VLMs). By integrating action modules into these pretrained models, VLA…

Computer Vision and Pattern Recognition · Computer Science 2025-10-20 Shaoqi Dong , Chaoyou Fu , Haihan Gao , Yi-Fan Zhang , Chi Yan , Chu Wu , Xiaoyu Liu , Yunhang Shen , Jing Huo , Deqiang Jiang , Haoyu Cao , Yang Gao , Xing Sun , Ran He , Caifeng Shan

We propose a CompliantVLA-adaptor that augments the state-of-the-art Vision-Language-Action (VLA) models with vision-language model (VLM)-informed context-aware variable impedance control (VIC) to improve the safety and effectiveness of…

In recent years, unmanned aerial vehicle (UAV) related technology has expanded knowledge in the area, bringing to light new problems and challenges that require solutions. Furthermore, because the technology allows processes usually carried…

Artificial Intelligence · Computer Science 2022-12-08 Cristian Millán-Arias , Ruben Contreras , Francisco Cruz , Bruno Fernandes

Vision-language-action (VLA) models have shown strong potential for generalist robot manipulation, yet they remain limited by insufficient spatial reasoning, particularly in determining where to interact in complex visual scenes. While…

Robotics · Computer Science 2026-05-26 Runze Wang , Yuqian Fu , Yu Li , Tao Lin , Tianwen Qian , Mohamed Elhoseiny , Bo Zhao , Yanwei Fu , Yu-Gang Jiang , Xiangyang Xue

Vision Language Action (VLA) models represent a transformative shift in robotics, with the aim of unifying visual perception, natural language understanding, and embodied control within a single learning framework. This review presents a…

Robotics · Computer Science 2026-01-21 Muhayy Ud Din , Waseem Akram , Lyes Saad Saoud , Jan Rosell , Irfan Hussain

Vision-language-action (VLA) models extend vision-language models (VLM) by integrating action generation modules for robotic manipulation. Leveraging the strengths of VLM in vision perception and instruction understanding, VLA models…

Vision-Language Models (VLMs) have emerged as a promising approach to address the data scarcity challenge in robotics, enabling the development of generalizable visuomotor control policies. While models like OpenVLA showcase the potential…

Vision-language-action models (VLAs) have shown potential in leveraging pretrained vision-language models and diverse robot demonstrations for learning generalizable sensorimotor control. While this paradigm effectively utilizes large-scale…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Qingqing Zhao , Yao Lu , Moo Jin Kim , Zipeng Fu , Zhuoyang Zhang , Yecheng Wu , Zhaoshuo Li , Qianli Ma , Song Han , Chelsea Finn , Ankur Handa , Ming-Yu Liu , Donglai Xiang , Gordon Wetzstein , Tsung-Yi Lin