English
Related papers

Related papers: QUAR-VLA: Vision-Language-Action Model for Quadrup…

200 papers

In this study, we are interested in imbuing robots with the capability of physically-grounded task planning. Recent advancements have shown that large language models (LLMs) possess extensive knowledge useful in robotic tasks, especially in…

Robotics · Computer Science 2023-12-27 Yingdong Hu , Fanqi Lin , Tong Zhang , Li Yi , Yang Gao

Leveraging diverse robotic data for pretraining remains a critical challenge. Existing methods typically model the dataset's action distribution using simple observations as inputs. However, these inputs are often incomplete, resulting in a…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Jiahui Zhang , Yurui Chen , Yueming Xu , Ze Huang , Yanpeng Zhou , Yu-Jie Yuan , Xinyue Cai , Guowei Huang , Xingyue Quan , Hang Xu , Li Zhang

We introduce OG-VLA, a novel architecture and learning framework that combines the generalization strengths of Vision Language Action models (VLAs) with the robustness of 3D-aware policies. We address the challenge of mapping natural…

Robotics · Computer Science 2025-11-19 Ishika Singh , Ankit Goyal , Stan Birchfield , Dieter Fox , Animesh Garg , Valts Blukis

We propose Bilateral Control-Based Imitation Learning via Vision-Language Fusion for Action Generation (Bi-VLA), a novel framework that extends bilateral control-based imitation learning to handle more than one task within a single model.…

Robotics · Computer Science 2025-09-24 Masato Kobayashi , Thanpimon Buamanee

Recent advances in vision-language-action (VLA) models have shown promise in integrating image generation with action prediction to improve generalization and reasoning in robot manipulation. However, existing methods are limited to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Wenyao Zhang , Hongsi Liu , Zekun Qi , Yunnan Wang , Xinqiang Yu , Jiazhao Zhang , Runpei Dong , Jiawei He , Fan Lu , He Wang , Zhizheng Zhang , Li Yi , Wenjun Zeng , Xin Jin

Vision-language-action (VLA) models have emerged as generalist robotic controllers capable of mapping visual observations and natural language instructions to continuous action sequences. However, VLAs provide no calibrated measure of…

Robotics · Computer Science 2026-04-21 Lingling Chen , Zongyao Lyu , William J. Beksi

Vision-language-action models (VLAs) have shown potential in leveraging pretrained vision-language models and diverse robot demonstrations for learning generalizable sensorimotor control. While this paradigm effectively utilizes large-scale…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Qingqing Zhao , Yao Lu , Moo Jin Kim , Zipeng Fu , Zhuoyang Zhang , Yecheng Wu , Zhaoshuo Li , Qianli Ma , Song Han , Chelsea Finn , Ankur Handa , Ming-Yu Liu , Donglai Xiang , Gordon Wetzstein , Tsung-Yi Lin

Vision-Language-Action (VLA) models have shown remarkable progress in embodied tasks recently, but most methods process visual observations independently at each timestep. This history-agnostic design treats robot manipulation as a Markov…

Machine Learning · Computer Science 2026-04-13 Lei Xiao , Jifeng Li , Juntao Gao , Feiyang Ye , Yan Jin , Jingjing Qian , Jing Zhang , Yong Wu , Xiaoyuan Yu

Vision-Language-Action (VLA) models have shown remarkable achievements, driven by the rich implicit knowledge of their vision-language components. However, achieving generalist robotic agents demands precise grounding into physical…

Robotics · Computer Science 2025-07-15 Jialei Huang , Shuo Wang , Fanqi Lin , Yihang Hu , Chuan Wen , Yang Gao

Vision-Language-Action (VLA) models commonly adapt pretrained Vision-Language Models (VLMs) to robot control by mapping visual observations and language instructions to continuous actions. Existing approaches typically take an…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Xuan Wang , Yinan Wu , Haoran Duan , Jungong Han

Robots deployed in dynamic environments must be able to not only follow diverse language instructions but flexibly adapt when user intent changes mid-execution. While recent Vision-Language-Action (VLA) models have advanced multi-task…

Robotics · Computer Science 2025-06-05 Meng Li , Zhen Zhao , Zhengping Che , Fei Liao , Kun Wu , Zhiyuan Xu , Pei Ren , Zhao Jin , Ning Liu , Jian Tang

Enabling robots to perform diverse tasks across varied environments is a central challenge in robot learning. While vision-language-action (VLA) models have shown promise for generalizable robot skills, realizing their full potential…

Robotics · Computer Science 2025-08-12 Junjie Wen , Yichen Zhu , Jinming Li , Zhibin Tang , Chaomin Shen , Feifei Feng

Robotic manipulation in open-world environments requires reasoning across semantics, geometry, and long-horizon action dynamics. Existing hierarchical Vision-Language-Action (VLA) frameworks typically use 2D representations to connect…

Trustworthy robot behavior requires not only high levels of task success but also that the robot can reliably quantify how likely it is to succeed. To this end, we present a first-of-its-kind study of confidence calibration in…

Robotics · Computer Science 2025-12-23 Thomas P Zollo , Richard Zemel

In recent human-robot collaboration environments, there is a growing focus on integrating diverse sensor data beyond visual information to enable safer and more intelligent task execution. Although thermal data can be crucial for enhancing…

Robotics · Computer Science 2026-04-10 Young-Chae Son , Dae-Kwan Ko , Yoon-Ji Choi , Soo-Chul Lim

A fundamental requirement for real-world robotic deployment is the ability to understand and respond to natural language instructions. Existing language-conditioned manipulation tasks typically assume that instructions are perfectly aligned…

Vision-Language-Action (VLA) models leverage pretrained vision-language models (VLMs) to couple perception with robotic control, offering a promising path toward general-purpose embodied intelligence. However, current SOTA VLAs are…

Robotics · Computer Science 2025-10-10 Yandu Chen , Kefan Gu , Yuqing Wen , Yucheng Zhao , Tiancai Wang , Liqiang Nie

Recent advances in Vision-Language-Action (VLA) models have enabled robotic agents to integrate multimodal understanding with action execution. However, our empirical analysis reveals that current VLAs struggle to allocate visual attention…

In this paper, we propose GTA-VLA(Guide, Think, Act), an interactive Vision-Language-Action (VLA) framework that enables spatially steerable embodied reasoning by allowing users to guide robot policies with explicit visual cues. Existing…

Robotics · Computer Science 2026-05-14 Yiran Ling , Qing Lian , Jinghang Li , Qing Jiang , Tianming Zhang , Xiaoke Jiang , Chuanxiu Liu , Jie Liu , Lei Zhang

Integrating visual-language instructions into visuomotor policies is gaining momentum in robot learning for enhancing open-world generalization. Despite promising advances, existing approaches face two challenges: limited language…

Robotics · Computer Science 2025-10-24 Wenhui Huang , Changhe Chen , Han Qi , Chen Lv , Yilun Du , Heng Yang