English
Related papers

Related papers: GuidedVLA: Specifying Task-Relevant Factors via Pl…

200 papers

Current research on Vision-Language-Action (VLA) models predominantly focuses on enhancing generalization through established reasoning techniques. While effective, these improvements invariably increase computational complexity and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Riccardo Andrea Izzo , Gianluca Bardaro , Matteo Matteucci

In robotics, Vision-Language-Action (VLA) models that integrate diverse multimodal signals from multi-view inputs have emerged as an effective approach. However, most prior work adopts static fusion that processes all visual inputs…

Robotics · Computer Science 2026-02-18 Young-Chae Son , Jung-Woo Lee , Yoon-Ji Choi , Dae-Kwan Ko , Soo-Chul Lim

Vision-Language Models (VLMs) have emerged as a promising approach to address the data scarcity challenge in robotics, enabling the development of generalizable visuomotor control policies. While models like OpenVLA showcase the potential…

Vision-language-action (VLA) models provide a promising foundation for general-purpose robotics. However, their successful deployment in real-world scenarios requires the ability to continually acquire new skills while retaining previously…

Robotics · Computer Science 2026-05-27 Jiarun Zhu , Yijun Hong , Xiaoquan Sun , Zetian Xu , Mingqi Yuan , Zhiyong Wang , Wenjun Zeng , Jiayu Chen

Vision-language-action (VLA) models provide strong action priors for robotic manipulation, but their reactive behavior can fail under distribution shift and long-horizon task structure. Recent VLA-guided planning methods improve execution…

Robotics · Computer Science 2026-05-25 Ke Ren , Ali Salamatian , Kieran Pattison , Cyrus Neary

Vision-Language-Action (VLA) models have advanced autonomous driving, but existing benchmarks still lack scenario diversity, reliable action-level annotation, and evaluation protocols aligned with human preferences. To address these…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Yuhan Hao , Zhengning Li , Lei Sun , Weilong Wang , Naixin Yi , Sheng Song , Caihong Qin , Mofan Zhou , Yifei Zhan , Xianpeng Lang

Vision-Language-Action models have achieved remarkable progress in robotic manipulation, yet they suffer from a critical limitation: a lack of 3D scene understanding. This deficiency manifests as three intertwined challenges: weak…

Robotics · Computer Science 2026-05-29 Zhongyu Xia , Yousen Tang , Bingqing Wei , Yongtao Wang

Vision-Language-Action (VLA) models have recently emerged as a promising paradigm for robotic manipulation, in which reliable action prediction critically depends on accurately interpreting and integrating visual observations conditioned on…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Yulin Luo , Hao Chen , Zhuangzhe Wu , Bowen Sui , Jiaming Liu , Chenyang Gu , Zhuoyang Liu , Qiuxuan Feng , Jiale Yu , Shuo Gu , Peng Jia , Pheng-Ann Heng , Shanghang Zhang

The important manifestation of robot intelligence is the ability to naturally interact and autonomously make decisions. Traditional approaches to robot control often compartmentalize perception, planning, and decision-making, simplifying…

Robotics · Computer Science 2025-02-05 Pengxiang Ding , Han Zhao , Wenjie Zhang , Wenxuan Song , Min Zhang , Siteng Huang , Ningxi Yang , Donglin Wang

Achieving truly adaptive embodied intelligence requires agents that learn not just by imitating static demonstrations, but by continuously improving through environmental interaction, which is akin to how humans master skills through…

Robotics · Computer Science 2025-12-17 Zechen Bai , Chen Gao , Mike Zheng Shou

We propose LCLA (Language-Conditioned Latent Alignment), a framework for vision-language navigation that learns modular perception-action interfaces by aligning sensory observations to a latent representation of an expert policy. The expert…

Robotics · Computer Science 2026-02-11 Nitesh Subedi , Adam Haroon , Samuel Tetteh , Prajwal Koirala , Cody Fleming , Soumik Sarkar

Vision-Language-Action (VLA) models have emerged as a unified paradigm for robotic perception and control, enabling emergent generalization and long-horizon task execution. However, their deployment in dynamic, real-world environments is…

Artificial Intelligence · Computer Science 2025-12-24 Yuntao Dai , Hang Gu , Teng Wang , Qianyu Cheng , Yifei Zheng , Zhiyong Qiu , Lei Gong , Wenqi Lou , Xuehai Zhou

Large policies pretrained on a combination of Internet-scale vision-language data and diverse robot demonstrations have the potential to change how we teach robots new skills: rather than training new behaviors from scratch, we can…

Vision-language-action (VLA) models have demonstrated exceptional performance in natural language-driven perception and control. However, the high computational cost of VLA models poses significant efficiency challenges, particularly for…

Vision-Language-Action (VLA) models are driving a revolution in robotics, enabling machines to understand instructions and interact with the physical world. This field is exploding with new models and datasets, making it both exciting and…

The reliance on language in Vision-Language-Action (VLA) models introduces ambiguity, cognitive overhead, and difficulties in precise object identification and sequential task execution, particularly in environments with multiple visually…

Robotics · Computer Science 2026-03-02 Donggeon Kim , Seungwon Jan , Hyeonjun Park , Daegyu Lim

Currently, inspired by the success of vision-language models (VLMs), an increasing number of researchers are focusing on improving VLMs and have achieved promising results. However, most existing methods concentrate on optimizing the…

Computer Vision and Pattern Recognition · Computer Science 2024-09-23 Dawei Yan , Pengcheng Li , Yang Li , Hao Chen , Qingguo Chen , Weihua Luo , Wei Dong , Qingsen Yan , Haokui Zhang , Chunhua Shen

Vision-language-action (VLA) models have significantly advanced robotic manipulation by integrating vision-language models (VLMs), and action decoders into a unified architecture. However, their deployment on resource-constrained edge…

Robotics · Computer Science 2025-10-30 Jiahong Chen , Jing Wang , Long Chen , Chuwei Cai , Jinghui Lu

Language and vision-language models have shown impressive performance across a wide range of tasks, but their internal mechanisms remain only partly understood. In this work, we study how individual attention heads in text-generative models…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Lorenzo Basile , Valentino Maiorca , Diego Doimo , Francesco Locatello , Alberto Cazzaniga

Vision-Language-Action (VLA) models demonstrate remarkable potential for generalizable robotic manipulation. The execution of complex multi-step behaviors in VLA models can be improved by robust instruction grounding, a critical component…