English
Related papers

Related papers: Can Explicit Physical Feasibility Benefit VLA Lear…

200 papers

Vision-Language-Action models (VLAs) promise to ground language instructions in robot control, yet in practice often fail to faithfully follow language. When presented with instructions that lack strong scene-specific supervision, VLAs…

Computer Vision and Pattern Recognition · Computer Science 2026-02-20 Yu Fang , Yuchun Feng , Dong Jing , Jiaqi Liu , Yue Yang , Zhenyu Wei , Daniel Szafir , Mingyu Ding

The emergence of vision-language-action (VLA) models has given rise to foundation models for robot manipulation. Although these models have achieved significant improvements, their generalization in multi-task manipulation remains limited.…

Large foundation models have shown strong open-world generalization to complex problems in vision and language, but similar levels of generalization have yet to be achieved in robotics. One fundamental challenge is the lack of robotic data,…

Vision-Language-Action (VLA) models have shown remarkable success in robotic tasks like manipulation by fusing a language model's reasoning with a vision model's 3D understanding. However, their high computational cost remains a major…

Robotics · Computer Science 2026-03-18 Zebin Yang , Yijiahao Qi , Tong Xie , Bo Yu , Shaoshan Liu , Meng Li

Vision-Language-Action (VLA) models have emerged as a promising paradigm for general-purpose robotic control, with test-time scaling (TTS) gaining attention to enhance robustness beyond training. However, existing TTS methods for VLAs…

Robotics · Computer Science 2026-02-05 Hyeonbeom Choi , Daechul Ahn , Youhan Lee , Taewook Kang , Seongwon Cho , Jonghyun Choi

VLA architectures that pair a pretrained VLM with a flow-matching action expert have emerged as a strong paradigm for language-conditioned manipulation. Yet the VLM, optimized for semantic abstraction and typically conditioned on static…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Zezhou Zhang , Songxin Zhang , Xiao Xiong , Junjie Zhang , Zejian Xie , Jingyi Xi , Zunyao Mao , Zan Mao , Zhixin Mai , Zhuoyang Song , Jiaxing Zhang

Vision-Language-Action (VLA) models for autonomous driving often hit a performance plateau during Reinforcement Learning (RL) optimization. This stagnation arises from exploration capabilities constrained by previous Supervised Fine-Tuning…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Yuechen Luo , Qimao Chen , Fang Li , Shaoqing Xu , Jaxin Liu , Ziying Song , Zhi-xin Yang , Fuxi Wen

The application of artificial intelligence (AI) in industry is accelerating the shift from traditional automation to intelligent systems with perception and cognition. Vision language-action (VLA) models have been a key paradigm in AI to…

Artificial Intelligence · Computer Science 2025-09-30 Shuai Li , Chen Yizhe , Li Dong , Liu Sichao , Lan Dapeng , Liu Yu , Zhibo Pang

Vision-Language-Action (VLA) models are promising for generalist robot manipulation but remain brittle in out-of-distribution (OOD) settings, especially with limited real-robot data. To resolve the generalization bottleneck, we introduce a…

Vision-Language-Action (VLA) models widely adopt pretrained Vision-Language Models (VLMs) as policy backbones, yet it remains unclear what kind of pretrained VLM representation is useful as a VLA initialization. In this paper, we study VLA…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Weifeng Lin , Siyuan Huang , Hao Li , Tingwei Chen , Ruichuan An , Xinyu Wei , Jianbo Liu , Hongsheng Li

Executing language-conditioned tasks in dynamic visual environments remains a central challenge in embodied AI. Existing Vision-Language-Action (VLA) models predominantly adopt reactive state-to-action mappings, often leading to…

Robotics · Computer Science 2025-09-10 Qi Lv , Weijie Kong , Hao Li , Jia Zeng , Zherui Qiu , Delin Qu , Haoming Song , Qizhi Chen , Xiang Deng , Jiangmiao Pang

This study evaluates two leading approaches for teaching construction robots new skills to understand their applicability for construction automation: a Vision-Language-Action (VLA) model and Reinforcement Learning (RL) methods. The goal is…

Robotics · Computer Science 2026-03-02 Zhaofeng Hu , Hongrui Yu , Vaidhyanathan Chandramouli , Ci-Jyun Liang

Vision-Language-Action (VLA) models have recently achieved remarkable progress in robotic perception and control, yet most existing approaches primarily rely on VLM trained using 2D images, which limits their spatial understanding and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-27 Zhifeng Rao , Wenlong Chen , Lei Xie , Xia Hua , Dongfu Yin , Zhen Tian , F. Richard Yu

Despite their strong performance in embodied tasks, recent Vision-Language-Action (VLA) models remain highly fragile under multimodal perturbations, where visual corruption and linguistic noise jointly induce distribution shifts that…

Robotics · Computer Science 2026-04-15 Yuhan Xie , Yuping Yan , Yunqi Zhao , Handing Wang , Yaochu Jin

Current Vision-Language-Action (VLA) models rely primarily on RGB perception, preventing them from capturing modalities such as thermal signals that are imperceptible to conventional visual sensors. Moreover, end-to-end generative policies…

Robotics · Computer Science 2026-03-09 Dian Yu , Qingchuan Zhou , Bingkun Huang , Majid Khadiv , Zewen Yang

Vision-Language-Action (VLA) models are driving rapid progress in robotics by enabling agents to interpret multimodal inputs and execute complex, long-horizon tasks. However, their safety and robustness against adversarial attacks remain…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Xin Wang , Jie Li , Zejia Weng , Yixu Wang , Yifeng Gao , Tianyu Pang , Chao Du , Yan Teng , Yingchun Wang , Zuxuan Wu , Xingjun Ma , Yu-Gang Jiang

Training end-to-end policies from image data to directly predict navigation actions for robotic systems has proven inherently difficult. Existing approaches often suffer from either the sim-to-real gap during policy transfer or a limited…

Robotics · Computer Science 2026-03-17 Lazar Milikic , Manthan Patel , Jonas Frey

Understanding how Vision-Language-Action (VLA) models transform multimodal knowledge into embodied control remains an open challenge. We present VLA-Trace, a progressive diagnostic framework that analyzes VLA models through a unified…

Artificial Intelligence · Computer Science 2026-05-29 Haoyuan Shi , Xiancong Ren , Yingji Zhang , Qinfan Zhang , Jiayu Hu , Haozhe Shan , Han Dong , Jinpeng Lu , Yinda Chen , Yi Zhang , Yong Dai , Xiaozhu Ju

Simulation offers a scalable and low-cost way to enrich vision-language-action (VLA) training, reducing reliance on expensive real-robot demonstrations. However, most sim-real co-training methods rely on supervised fine-tuning (SFT), which…

Robotics · Computer Science 2026-03-09 Liangzhi Shi , Shuaihang Chen , Feng Gao , Yinuo Chen , Kang Chen , Tonghe Zhang , Hongzhi Zang , Weinan Zhang , Chao Yu , Yu Wang

Teaching robots desired skills in real-world environments remains challenging, especially for non-experts. A key bottleneck is that collecting robotic data often requires expertise or specialized hardware, limiting accessibility and…

Robotics · Computer Science 2025-05-13 Gi-Cheon Kang , Junghyun Kim , Kyuhwan Shim , Jun Ki Lee , Byoung-Tak Zhang
‹ Prev 1 8 9 10 Next ›