English
Related papers

Related papers: SpanVLA: Efficient Action Bridging and Learning fr…

200 papers

Robotic foundation models achieve strong generalization by leveraging internet-scale vision-language representations, but their massive computational cost creates a fundamental bottleneck: high inference latency. In dynamic environments,…

Robotics · Computer Science 2026-02-17 Noriaki Hirose , Catherine Glossop , Dhruv Shah , Sergey Levine

Vision-language-action models (VLAs) have shown potential in leveraging pretrained vision-language models and diverse robot demonstrations for learning generalizable sensorimotor control. While this paradigm effectively utilizes large-scale…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Qingqing Zhao , Yao Lu , Moo Jin Kim , Zipeng Fu , Zhuoyang Zhang , Yecheng Wu , Zhaoshuo Li , Qianli Ma , Song Han , Chelsea Finn , Ankur Handa , Ming-Yu Liu , Donglai Xiang , Gordon Wetzstein , Tsung-Yi Lin

Pre-trained Vision-Language-Action (VLA) models have achieved remarkable success in improving robustness and generalization for end-to-end robotic manipulation. However, these models struggle with long-horizon tasks due to their lack of…

Robotics · Computer Science 2025-11-13 Runhao Li , Wenkai Guo , Zhenyu Wu , Changyuan Wang , Haoyuan Deng , Zhenyu Weng , Yap-Peng Tan , Ziwei Wang

Research interest in end-to-end autonomous driving has surged owing to its fully differentiable design integrating modular tasks, i.e. perception, prediction and planing, which enables optimization in pursuit of the ultimate goal. Despite…

Artificial Intelligence · Computer Science 2025-06-04 Anqing Jiang , Yu Gao , Zhigang Sun , Yiru Wang , Jijun Wang , Jinghao Chai , Qian Cao , Yuweng Heng , Hao Jiang , Yunda Dong , Zongzheng Zhang , Xianda Guo , Hao Sun , Hao Zhao

Vision-Language-Action (VLA) models have emerged as a popular paradigm for learning robot manipulation policies that can follow language instructions and generalize to novel scenarios. Recent works have begun to explore the incorporation of…

Vision-Language-Action (VLA) models demonstrate remarkable potential for generalizable robotic manipulation. The performance of VLA models can be improved by integrating with action chunking, a critical technique for effective control.…

Vision-and-Language Navigation (VLN) aims to enable an embodied agent to follow natural-language instructions and navigate to a target location in unseen 3D environments. We argue that adapting VLMs to VLN requires endowing them with two…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Pengna Li , Kangyi Wu , Shaoqing Xu , Fang Li , Hanbing Li , Lin Zhao , Kailin Lyu , Long Chen , Zhi-Xin Yang , Nanning Zheng

Vision-Language-Action (VLA) models show promising ability in language-guided robotic tasks. However, making VLA policies reliable remains challenging, because a manipulation task is completed through closed-loop interaction, where each…

Robotics · Computer Science 2026-05-20 Peizheng Guo , Jingyao Wang , Changwen Zheng , Wenwen Qiang

Vision-Language-Action (VLA) models are receiving increasing attention for their ability to enable robots to perform complex tasks by integrating visual context with linguistic commands. However, achieving efficient real-time performance…

Robotics · Computer Science 2024-10-22 ByungOk Han , Jaehong Kim , Jinhyeok Jang

Building generalist embodied agents requires integrating perception, language understanding, and action, which are core capabilities addressed by Vision-Language-Action (VLA) approaches based on multimodal foundation models, including…

Robotics · Computer Science 2026-04-08 StarVLA Community

Recently, leveraging pre-trained vision-language models (VLMs) for building vision-language-action (VLA) models has emerged as a promising approach to effective robot manipulation learning. However, only few methods incorporate 3D signals…

Robotics · Computer Science 2025-10-15 Peiyan Li , Yixiang Chen , Hongtao Wu , Xiao Ma , Xiangnan Wu , Yan Huang , Liang Wang , Tao Kong , Tieniu Tan

Vision-Language-Action (VLA) models rely on current observations, including images, language instructions, and robot states, to predict actions and complete tasks. While accurate visual perception is crucial for precise action prediction…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Cheng Yang , Jianhao Jiao , Lingyi Huang , Jinqi Xiao , Zhexiang Tang , Yu Gong , Yibiao Ying , Yang Sui , Jintian Lin , Wen Huang , Bo Yuan

Vision-Language-Action (VLA) models have achieved remarkable progress in robotic manipulation by mapping multimodal observations and instructions directly to actions. However, they typically mimic expert trajectories without predictive…

Standard vision-language-action (VLA) models rely on fitting statistical data priors, limiting their robust understanding of underlying physical dynamics. Reinforcement learning enhances physical grounding through exploration yet typically…

Robotics · Computer Science 2026-02-26 Chenyv Liu , Wentao Tan , Lei Zhu , Fengling Li , Jingjing Li , Guoli Yang , Heng Tao Shen

Vision-Language-Action (VLA) models offer promising capabilities for autonomous driving through multimodal understanding. However, their utilization in safety-critical scenarios is constrained by inherent limitations, including imprecise…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Yiru Wang , Zichong Gu , Yu Gao , Anqing Jiang , Zhigang Sun , Shuo Wang , Yuwen Heng , Hao Sun

Vision-Language-Action (VLA) models aim to control robots for manipulation from visual observations and natural-language instructions. However, existing hierarchical and autoregressive paradigms often introduce architectural overhead,…

Vision-Language-Action (VLA) models have shown strong performance on embodied manipulation, yet they remain brittle under visual observation changes, paraphrased language instructions, and compounded perturbations. This limitation suggests…

Robotics · Computer Science 2026-05-20 Jingzhou Luo , Yifan Wen , Yongjie Bai , Xinshuai Song , Yang Liu , Liang Lin

Recent high-capacity vision-language-action (VLA) models have demonstrated impressive performance on a range of robotic manipulation tasks by imitating human demonstrations. However, exploiting offline data with limited visited states will…

Robotics · Computer Science 2025-05-27 Guanxing Lu , Wenkai Guo , Chubin Zhang , Yuheng Zhou , Haonan Jiang , Zifeng Gao , Yansong Tang , Ziwei Wang

Vision-Language-Action (VLA) models for autonomous driving often hit a performance plateau during Reinforcement Learning (RL) optimization. This stagnation arises from exploration capabilities constrained by previous Supervised Fine-Tuning…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Yuechen Luo , Qimao Chen , Fang Li , Shaoqing Xu , Jaxin Liu , Ziying Song , Zhi-xin Yang , Fuxi Wen

Autonomous driving requires reasoning about how the environment evolves and planning actions accordingly. Existing world-model-based approaches typically predict future scenes first and plan afterwards, resulting in open-loop imagination…

Robotics · Computer Science 2026-03-31 Qiqi Liu , Huan Xu , Jingyu Li , Bin Sun , Zhihui Hao , Dangen She , Xiatian Zhu , Li Zhang
‹ Prev 1 4 5 6 7 8 10 Next ›