English
Related papers

Related papers: Counterfactual VLA: Self-Reflective Vision-Languag…

200 papers

Vision-Language-Action (VLA) models have advanced robotic manipulation by combining vision, language, and proprioception to predict actions. However, previous methods fuse proprioceptive signals directly with vision-language features,…

Robotics · Computer Science 2026-03-13 Zhuohao Li , Yinghao Li , Jian-Jian Jiang , Lang Zhou , Tianyu Zhang , Jiadong Yin , Mu Lin , Yi-Lin Wei , Wei-Shi Zheng

Vision-Language-Action (VLA) policies are typically deployed with asynchronous inference: the robot executes a previously predicted action chunk while the model computes the next one. This creates a prediction-execution misalignment: the…

Robotics · Computer Science 2026-05-20 Yixiang Zhu , Yonghao Chen , Rui Meng , Jingyu Guo , Jiaxiang Zou , Zijie Yang , Taowen Wang , Xinyu Chen

End-to-end architectures trained via imitation learning have advanced autonomous driving by scaling model size and data, yet performance remains brittle in safety-critical long-tail scenarios where supervision is sparse and causal…

While reasoning technology like Chain of Thought (CoT) has been widely adopted in Vision Language Action (VLA) models, it demonstrates promising capabilities in end to end autonomous driving. However, recent efforts to integrate CoT…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Yuechen Luo , Fang Li , Shaoqing Xu , Zhiyi Lai , Lei Yang , Qimao Chen , Ziang Luo , Zixun Xie , Shengyin Jiang , Jiaxin Liu , Long Chen , Bing Wang , Zhi-xin Yang

Recent high-capacity vision-language-action (VLA) models have demonstrated impressive performance on a range of robotic manipulation tasks by imitating human demonstrations. However, exploiting offline data with limited visited states will…

Robotics · Computer Science 2025-05-27 Guanxing Lu , Wenkai Guo , Chubin Zhang , Yuheng Zhou , Haonan Jiang , Zifeng Gao , Yansong Tang , Ziwei Wang

Reasoning-augmented vision language models (VLMs) generate explicit chains of thought that promise greater capability and transparency but also introduce new failure modes: models may reach correct answers via visually unfaithful…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Rheeya Uppaal , Phu Mon Htut , Min Bai , Nikolaos Pappas , Zheng Qi , Sandesh Swamy

While Vision-Language Models (VLMs) offer rich world knowledge for end-to-end autonomous driving, current approaches heavily rely on labor-intensive language annotations (e.g., VQA) to bridge perception and control. This paradigm suffers…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Chengen Xie , Chonghao Sima , Tianyu Li , Bin Sun , Junjie Wu , Zhihui Hao , Hongyang Li

Vision-Language-Action (VLA) models show promising ability in language-guided robotic tasks. However, making VLA policies reliable remains challenging, because a manipulation task is completed through closed-loop interaction, where each…

Robotics · Computer Science 2026-05-20 Peizheng Guo , Jingyao Wang , Changwen Zheng , Wenwen Qiang

Recent vision-language-action models (VLAs) build upon pretrained vision-language models and leverage diverse robot datasets to demonstrate strong task execution, language following ability, and semantic generalization. Despite these…

Robotics · Computer Science 2025-04-29 Moo Jin Kim , Chelsea Finn , Percy Liang

Recently, Vision-Language-Action (VLA) models have demonstrated strong performance on a range of robotic tasks. These models rely on multimodal inputs, with language instructions playing a crucial role -- not only in predicting actions, but…

Artificial Intelligence · Computer Science 2025-08-25 Wen-Han Hsieh , Elvis Hsieh , Dantong Niu , Trevor Darrell , Roei Herzig , David M. Chan

Vision-Language-Action (VLA)-based driving systems represent a significant paradigm shift in autonomous driving since, by combining traffic scene understanding, linguistic interpretation, and action generation, these systems enable more…

Robotics · Computer Science 2026-03-19 Gerhard Yu , Fuyuki Ishikawa , Oluwafemi Odu , Alvine Boaye Belle

Vision-Language-Action (VLA) models leverage pretrained vision-language models (VLMs) to couple perception with robotic control, offering a promising path toward general-purpose embodied intelligence. However, current SOTA VLAs are…

Robotics · Computer Science 2025-10-10 Yandu Chen , Kefan Gu , Yuqing Wen , Yucheng Zhao , Tiancai Wang , Liqiang Nie

End-to-end autonomous driving has emerged as a promising approach to unify perception, prediction, and planning within a single framework, reducing information loss and improving adaptability. However, existing methods often rely on fixed…

Robotics · Computer Science 2025-07-18 Yuhang Lu , Jiadong Tu , Yuexin Ma , Xinge Zhu

Humans possess a unified cognitive ability to perceive, comprehend, and interact with the physical world. Why can't large language models replicate this holistic understanding? Through a systematic analysis of existing training paradigms in…

The end-to-end learning ability of self-driving vehicles has achieved significant milestones over the last decade owing to rapid advances in deep learning and computer vision algorithms. However, as autonomous driving technology is a…

Computer Vision and Pattern Recognition · Computer Science 2023-07-21 Shahin Atakishiyev , Mohammad Salameh , Housam Babiker , Randy Goebel

Vision-language models (VLMs) show promise for autonomous driving but often lack transparent reasoning capabilities that are critical for safety. We investigate whether explicitly modeling reasoning during fine-tuning enhances VLM…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Amirhosein Chahe , Lifeng Zhou

Recent Vision-Language-Action (VLA) models equipped with Flow Matching (FM) action heads achieve state-of-the-art performance in complex robot manipulation. However, the multi-step iterative ODE solving required by FM introduces inference…

Robotics · Computer Science 2026-03-19 Zhou Fang , Jiaqi Wang , Yi Zhou , Qiongfeng Shi

Vision-Language-Action (VLA) models have recently demonstrated strong performance across embodied tasks. Modern VLAs commonly employ diffusion action experts to efficiently generate high-precision continuous action chunks, while…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Chen Zhao , Zhuoran Wang , Haoyang Li , Shifeng Bao , Guanlin Li , Youhe Feng , Yang Li , Jie Tang , Jing Zhang

Vision-Language-Action (VLA) models aim for general robot learning by aligning action as a modality within powerful Vision-Language Models (VLMs). Existing VLAs rely on end-to-end supervision to implicitly enable the action decoding process…

Existing vision-and-language navigation models often deviate from the correct trajectory when executing instructions. However, these models lack effective error correction capability, hindering their recovery from errors. To address this…

Robotics · Computer Science 2025-08-15 Zhuoyuan Yu , Yuxing Long , Zihan Yang , Chengyan Zeng , Hongwei Fan , Jiyao Zhang , Hao Dong