English
Related papers

Related papers: AsyncVLA: An Asynchronous VLA for Fast and Robust …

200 papers

Since current Vision-Language-Action (VLA) systems suffer from limited spatial perception and the absence of memory throughout manipulation, we investigate visual anchors as a means to enhance spatial and temporal reasoning within VLA…

Robotics · Computer Science 2026-03-16 Juan Zhu , Zhanying Shao , Xiaoqi Li , Ethan Morgan , Jiadong Xu , Hongwei Fan , Hao Dong

Offering great potential in robotic manipulation, a capable Vision-Language-Action (VLA) foundation model is expected to faithfully generalize across tasks and platforms while ensuring cost efficiency (e.g., data and GPU hours required for…

Vision-Language-Action (VLA) models show promise for robotic control, yet performance in complex household environments remains sub-optimal. Mobile manipulation requires reasoning about global scene layout, fine-grained geometry, and…

Robotics · Computer Science 2026-03-25 Ruisen Tu , Arth Shukla , Sohyun Yoo , Xuanlin Li , Junxi Li , Jianwen Xie , Hao Su , Zhuowen Tu

Vision-Language-Action (VLA) models have attracted increasing attention for their strong control capabilities. However, their high computational cost and low execution frequency hinder their suitability for real-time tasks such as robotic…

Computer Vision and Pattern Recognition · Computer Science 2025-10-06 Ye Li , Yuan Meng , Zewen Sun , Kangye Ji , Chen Tang , Jiajun Fan , Xinzhu Ma , Shutao Xia , Zhi Wang , Wenwu Zhu

Diffusion and flow matching models have emerged as powerful robot policies, enabling Vision-Language-Action (VLA) models to generalize across diverse scenes and instructions. Yet, when trained via imitation learning, their high generative…

Robotics · Computer Science 2026-03-26 Minho Park , Kinam Kim , Junha Hyung , Hyojin Jang , Hoiyeong Jin , Jooyeol Yun , Hojoon Lee , Jaegul Choo

Vision-Language-Action (VLA) models have recently emerged, demonstrating strong generalization in robotic scene understanding and manipulation. However, when confronted with long-horizon tasks that require defined goal states, such as LEGO…

VLA models have shown promising potential in embodied navigation by unifying perception and planning while inheriting the strong generalization abilities of large VLMs. However, most existing VLA models rely on reactive mappings directly…

Robotics · Computer Science 2026-01-14 Shaoan Wang , Yuanfei Luo , Xingyu Chen , Aocheng Luo , Dongyue Li , Chang Liu , Sheng Chen , Yangang Zhang , Junzhi Yu

Most existing vision-language-action (VLA) models for robotic manipulation lack progress awareness, typically relying on hand-crafted heuristics for task termination. This limitation is particularly severe in long-horizon tasks involving…

Robotics · Computer Science 2026-03-31 Hongyu Yan , Qiwei Li , Jiaolong Yang , Yadong Mu

We present OpenDriveVLA, a Vision Language Action model designed for end-to-end autonomous driving, built upon open-source large language models. OpenDriveVLA generates spatially grounded driving actions by leveraging multimodal inputs,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Xingcheng Zhou , Xuyuan Han , Feng Yang , Yunpu Ma , Volker Tresp , Alois Knoll

Vision-and-Language Navigation (VLN) requires agents to interpret natural language instructions and act coherently in visually rich environments. However, most existing methods rely on reactive state-action mappings without explicitly…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Weiye Zhu , Zekai Zhang , Xiangchen Wang , Hewei Pan , Teng Wang , Tiantian Geng , Rongtao Xu , Feng Zheng

Vision-Language-Action (VLA) models are promising for generalist robot control, but on-robot deployment is bottlenecked by real-time inference under tight cost and energy budgets. Most prior evaluations rely on desktop-grade GPUs, obscuring…

Robotics · Computer Science 2026-04-28 Kaijun Zhou , Qiwei Chen , Da Peng , Zhiyang Li , Xijun Li , Jinyu Gu

Vision-Language-Action (VLA) models enable generalist robotic manipulation but suffer from high inference latency. This bottleneck stems from the massive number of visual tokens processed by large language backbones. Existing methods either…

Robotics · Computer Science 2026-03-12 Yuquan Li , Lianjie Ma , Han Ding , Lijun Zhu

Large-scale Vision-Language-Action (VLA) models offer semantic generalization but suffer from high inference latency, limiting them to low-frequency batch-and-execute paradigm. This frequency mismatch creates an execution blind spot,…

Robotics · Computer Science 2026-01-22 Yuteng Sun , Haoran Wang , Ruofei Bai , Zhengguo Li , Jun Li , Meng Yee , Chuah , Wei Yun Yau

Vision-Language-Action (VLA) models have recently demonstrated impressive capabilities across various embodied AI tasks. While deploying VLA models on real-world robots imposes strict real-time inference constraints, the inference…

Robotics · Computer Science 2026-02-23 Wenqi Jiang , Jason Clemons , Karu Sankaralingam , Christos Kozyrakis

Visual navigation policy is widely regarded as a promising direction, as it mimics humans by using egocentric visual observations for navigation. However, optical information of visual observations is difficult to be explicitly modeled like…

Robotics · Computer Science 2025-10-06 Tianyu Xu , Jiawei Chen , Jiazhao Zhang , Wenyao Zhang , Zekun Qi , Minghan Li , Zhizheng Zhang , He Wang

Vision-Language-Action (VLA) models have recently shown impressive generalization and language-guided manipulation capabilities. However, their performance degrades on tasks requiring precise spatial reasoning due to limited spatial…

Computer Vision and Pattern Recognition · Computer Science 2025-10-16 Tianyuan Yuan , Yicheng Liu , Chenhao Lu , Zhuoguang Chen , Tao Jiang , Hang Zhao

Recent work has begun to equip vision-language-action (VLA) policies with explicit intermediate reasoning. In embodied control, however, textual chain-of-thought is a poor fit: irrelevant or weakly textual information can interfere with…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Mingjian Gao , Wenqiao Zhang , Yuqian Yuan , Yang Dai , Binhe Yu , Zheqi Lv , Haoyu Zheng , Jiaqi Zhu , Zhiqi Ge , Zixuan Wan , Siliang Tang , Yueting Zhuang

In dynamic environments such as warehouses, hospitals, and homes, robots must seamlessly transition between gross motion and precise manipulations to complete complex tasks. However, current Vision-Language-Action (VLA) frameworks, largely…

Conventional end-to-end (E2E) driving models are effective at generating physically plausible trajectories, but often fail to generalize to long-tail scenarios due to the lack of essential world knowledge to understand and reason about…

Robotics · Computer Science 2025-11-05 Yu Gao , Anqing Jiang , Yiru Wang , Wang Jijun , Hao Jiang , Zhigang Sun , Heng Yuwen , Wang Shuo , Hao Zhao , Sun Hao

Large vision-language models (VLMs) excel at multimodal understanding but fall short when extended to embodied tasks, where instructions must be transformed into low-level motor actions. We introduce ST4VLA, a dual-system…