English
Related papers

Related papers: AnywhereVLA: Language-Conditioned Exploration and …

200 papers

Vision-language-action (VLA) models perform well on training-seen robotic tasks but struggle to generalize to unseen scenes and objects. A key limitation lies in their implicit visual representations, which entangle object appearance,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Hanyu Zhou , Chuanhao Ma , Gim Hee Lee

Temporal context is essential for robotic manipulation because such tasks are inherently non-Markovian, yet mainstream VLA models typically overlook it and struggle with long-horizon, temporally dependent tasks. Cognitive science suggests…

Robotics · Computer Science 2026-02-02 Hao Shi , Bin Xie , Yingfei Liu , Lin Sun , Fengrong Liu , Tiancai Wang , Erjin Zhou , Haoqiang Fan , Xiangyu Zhang , Gao Huang

Active Simultaneous Localization and Mapping (Active SLAM) involves the strategic planning and precise control of a robotic system's movement in order to construct a highly accurate and comprehensive representation of its surrounding…

Robotics · Computer Science 2025-11-19 Yizhen Yin , Yuhua Qi , Dapeng Feng , Hongbo Chen , Hongjun Ma , Jin Wu , Yi Jiang

Vision-Language-Action (VLA) models represent a pivotal advance in embodied intelligence, yet they confront critical barriers to real-world deployment, most notably catastrophic forgetting. This issue stems from their overreliance on…

Vision-language-action models have advanced robotic manipulation but remain constrained by reliance on the large, teleoperation-collected datasets dominated by the static, tabletop scenes. We propose a simulation-first framework to verify…

Robotics · Computer Science 2026-02-06 Wenbo Wang , Fangyun Wei , QiXiu Li , Xi Chen , Yaobo Liang , Chang Xu , Jiaolong Yang , Baining Guo

The real-world deployment of fully autonomous mobile robots depends on a robust SLAM (Simultaneous Localization and Mapping) system, capable of handling dynamic environments, where objects are moving in front of the robot, and changing…

Embodied visual tracking is crucial for Unmanned Aerial Vehicles (UAVs) executing complex real-world tasks. In dynamic urban scenarios with complex semantic requirements, Vision-Language-Action (VLA) models show great promise due to their…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Qiyao Zhang , Shuhua Zheng , Jianli Sun , Chengxiang Li , Xianke Wu , Zihan Song , Zhiyong Cui , Yisheng Lv , Yonglin Tian

The emergence of Vision Language Action (VLA) models marks a paradigm shift from traditional policy-based control to generalized robotics, reframing Vision Language Models (VLMs) from passive sequence generators into active agents for…

Robotics · Computer Science 2025-11-11 Dapeng Zhang , Jing Sun , Chenghui Hu , Xiaoyan Wu , Zhenlong Yuan , Rui Zhou , Fei Shen , Qingguo Zhou

The Visual-Language-Action (VLA) models can follow text instructions according to visual observations of the surrounding environment. This ability to map multimodal inputs to actions is derived from the training of the VLA model on…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Jinyue Bian , Zhaoxing Zhang , Zhengyu Liang , Shiwei Zheng , Shengtao Zhang , Rong Shen , Chen Yang , Anzhou Hou

Vision-Language-Action (VLA) models offer promising capabilities for autonomous driving through multimodal understanding. However, their utilization in safety-critical scenarios is constrained by inherent limitations, including imprecise…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Yiru Wang , Zichong Gu , Yu Gao , Anqing Jiang , Zhigang Sun , Shuo Wang , Yuwen Heng , Hao Sun

Recent Vision-Language-Action (VLA) models have made impressive progress toward general-purpose robotic manipulation by post-training large Vision-Language Models (VLMs) for action prediction. Yet most VLAs entangle perception and control…

With the recent rise of large language models, vision-language models, and other general foundation models, there is growing potential for multimodal, multi-task robotics that can operate in diverse environments given natural language…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Haochen Zhang , Nader Zantout , Pujith Kachana , Ji Zhang , Wenshan Wang

Vision-Language-Action (VLA) policies are typically evaluated as if the user had finished typing or speaking before the robot begins acting. In real deployment, however, users take several seconds to enter a request, leaving the policy idle…

Robotics · Computer Science 2026-05-13 Joonha Park , Jiseung Jeong , Taesik Gong

A fundamental challenge in autonomous driving is the integration of high-level, semantic reasoning for long-tail events with low-level, reactive control for robust driving. While large vision-language models (VLMs) trained on web-scale data…

Robots operating in the open world encounter various different environments that can substantially differ from each other. This domain gap also poses a challenge for Simultaneous Localization and Mapping (SLAM) being one of the fundamental…

Robotics · Computer Science 2023-03-14 Niclas Vödisch , Daniele Cattaneo , Wolfram Burgard , Abhinav Valada

RaceVLA presents an innovative approach for autonomous racing drone navigation by leveraging Visual-Language-Action (VLA) to emulate human-like behavior. This research explores the integration of advanced algorithms that enable drones to…

In order for robots to interact with objects effectively, they must understand the form and function of each object they encounter. Essentially, robots need to understand which actions each object affords, and where those affordances can be…

Robotics · Computer Science 2024-05-28 Edmond Tong , Anthony Opipari , Stanley Lewis , Zhen Zeng , Odest Chadwicke Jenkins

Simultaneous Localisation and Mapping (SLAM) is one of the fundamental problems in autonomous mobile robots where a robot needs to reconstruct a previously unseen environment while simultaneously localising itself with respect to the map.…

Robotics · Computer Science 2022-09-13 Tin Lai

Learning real-world robotic manipulation is challenging, particularly when limited demonstrations are available. Existing methods for few-shot manipulation often rely on simulation-augmented data or pre-built modules like grasping and pose…

Generalization remains a fundamental challenge in robotic manipulation. To tackle this challenge, recent Vision-Language-Action (VLA) models build policies on top of Vision-Language Models (VLMs), seeking to transfer their open-world…