English
Related papers

Related papers: Long-Horizon Manipulation via Trace-Conditioned VL…

200 papers

Vision-Language-Action (VLA) models have recently enabled robotic manipulation by grounding visual and linguistic cues into actions. However, most VLAs assume the Markov property, relying only on the current observation and thus suffering…

Long-horizon robotic manipulation is increasingly important for real-world deployment, requiring spatial disambiguation in complex layouts and temporal resilience under dynamic interaction. However, existing end-to-end and hierarchical…

Instructing a robot to complete an everyday task within our homes has been a long-standing challenge for robotics. While recent progress in language-conditioned imitation learning and offline reinforcement learning has demonstrated…

Robotics · Computer Science 2024-07-03 Federico Ceola , Lorenzo Natale , Niko Sünderhauf , Krishan Rana

Bridging the gap between natural language commands and autonomous execution in unstructured environments remains an open challenge for robotics. This requires robots to perceive and reason over the current task scene through multiple…

Robotics · Computer Science 2025-12-23 Jin Wang , Kim Tien Ly , Jacques Cloete , Nikos Tsagarakis , Ioannis Havoutis

We present ProgVLA, a compact vision-language-action (VLA) model designed for reliable robot manipulation under tight compute and memory budgets. The model specifically focuses on efficiently processing long multi-modal sequences by…

Robotics · Computer Science 2026-05-28 Seungsu Kim , Jinyoung Choi , Seungmin Baek , Jean-Michel Renders

Vision-Language Models (VLM) can generate plausible high-level plans when prompted with a goal, the context, an image of the scene, and any planning constraints. However, there is no guarantee that the predicted actions are geometrically…

Robotics · Computer Science 2024-10-04 Zhutian Yang , Caelan Garrett , Dieter Fox , Tomás Lozano-Pérez , Leslie Pack Kaelbling

Sequential decision-making and motion planning for robotic manipulation induce combinatorial complexity. For long-horizon tasks, especially when the environment comprises many objects that can be interacted with, planning efficiency becomes…

Robotics · Computer Science 2022-03-08 Cornelius V. Braun , Joaquim Ortiz-Haro , Marc Toussaint , Ozgur S. Oguz

Enabling humanoid robots to perform autonomously loco-manipulation in unstructured environments is crucial and highly challenging for achieving embodied intelligence. This involves robots being able to plan their actions and behaviors in…

Robotics · Computer Science 2024-08-16 Jin Wang , Arturo Laurenzi , Nikos Tsagarakis

Vision-Language-Action (VLA) models typically map visual observations and linguistic instructions directly to control signals. This "black-box" mapping forces a single forward pass to simultaneously handle instruction interpretation,…

Robotics · Computer Science 2026-05-12 Zixuan Wang , Yuxin Chen , Yuqi Liu , Jinhui Ye , Pengguang Chen , Changsheng Lu , Shu Liu , Bei Yu , Jiaya Jia

Action chunking has recently emerged as a standard practice in flow-based Vision-Language-Action (VLA) models. However, the effect and choice of the execution horizon - the number of actions to be executed from each predicted chunk -…

Robotics · Computer Science 2026-02-26 Haoxuan Wang , Gengyu Zhang , Yan Yan , Ramana Rao Kompella , Gaowen Liu

Recent world-model-based Vision-Language-Action (VLA) architectures have improved robotic manipulation through predictive visual foresight. However, dense future prediction introduces visual redundancy and accumulates errors, causing…

Robotics · Computer Science 2026-03-16 Minghao Jin , Mozheng Liao , Mingfei Han , Zhihui Li , Xiaojun Chang

The Visual-Language-Action (VLA) models can follow text instructions according to visual observations of the surrounding environment. This ability to map multimodal inputs to actions is derived from the training of the VLA model on…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Jinyue Bian , Zhaoxing Zhang , Zhengyu Liang , Shiwei Zheng , Shengtao Zhang , Rong Shen , Chen Yang , Anzhou Hou

While Vision-Language-Action (VLA) models have demonstrated promising generalization capabilities in robotic manipulation, deploying them on specific and complex downstream tasks still demands effective post-training. In parallel,…

Robotics · Computer Science 2026-03-11 Yifan Han , Zhongxi Chen , Yuxuan Zhao , Congsheng Xu , Yanming Shao , Yichuan Peng , Yao Mu , Wenzhao Lian

Vision-Language-Action (VLA) models have emerged as a promising paradigm for building embodied agents that ground perception and language into action. However, most existing approaches rely on direct action prediction, lacking the ability…

Robotics · Computer Science 2026-04-21 Runze Li , Hongyin Zhang , Junxi Jin , Qixin Zeng , Zifeng Zhuang , Yiqi Tang , Shangke Lyu , Donglin Wang

This work introduces a framework harnessing the capabilities of Large Language Models (LLMs) to generate primitive task conditions for generalizable long-horizon manipulations with novel objects and unseen tasks. These task conditions serve…

Robotics · Computer Science 2023-10-04 Haoyu Zhou , Mingyu Ding , Weikun Peng , Masayoshi Tomizuka , Lin Shao , Chuang Gan

We introduce iFlyBot-VLA, a large-scale Vision-Language-Action (VLA) model trained under a novel framework. The main contributions are listed as follows: (1) a latent action model thoroughly trained on large-scale human and robotic…

Computer Vision and Pattern Recognition · Computer Science 2025-11-05 Yuan Zhang , Chenyu Xue , Wenjie Xu , Chao Ji , Jiajia wu , Jia Pan

Long-horizon robotic manipulation remains challenging for Vision-Language-Action (VLA) models despite recent progress in zero-shot generalization and simulation-to-real-world transfer. Current VLA models suffer from stage hallucination,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Zeting Liu , Zida Yang , Zeyu Zhang , Hao Tang

Vision-Language-Action (VLA) systems have shown strong potential for language-driven robotic manipulation. However, scaling them to long-horizon tasks remains challenging. Existing pipelines typically separate data collection, policy…

Recently, some studies have integrated Multimodal Large Language Models into robotic manipulation, constructing vision-language-action models (VLAs) to interpret multimodal information and predict SE(3) poses. While VLAs have shown…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Chenxuan Li , Jiaming Liu , Guanqun Wang , Xiaoqi Li , Sixiang Chen , Liang Heng , Chuyan Xiong , Jiaxin Ge , Renrui Zhang , Kaichen Zhou , Shanghang Zhang

The ability to perform reliable long-horizon task planning is crucial for deploying robots in real-world environments. However, directly employing Large Language Models (LLMs) as action sequence generators often results in low success rates…

Robotics · Computer Science 2025-07-17 Tianxing Zhou , Zhirui Wang , Haojia Ao , Guangyan Chen , Boyang Xing , Jingwen Cheng , Yi Yang , Yufeng Yue