English

A Dual Process VLA: Efficient Robotic Manipulation Leveraging VLM

Robotics 2024-10-22 v1 Computer Vision and Pattern Recognition

Abstract

Vision-Language-Action (VLA) models are receiving increasing attention for their ability to enable robots to perform complex tasks by integrating visual context with linguistic commands. However, achieving efficient real-time performance remains challenging due to the high computational demands of existing models. To overcome this, we propose Dual Process VLA (DP-VLA), a hierarchical framework inspired by dual-process theory. DP-VLA utilizes a Large System 2 Model (L-Sys2) for complex reasoning and decision-making, while a Small System 1 Model (S-Sys1) handles real-time motor control and sensory processing. By leveraging Vision-Language Models (VLMs), the L-Sys2 operates at low frequencies, reducing computational overhead, while the S-Sys1 ensures fast and accurate task execution. Experimental results on the RoboCasa dataset demonstrate that DP-VLA achieves faster inference and higher task success rates, providing a scalable solution for advanced robotic applications.

Keywords

Cite

@article{arxiv.2410.15549,
  title  = {A Dual Process VLA: Efficient Robotic Manipulation Leveraging VLM},
  author = {ByungOk Han and Jaehong Kim and Jinhyeok Jang},
  journal= {arXiv preprint arXiv:2410.15549},
  year   = {2024}
}

Comments

10 page

R2 v1 2026-06-28T19:28:58.191Z