English

Thinker: A vision-language foundation model for embodied intelligence

Computer Vision and Pattern Recognition 2026-01-30 v1 Artificial Intelligence

Abstract

When large vision-language models are applied to the field of robotics, they encounter problems that are simple for humans yet error-prone for models. Such issues include confusion between third-person and first-person perspectives and a tendency to overlook information in video endings during temporal reasoning. To address these challenges, we propose Thinker, a large vision-language foundation model designed for embodied intelligence. We tackle the aforementioned issues from two perspectives. Firstly, we construct a large-scale dataset tailored for robotic perception and reasoning, encompassing ego-view videos, visual grounding, spatial understanding, and chain-of-thought data. Secondly, we introduce a simple yet effective approach that substantially enhances the model's capacity for video comprehension by jointly incorporating key frames and full video sequences as inputs. Our model achieves state-of-the-art results on two of the most commonly used benchmark datasets in the field of task planning.

Keywords

Cite

@article{arxiv.2601.21199,
  title  = {Thinker: A vision-language foundation model for embodied intelligence},
  author = {Baiyu Pan and Daqin Luo and Junpeng Yang and Jiyuan Wang and Yixuan Zhang and Hailin Shi and Jichao Jiao},
  journal= {arXiv preprint arXiv:2601.21199},
  year   = {2026}
}

Comments

IROS 2025, 4 pages, 3 figures

R2 v1 2026-07-01T09:24:54.837Z