English

TrackVLA++: Unleashing Reasoning and Memory Capabilities in VLA Models for Embodied Visual Tracking

Robotics 2025-10-09 v1 Artificial Intelligence Computer Vision and Pattern Recognition

Abstract

Embodied Visual Tracking (EVT) is a fundamental ability that underpins practical applications, such as companion robots, guidance robots and service assistants, where continuously following moving targets is essential. Recent advances have enabled language-guided tracking in complex and unstructured scenes. However, existing approaches lack explicit spatial reasoning and effective temporal memory, causing failures under severe occlusions or in the presence of similar-looking distractors. To address these challenges, we present TrackVLA++, a novel Vision-Language-Action (VLA) model that enhances embodied visual tracking with two key modules, a spatial reasoning mechanism and a Target Identification Memory (TIM). The reasoning module introduces a Chain-of-Thought paradigm, termed Polar-CoT, which infers the target's relative position and encodes it as a compact polar-coordinate token for action prediction. Guided by these spatial priors, the TIM employs a gated update strategy to preserve long-horizon target memory, ensuring spatiotemporal consistency and mitigating target loss during extended occlusions. Extensive experiments show that TrackVLA++ achieves state-of-the-art performance on public benchmarks across both egocentric and multi-camera settings. On the challenging EVT-Bench DT split, TrackVLA++ surpasses the previous leading approach by 5.1 and 12, respectively. Furthermore, TrackVLA++ exhibits strong zero-shot generalization, enabling robust real-world tracking in dynamic and occluded scenarios.

Keywords

Cite

@article{arxiv.2510.07134,
  title  = {TrackVLA++: Unleashing Reasoning and Memory Capabilities in VLA Models for Embodied Visual Tracking},
  author = {Jiahang Liu and Yunpeng Qi and Jiazhao Zhang and Minghan Li and Shaoan Wang and Kui Wu and Hanjing Ye and Hong Zhang and Zhibo Chen and Fangwei Zhong and Zhizheng Zhang and He Wang},
  journal= {arXiv preprint arXiv:2510.07134},
  year   = {2025}
}

Comments

Project page: https://pku-epic.github.io/TrackVLA-plus-plus-Web/

R2 v1 2026-07-01T06:24:12.975Z