English

WinT3R: Window-Based Streaming Reconstruction with Camera Token Pool

Computer Vision and Pattern Recognition 2025-09-08 v1 Artificial Intelligence

Abstract

We present WinT3R, a feed-forward reconstruction model capable of online prediction of precise camera poses and high-quality point maps. Previous methods suffer from a trade-off between reconstruction quality and real-time performance. To address this, we first introduce a sliding window mechanism that ensures sufficient information exchange among frames within the window, thereby improving the quality of geometric predictions without large computation. In addition, we leverage a compact representation of cameras and maintain a global camera token pool, which enhances the reliability of camera pose estimation without sacrificing efficiency. These designs enable WinT3R to achieve state-of-the-art performance in terms of online reconstruction quality, camera pose estimation, and reconstruction speed, as validated by extensive experiments on diverse datasets. Code and model are publicly available at https://github.com/LiZizun/WinT3R.

Keywords

Cite

@article{arxiv.2509.05296,
  title  = {WinT3R: Window-Based Streaming Reconstruction with Camera Token Pool},
  author = {Zizun Li and Jianjun Zhou and Yifan Wang and Haoyu Guo and Wenzheng Chang and Yang Zhou and Haoyi Zhu and Junyi Chen and Chunhua Shen and Tong He},
  journal= {arXiv preprint arXiv:2509.05296},
  year   = {2025}
}
R2 v1 2026-07-01T05:23:32.152Z