English

Flow4R: Unifying 4D Reconstruction and Tracking with Scene Flow

Computer Vision and Pattern Recognition 2026-02-17 v1

Abstract

Reconstructing and tracking dynamic 3D scenes remains a fundamental challenge in computer vision. Existing approaches often decouple geometry from motion: multi-view reconstruction methods assume static scenes, while dynamic tracking frameworks rely on explicit camera pose estimation or separate motion models. We propose Flow4R, a unified framework that treats camera-space scene flow as the central representation linking 3D structure, object motion, and camera motion. Flow4R predicts a minimal per-pixel property set-3D point position, scene flow, pose weight, and confidence-from two-view inputs using a Vision Transformer. This flow-centric formulation allows local geometry and bidirectional motion to be inferred symmetrically with a shared decoder in a single forward pass, without requiring explicit pose regressors or bundle adjustment. Trained jointly on static and dynamic datasets, Flow4R achieves state-of-the-art performance on 4D reconstruction and tracking tasks, demonstrating the effectiveness of the flow-central representation for spatiotemporal scene understanding.

Keywords

Cite

@article{arxiv.2602.14021,
  title  = {Flow4R: Unifying 4D Reconstruction and Tracking with Scene Flow},
  author = {Shenhan Qian and Ganlin Zhang and Shangzhe Wu and Daniel Cremers},
  journal= {arXiv preprint arXiv:2602.14021},
  year   = {2026}
}

Comments

Project Page: https://shenhanqian.github.io/flow4r

R2 v1 2026-07-01T10:37:20.128Z