English

How Much Future Helps? A Controlled Study of Future-Privileged Supervision for Causal Egocentric Gaze Estimation

Computer Vision and Pattern Recognition 2026-07-01 v1

Abstract

Egocentric gaze estimation is commonly studied using models that process the full video with access to future frames, while real-world applications require strictly causal, online prediction. This discrepancy raises key questions: Does future context inherently provide valuable signals for gaze estimation? If so, how much future look-ahead optimally supervises a causal model during training? To investigate, we propose a controlled framework featuring a future-aware branch that accesses a tunable look-ahead horizon during training but is discarded at inference. This design isolates the impact of future context while keeping the inference architecture fixed and strictly causal. Across EGTEA Gaze+ and Ego4D, we find that future-privileged supervision consistently improves causal gaze prediction, confirming its utility. However, performance gains do not increase monotonically with longer look-ahead, but rather peak within a bounded temporal regime. Specifically, optimal performance corresponds to roughly 1.7--3.3 seconds of future context (H[5,10]H{\in}[5, 10]) on EGTEA Gaze+ and 2.7 seconds (H=10H{=}10) on Ego4D. Our results demonstrate that lightweight causal models can effectively absorb future-aware signals, providing practical guidance for real-time egocentric gaze modeling.

Keywords

Cite

@article{arxiv.2607.01437,
  title  = {How Much Future Helps? A Controlled Study of Future-Privileged Supervision for Causal Egocentric Gaze Estimation},
  author = {Jia Li and Wenjie Zhao and Fnu Atisri and Sanskriti Aripineni and Shijian Deng and Jon E. Froehlich and Yuhang Zhao and Yapeng Tian},
  journal= {arXiv preprint arXiv:2607.01437},
  year   = {2026}
}

Comments

Accepted to the 7th International Workshop on Eye and Gaze in Computer Vision (GAZE 2026), CVPR 2026. Best Paper Award