English

CapStARE: Capsule-based Spatiotemporal Architecture for Robust and Efficient Gaze Estimation

Computer Vision and Pattern Recognition 2025-09-25 v1

Abstract

We introduce CapStARE, a capsule-based spatio-temporal architecture for gaze estimation that integrates a ConvNeXt backbone, capsule formation with attention routing, and dual GRU decoders specialized for slow and rapid gaze dynamics. This modular design enables efficient part-whole reasoning and disentangled temporal modeling, achieving state-of-the-art performance on ETH-XGaze (3.36) and MPIIFaceGaze (2.65) while maintaining real-time inference (< 10 ms). The model also generalizes well to unconstrained conditions in Gaze360 (9.06) and human-robot interaction scenarios in RT-GENE (4.76), outperforming or matching existing methods with fewer parameters and greater interpretability. These results demonstrate that CapStARE offers a practical and robust solution for real-time gaze estimation in interactive systems. The related code and results for this article can be found on: https://github.com/toukapy/capsStare

Cite

@article{arxiv.2509.19936,
  title  = {CapStARE: Capsule-based Spatiotemporal Architecture for Robust and Efficient Gaze Estimation},
  author = {Miren Samaniego and Igor Rodriguez and Elena Lazkano},
  journal= {arXiv preprint arXiv:2509.19936},
  year   = {2025}
}
R2 v1 2026-07-01T05:53:50.966Z