English

Polarization-Based Eye Tracking with Personalized Siamese Architectures

Computer Vision and Pattern Recognition 2026-03-30 v1

Abstract

Head-mounted devices integrated with eye tracking promise a solution for natural human-computer interaction. However, they typically require per-user calibration for optimal performance due to inter-person variability. A differential personalization approach using Siamese architectures learns relative gaze displacements and reconstructs absolute gaze from a small set of calibration frames. In this paper, we benchmark Siamese personalization on polarization-enabled eye tracking. For benchmarking, we use a 338-subject dataset captured with a polarization-sensitive camera and 850 nm illumination. We achieve performance comparable to linear calibration with 10-fold fewer samples. Using polarization inputs for Siamese personalization reduces gaze error by up to 12% compared to near-infrared (NIR)-based inputs. Combining Siamese personalization with linear calibration yields further improvements of up to 13% over a linearly calibrated baseline. These results establish Siamese personalization as a practical approach enabling accurate eye tracking.

Keywords

Cite

@article{arxiv.2603.25889,
  title  = {Polarization-Based Eye Tracking with Personalized Siamese Architectures},
  author = {Beyza Kalkanli and Tom Bu and Mahsa Shakeri and Alexander Fix and Dave Stronks and Dmitri Model and Mantas Žurauskas},
  journal= {arXiv preprint arXiv:2603.25889},
  year   = {2026}
}

Comments

Accepted to ETRA 2026 as full paper

R2 v1 2026-07-01T11:39:54.667Z