English

SLYKLatent: A Learning Framework for Gaze Estimation Using Deep Facial Feature Learning

Computer Vision and Pattern Recognition 2025-11-06 v2 Artificial Intelligence Human-Computer Interaction Image and Video Processing

Abstract

In this research, we present SLYKLatent, a novel approach for enhancing gaze estimation by addressing appearance instability challenges in datasets due to aleatoric uncertainties, covariant shifts, and test domain generalization. SLYKLatent utilizes Self-Supervised Learning for initial training with facial expression datasets, followed by refinement with a patch-based tri-branch network and an inverse explained variance-weighted training loss function. Our evaluation on benchmark datasets achieves a 10.9% improvement on Gaze360, supersedes top MPIIFaceGaze results with 3.8%, and leads on a subset of ETH-XGaze by 11.6%, surpassing existing methods by significant margins. Adaptability tests on RAF-DB and Affectnet show 86.4% and 60.9% accuracies, respectively. Ablation studies confirm the effectiveness of SLYKLatent's novel components.

Keywords

Cite

@article{arxiv.2402.01555,
  title  = {SLYKLatent: A Learning Framework for Gaze Estimation Using Deep Facial Feature Learning},
  author = {Samuel Adebayo and Joost C. Dessing and Seán McLoone},
  journal= {arXiv preprint arXiv:2402.01555},
  year   = {2025}
}
R2 v1 2026-06-28T14:36:05.122Z