English

Learning Gaussian Representation for Eye Fixation Prediction

Computer Vision and Pattern Recognition 2024-03-25 v1

Abstract

Existing eye fixation prediction methods perform the mapping from input images to the corresponding dense fixation maps generated from raw fixation points. However, due to the stochastic nature of human fixation, the generated dense fixation maps may be a less-than-ideal representation of human fixation. To provide a robust fixation model, we introduce Gaussian Representation for eye fixation modeling. Specifically, we propose to model the eye fixation map as a mixture of probability distributions, namely a Gaussian Mixture Model. In this new representation, we use several Gaussian distribution components as an alternative to the provided fixation map, which makes the model more robust to the randomness of fixation. Meanwhile, we design our framework upon some lightweight backbones to achieve real-time fixation prediction. Experimental results on three public fixation prediction datasets (SALICON, MIT1003, TORONTO) demonstrate that our method is fast and effective.

Keywords

Cite

@article{arxiv.2403.14821,
  title  = {Learning Gaussian Representation for Eye Fixation Prediction},
  author = {Peipei Song and Jing Zhang and Piotr Koniusz and Nick Barnes},
  journal= {arXiv preprint arXiv:2403.14821},
  year   = {2024}
}

Comments

11 pages, 7 figures

R2 v1 2026-06-28T15:29:16.548Z