English
Related papers

Related papers: MTGLS: Multi-Task Gaze Estimation with Limited Sup…

200 papers

Eye gaze offers valuable cues about attention, short-term intent, and future actions, making it a powerful signal for modeling egocentric behavior. In this work, we propose a gaze-regularized framework that enhances VLMs for two key…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Anupam Pani , Yanchao Yang

In this paper, we evaluate a synthetic framework to be used in the field of gaze estimation employing deep learning techniques. The lack of sufficient annotated data could be overcome by the utilization of a synthetic evaluation framework…

Computer Vision and Pattern Recognition · Computer Science 2020-06-15 Gonzalo Garde , Andoni Larumbe-Bergera , Benoît Bossavit , Rafael Cabeza , Sonia Porta , Arantxa Villanueva

Gaze estimation is of great importance to many scientific fields and daily applications, ranging from fundamental research in cognitive psychology to attention-aware mobile systems. While recent advancements in deep learning have yielded…

Computer Vision and Pattern Recognition · Computer Science 2022-09-15 Lingyu Du , Guohao Lan

Understanding user intent during magnified reading is critical for accessible interface design. Yet magnification collapses visual context and forces continual viewport dragging, producing fragmented, noisy gaze and obscuring reading…

Human-Computer Interaction · Computer Science 2025-09-25 Seongsil Heo , Roberto Manduchi

The ability of gaze estimation models to generalize is often significantly hindered by various factors unrelated to gaze, especially when the training dataset is limited. Current strategies aim to address this challenge through different…

Computer Vision and Pattern Recognition · Computer Science 2024-11-14 Pengwei Yin , Jingjing Wang , Guanzhong Zeng , Di Xie , Jiang Zhu

Appearance-based gaze estimation has been actively studied in recent years. However, its generalization performance for unseen head poses is still a significant limitation for existing methods. This work proposes a generalizable multi-view…

Computer Vision and Pattern Recognition · Computer Science 2023-11-16 Yoichiro Hisadome , Tianyi Wu , Jiawei Qin , Yusuke Sugano

Vision-language models (VLMs) have rapidly evolved into general-purpose multimodal reasoners with strong zero-shot generalization. In this context, VLMs could greatly benefit the analysis of human gaze and attention, a central task in human…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Hengfei Wang , Anshul Gupta , Pierre Vuillecard , Jean-Marc Odobez

Unconstrained gaze estimation is the process of determining where a subject is directing their visual attention in uncontrolled environments. Gaze estimation systems are important for a myriad of tasks such as driver distraction monitoring,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Franko Šikić , Donik Vršnak , Sven Lončarić

Medical image segmentation remains challenging due to the high cost of pixel-level annotations for training. In the context of weak supervision, clinician gaze data captures regions of diagnostic interest; however, its sparsity limits its…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Jingkun Chen , Haoran Duan , Xiao Zhang , Boyan Gao , Vicente Grau , Jungong Han

Appearance-based gaze estimation from RGB images provides relatively unconstrained gaze tracking. We have previously proposed a gaze decomposition method that decomposes the gaze angle into the sum of a subject-independent gaze estimate…

Computer Vision and Pattern Recognition · Computer Science 2022-02-15 Zhaokang Chen , Bertram E. Shi

Along with the recent development of deep neural networks, appearance-based gaze estimation has succeeded considerably when training and testing within the same domain. Compared to the within-domain task, the variance of different domains…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Jiawei Qin , Takuru Shimoyama , Xucong Zhang , Yusuke Sugano

Eye gaze estimation and simultaneous semantic understanding of a user through eye images is a crucial component in Virtual and Mixed Reality; enabling energy efficient rendering, multi-focal displays and effective interaction with 3D…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Zhengyang Wu , Srivignesh Rajendran , Tarrence van As , Joelle Zimmermann , Vijay Badrinarayanan , Andrew Rabinovich

Analyzing the gaze accuracy characteristics of an eye tracker is a critical task as its gaze data is frequently affected by non-ideal operating conditions in various consumer eye tracking applications. In this study, gaze error patterns…

Signal Processing · Electrical Eng. & Systems 2020-05-11 Anuradha Kar

3D gaze information is important for scene-centric attention analysis but accurate estimation and analysis of 3D gaze in real-world environments remains challenging. We present a novel 3D gaze estimation method for monocular head-mounted…

Human-Computer Interaction · Computer Science 2017-02-07 Mohsen Mansouryar , Julian Steil , Yusuke Sugano , Andreas Bulling

Inter-personal anatomical differences limit the accuracy of person-independent gaze estimation networks. Yet there is a need to lower gaze errors further to enable applications requiring higher quality. Further gains can be achieved by…

Computer Vision and Pattern Recognition · Computer Science 2019-10-15 Seonwook Park , Shalini De Mello , Pavlo Molchanov , Umar Iqbal , Otmar Hilliges , Jan Kautz

Human gaze provides essential cues for interpreting attention, intention, and social interaction in visual scenes, yet gaze understanding remains largely unexplored in current vision-language models (VLMs). While recent VLMs achieve strong…

Computer Vision and Pattern Recognition · Computer Science 2025-12-25 Shijing Wang , Chaoqun Cui , Yaping Huang , Hyung Jin Chang , Yihua Cheng

The best performing methods for 3D human pose estimation from monocular images require large amounts of in-the-wild 2D and controlled 3D pose annotated datasets which are costly and require sophisticated systems to acquire. To reduce this…

Computer Vision and Pattern Recognition · Computer Science 2020-02-26 Rahul Mitra , Nitesh B. Gundavarapu , Abhishek Sharma , Arjun Jain

Visual gaze estimation, with its wide-ranging application scenarios, has garnered increasing attention within the research community. Although existing approaches infer gaze solely from image signals, recent advances in visual-language…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Jun Wang , Hao Ruan , Liangjian Wen , Yong Dai , Mingjie Wang

Head-mounted eye trackers promise convenient access to reliable gaze data in unconstrained environments. Due to several limitations, however, often they can only partially deliver on this promise. Among those are the following: (i) the…

Computer Vision and Pattern Recognition · Computer Science 2020-09-02 Marc Tonsen , Chris Kay Baumann , Kai Dierkes

Although the number of gaze estimation datasets is growing, the application of appearance-based gaze estimation methods is mostly limited to estimating the point of gaze on a screen. This is in part because most datasets are generated in a…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Cedric Leblond-Menard , Gabriel Picard-Krashevski , Sofiane Achiche