English
Related papers

Related papers: PicoEyes: Unified Gaze Estimation Framework for Mi…

200 papers

Determining the direction in which a person is looking is an important problem in a wide range of HCI applications. In this paper we describe a highly accurate algorithm that performs gaze estimation using an affordable and widely available…

Computer Vision and Pattern Recognition · Computer Science 2016-04-07 Reza Shoja Ghiass , Ognjen Arandjelovic

Recent studies on appearance based gaze estimation indicate the ability of Neural Networks to decode gaze information from facial images encompassing pose information. In this paper, we propose Gaze-Net: A capsule network capable of…

Computer Vision and Pattern Recognition · Computer Science 2020-04-17 Bhanuka Mahanama , Yasith Jayawardana , Sampath Jayarathna

Gaze estimation, the task of predicting where an individual is looking, is a critical task with direct applications in areas such as human-computer interaction and virtual reality. Estimating the direction of looking in unconstrained…

Computer Vision and Pattern Recognition · Computer Science 2024-02-14 Andy Cătrună , Adrian Cosma , Emilian Rădoi

Understanding where people are looking is an informative social cue. In this work, we present Gaze360, a large-scale gaze-tracking dataset and method for robust 3D gaze estimation in unconstrained images. Our dataset consists of 238…

Computer Vision and Pattern Recognition · Computer Science 2019-10-23 Petr Kellnhofer , Adria Recasens , Simon Stent , Wojciech Matusik , Antonio Torralba

Despite significant advances in improving the gaze tracking accuracy under controlled conditions, the tracking robustness under real-world conditions, such as large head pose and movements, use of eyeglasses, illumination and eye type…

Computer Vision and Pattern Recognition · Computer Science 2018-01-04 Nuri Murat Arar , Jean-Philippe Thiran

3D and 2D gaze estimation share the fundamental objective of capturing eye movements but are traditionally treated as two distinct research domains. In this paper, we introduce a novel cross-task few-shot 2D gaze estimation approach, aiming…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Yihua Cheng , Hengfei Wang , Zhongqun Zhang , Yang Yue , Bo Eun Kim , Feng Lu , Hyung Jin Chang

Appearance-based gaze estimation has attracted more and more attention because of its wide range of applications. The use of deep convolutional neural networks has improved the accuracy significantly. In order to improve the estimation…

Computer Vision and Pattern Recognition · Computer Science 2019-03-19 Zhaokang Chen , Bertram E. Shi

Eye tracking has become increasingly important in virtual and augmented reality applications; however, the current gaze accuracy falls short of meeting the requirements for spatial computing. We designed a gaze collection framework and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Xiaoyin Yang

A major challenge for physically unconstrained gaze estimation is acquiring training data with 3D gaze annotations for in-the-wild and outdoor scenarios. In contrast, videos of human interactions in unconstrained environments are abundantly…

Computer Vision and Pattern Recognition · Computer Science 2021-05-21 Rakshit Kothari , Shalini De Mello , Umar Iqbal , Wonmin Byeon , Seonwook Park , Jan Kautz

Deep learning has bolstered gaze estimation techniques, but real-world deployment has been impeded by inadequate training datasets. This problem is exacerbated by both hardware-induced variations in eye images and inherent biological…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Sean Anthony Byrne , Virmarie Maquiling , Marcus Nyström , Enkelejda Kasneci , Diederick C. Niehorster

Human eye gaze estimation is an important cognitive ingredient for successful human-robot interaction, enabling the robot to read and predict human behavior. We approach this problem using artificial neural networks and build a modular…

Computer Vision and Pattern Recognition · Computer Science 2024-03-01 Dmytro Herashchenko , Igor Farkaš

We present a novel multistream network that learns robust eye representations for gaze estimation. We first create a synthetic dataset containing eye region masks detailing the visible eyeball and iris using a simulator. We then perform eye…

Computer Vision and Pattern Recognition · Computer Science 2021-12-16 Zunayed Mahmud , Paul Hungler , Ali Etemad

Deep learning appearance-based 3D gaze estimation is gaining popularity due to its minimal hardware requirements and being free of constraint. Unreliable and overconfident inferences, however, still limit the adoption of this gaze…

Computer Vision and Pattern Recognition · Computer Science 2025-02-26 Qiaojie Zheng , Xiaoli Zhang

In this letter, we propose a new method, Multi-Clue Gaze (MCGaze), to facilitate video gaze estimation via capturing spatial-temporal interaction context among head, face, and eye in an end-to-end learning way, which has not been well…

Computer Vision and Pattern Recognition · Computer Science 2024-01-01 Yiran Guan , Zhuoguang Chen , Wenzheng Zeng , Zhiguo Cao , Yang Xiao

Appearance-based gaze estimation has been actively studied in recent years. However, its generalization performance for unseen head poses is still a significant limitation for existing methods. This work proposes a generalizable multi-view…

Computer Vision and Pattern Recognition · Computer Science 2023-11-16 Yoichiro Hisadome , Tianyi Wu , Jiawei Qin , Yusuke Sugano

Appearance-based gaze estimation (AGE) has achieved remarkable performance in constrained settings, yet we reveal a significant generalization gap where existing AGE models often fail in practical, unconstrained scenarios, particularly…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Zhenhao Li , Zheng Liu , Seunghyun Lee , Amin Fadaeinejad , Yuanhao Yu

Enabling robots to understand human gaze target is a crucial step to allow capabilities in downstream tasks, for example, attention estimation and movement anticipation in real-world human-robot interactions. Prior works have addressed the…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Zhuangzhuang Dai , Vincent Gbouna Zakka , Luis J. Manso , Chen Li

Along with the recent development of deep neural networks, appearance-based gaze estimation has succeeded considerably when training and testing within the same domain. Compared to the within-domain task, the variance of different domains…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Jiawei Qin , Takuru Shimoyama , Xucong Zhang , Yusuke Sugano

Predicting gaze behavior in virtual reality environments remains a significant challenge with implications for rendering optimization and interface design. This paper introduces a multimodal approach to VR gaze prediction that combines…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Farhaan Ebadulla , Chiraag Mudlpaur , Shreya Chaurasia , Gaurav BV

Non-invasive gaze estimation methods usually regress gaze directions directly from a single face or eye image. However, due to important variabilities in eye shapes and inner eye structures amongst individuals, universal models obtain…

Computer Vision and Pattern Recognition · Computer Science 2020-02-07 Gang Liu , Yu Yu , Kenneth A. Funes Mora , Jean-Marc Odobez