English
Related papers

Related papers: Unsupervised Learning of Eye Gaze Representation f…

200 papers

Vision-based autonomous driving through imitation learning mimics the behaviors of human drivers by training on pairs of data of raw driver-view images and actions. However, there are other cues, e.g. gaze behavior, available from human…

Computer Vision and Pattern Recognition · Computer Science 2019-08-28 Congcong Liu , Yuying Chen , Lei Tai , Ming Liu , Bertram Shi

Images of the eye are key in several computer vision problems, such as shape registration and gaze estimation. Recent large-scale supervised methods for these problems require time-consuming data collection and manual annotation, which can…

Computer Vision and Pattern Recognition · Computer Science 2017-02-07 Erroll Wood , Tadas Baltrusaitis , Xucong Zhang , Yusuke Sugano , Peter Robinson , Andreas Bulling

With the escalated demand of human-machine interfaces for intelligent systems, development of gaze controlled system have become a necessity. Gaze, being the non-intrusive form of human interaction, is one of the best suited approach.…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Somsukla Maiti , Akshansh Gupta

We address the challenge of unsupervised mistake detection in egocentric video of skilled human activities through the analysis of gaze signals. While traditional methods rely on manually labeled mistakes, our approach does not require…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 Michele Mazzamuto , Antonino Furnari , Yoichi Sato , Giovanni Maria Farinella

Estimating human gaze from natural eye images only is a challenging task. Gaze direction can be defined by the pupil- and the eyeball center where the latter is unobservable in 2D images. Hence, achieving highly accurate gaze estimates is…

Computer Vision and Pattern Recognition · Computer Science 2018-12-31 Seonwook Park , Adrian Spurr , Otmar Hilliges

Eye gaze analysis is an important research problem in the field of Computer Vision and Human-Computer Interaction. Even with notable progress in the last 10 years, automatic gaze analysis still remains challenging due to the uniqueness of…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Shreya Ghosh , Abhinav Dhall , Munawar Hayat , Jarrod Knibbe , Qiang Ji

Appearance-based gaze estimation has shown great promise in many applications by using a single general-purpose camera as the input device. However, its success is highly depending on the availability of large-scale well-annotated gaze…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Lingyu Du , Xucong Zhang , Guohao Lan

Estimation of 3D gaze is highly relevant to multiple fields, including but not limited to interactive systems, specialized human-computer interfaces, and behavioral research. Although recently deep learning methods have boosted the accuracy…

Computer Vision and Pattern Recognition · Computer Science 2020-11-04 Gabriel Lefundes , Luciano Oliveira

Developing gaze estimation models that generalize well to unseen domains and in-the-wild conditions remains a challenge with no known best solution. This is mostly due to the difficulty of acquiring ground truth data that cover the…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Evangelos Ververas , Polydefkis Gkagkos , Jiankang Deng , Michail Christos Doukas , Jia Guo , Stefanos Zafeiriou

Finding the eye and parsing out the parts (e.g. pupil and iris) is a key prerequisite for image-based eye tracking, which has become an indispensable module in today's head-mounted VR/AR devices. However, a typical route for training a…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Jiangfan Deng , Zhuang Jia , Zhaoxue Wang , Xiang Long , Daniel K. Du

Learning-based methods are believed to work well for unconstrained gaze estimation, i.e. gaze estimation from a monocular RGB camera without assumptions regarding user, environment, or camera. However, current gaze datasets were collected…

Computer Vision and Pattern Recognition · Computer Science 2017-11-27 Xucong Zhang , Yusuke Sugano , Mario Fritz , Andreas Bulling

With the rapid development of deep learning technology in the past decade, appearance-based gaze estimation has attracted great attention from both computer vision and human-computer interaction research communities. Fascinating methods…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Yunhan Wang , Xiangwei Shi , Shalini De Mello , Hyung Jin Chang , Xucong Zhang

Non-invasive gaze estimation methods usually regress gaze directions directly from a single face or eye image. However, due to important variabilities in eye shapes and inner eye structures amongst individuals, universal models obtain…

Computer Vision and Pattern Recognition · Computer Science 2020-02-07 Gang Liu , Yu Yu , Kenneth A. Funes Mora , Jean-Marc Odobez

Appearance-based gaze estimation provides relatively unconstrained gaze tracking. However, subject-independent models achieve limited accuracy partly due to individual variations. To improve estimation, we propose a novel gaze decomposition…

Computer Vision and Pattern Recognition · Computer Science 2020-01-10 Zhaokang Chen , Bertram E. Shi

Inter-personal anatomical differences limit the accuracy of person-independent gaze estimation networks. Yet there is a need to lower gaze errors further to enable applications requiring higher quality. Further gains can be achieved by…

Computer Vision and Pattern Recognition · Computer Science 2019-10-15 Seonwook Park , Shalini De Mello , Pavlo Molchanov , Umar Iqbal , Otmar Hilliges , Jan Kautz

Eye gaze is an important non-verbal cue for human affect analysis. Recent gaze estimation work indicated that information from the full face region can benefit performance. Pushing this idea further, we propose an appearance-based method…

Computer Vision and Pattern Recognition · Computer Science 2023-05-17 Xucong Zhang , Yusuke Sugano , Mario Fritz , Andreas Bulling

Egocentric perception has grown rapidly with the advent of immersive computing devices. Human gaze prediction is an important problem in analyzing egocentric videos and has primarily been tackled through either saliency-based modeling or…

Computer Vision and Pattern Recognition · Computer Science 2021-04-30 Sathyanarayanan N. Aakur , Arunkumar Bagavathi

We propose a self-supervised framework for learning facial attributes by simply watching videos of a human face speaking, laughing, and moving over time. To perform this task, we introduce a network, Facial Attributes-Net (FAb-Net), that is…

Computer Vision and Pattern Recognition · Computer Science 2018-08-22 Olivia Wiles , A. Sophia Koepke , Andrew Zisserman

In recent years, the accuracy of gaze estimation techniques has gradually improved, but existing methods often rely on large datasets or large models to improve performance, which leads to high demands on computational resources. In terms…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Zhang Cheng , Yanxia Wang , Guoyu Xia

The study of human gaze behavior in natural contexts requires algorithms for gaze estimation that are robust to a wide range of imaging conditions. However, algorithms often fail to identify features such as the iris and pupil centroid in…

Computer Vision and Pattern Recognition · Computer Science 2022-05-05 Rakshit S. Kothari , Reynold J. Bailey , Christopher Kanan , Jeff B. Pelz , Gabriel J. Diaz