English
Related papers

Related papers: Appearance-based gaze estimation enhanced with syn…

200 papers

This paper evaluates the current gaze estimation methods within an HRI context of a shared workspace scenario. We introduce a new, annotated dataset collected with the NICO robotic platform. We evaluate four state-of-the-art gaze estimation…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Matej Palider , Omar Eldardeer , Viktor Kocur

Gaze reflects how humans process visual scenes and is therefore increasingly used in computer vision systems. Previous works demonstrated the potential of gaze for object-centric tasks, such as object localization and recognition, but it…

Computer Vision and Pattern Recognition · Computer Science 2016-08-19 Yusuke Sugano , Andreas Bulling

Non-invasive gaze estimation methods usually regress gaze directions directly from a single face or eye image. However, due to important variabilities in eye shapes and inner eye structures amongst individuals, universal models obtain…

Computer Vision and Pattern Recognition · Computer Science 2020-02-07 Gang Liu , Yu Yu , Kenneth A. Funes Mora , Jean-Marc Odobez

We explore techniques for eye gaze estimation using machine learning. Eye gaze estimation is a common problem for various behavior analysis and human-computer interfaces. The purpose of this work is to discuss various model types for eye…

Computer Vision and Pattern Recognition · Computer Science 2022-08-01 Aveena Kottwani , Ayush Kumar

Developing gaze estimation models that generalize well to unseen domains and in-the-wild conditions remains a challenge with no known best solution. This is mostly due to the difficulty of acquiring ground truth data that cover the…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Evangelos Ververas , Polydefkis Gkagkos , Jiankang Deng , Michail Christos Doukas , Jia Guo , Stefanos Zafeiriou

This research report explores the role of eye gaze in human-robot interactions and proposes a learning system for detecting objects gazed at by humans using solely visual feedback. The system leverages face detection, human attention…

Robotics · Computer Science 2025-09-16 Shiva Hanifi , Elisa Maiettini , Maria Lombardi , Lorenzo Natale

Appearance-based gaze estimation methods that only require an off-the-shelf camera have significantly improved but they are still not yet widely used in the human-computer interaction (HCI) community. This is partly because it remains…

Human-Computer Interaction · Computer Science 2019-01-31 Xucong Zhang , Yusuke Sugano , Andreas Bulling

Gaze estimation is the fundamental basis for many visual tasks. Yet, the high cost of acquiring gaze datasets with 3D annotations hinders the optimization and application of gaze estimation models. In this work, we propose a novel Head-Eye…

Computer Vision and Pattern Recognition · Computer Science 2023-01-02 Pengwei Yin , Jiawu Dai , Jingjing Wang , Di Xie , Shiliang Pu

Enabling robots to understand human gaze target is a crucial step to allow capabilities in downstream tasks, for example, attention estimation and movement anticipation in real-world human-robot interactions. Prior works have addressed the…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Zhuangzhuang Dai , Vincent Gbouna Zakka , Luis J. Manso , Chen Li

As a critical cue for understanding human intention, human gaze provides a key signal for Human-Computer Interaction(HCI) applications. Appearance-based gaze estimation, which directly regresses the gaze vector from eye images, has made…

Computer Vision and Pattern Recognition · Computer Science 2021-11-24 Shaobo Guo , Xiao Jiang , Zhizhong Su , Rui Wu , Xin Wang

Eye gaze is an important non-verbal cue for human affect analysis. Recent gaze estimation work indicated that information from the full face region can benefit performance. Pushing this idea further, we propose an appearance-based method…

Computer Vision and Pattern Recognition · Computer Science 2023-05-17 Xucong Zhang , Yusuke Sugano , Mario Fritz , Andreas Bulling

Appearance-based gaze estimation is believed to work well in real-world settings, but existing datasets have been collected under controlled laboratory conditions and methods have been not evaluated across multiple datasets. In this work we…

Computer Vision and Pattern Recognition · Computer Science 2017-02-07 Xucong Zhang , Yusuke Sugano , Mario Fritz , Andreas Bulling

Unconstrained remote gaze estimation remains challenging mostly due to its vulnerability to the large variability in head-pose. Prior solutions struggle to maintain reliable accuracy in unconstrained remote gaze tracking. Among them,…

Computer Vision and Pattern Recognition · Computer Science 2020-04-09 Zhecan Wang , Jian Zhao , Cheng Lu , Han Huang , Fan Yang , Lianji Li , Yandong Guo

Accurate and efficient eye gaze estimation is important for emerging consumer electronic systems such as driver monitoring systems and novel user interfaces. Such systems are required to operate reliably in difficult, unconstrained…

Computer Vision and Pattern Recognition · Computer Science 2018-06-29 Joseph Lemley , Anuradha Kar , Alexandru Drimbarean , Peter Corcoran

Deep neural networks for video-based eye tracking have demonstrated resilience to noisy environments, stray reflections, and low resolution. However, to train these networks, a large number of manually annotated images are required. To…

Computer Vision and Pattern Recognition · Computer Science 2020-12-22 Nitinraj Nair , Rakshit Kothari , Aayush K. Chaudhary , Zhizhuo Yang , Gabriel J. Diaz , Jeff B. Pelz , Reynold J. Bailey

Introduction: In the realm of human-computer interaction and behavioral research, accurate real-time gaze estimation is critical. Traditional methods often rely on expensive equipment or large datasets, which are impractical in many…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Esther Enhui Ye , John Enzhou Ye , Joseph Ye , Jacob Ye , Runzhou Ye

We present a novel multistream network that learns robust eye representations for gaze estimation. We first create a synthetic dataset containing eye region masks detailing the visible eyeball and iris using a simulator. We then perform eye…

Computer Vision and Pattern Recognition · Computer Science 2021-12-16 Zunayed Mahmud , Paul Hungler , Ali Etemad

Predicting human motion is critical for assistive robots and AR/VR applications, where the interaction with humans needs to be safe and comfortable. Meanwhile, an accurate prediction depends on understanding both the scene context and human…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Yang Zheng , Yanchao Yang , Kaichun Mo , Jiaman Li , Tao Yu , Yebin Liu , C. Karen Liu , Leonidas J. Guibas

While for the evaluation of robustness of eye tracking algorithms the use of real-world data is essential, there are many applications where simulated, synthetic eye images are of advantage. They can generate labelled ground-truth data for…

Computer Vision and Pattern Recognition · Computer Science 2015-11-25 Thomas C. Kübler , Tobias Rittig , Judith Ungewiss , Christina Krauss , Enkelejda Kasneci

Gaze behavior is an important non-verbal cue in social signal processing and human-computer interaction. In this paper, we tackle the problem of person- and head pose-independent 3D gaze estimation from remote cameras, using a multi-modal…

Computer Vision and Pattern Recognition · Computer Science 2018-09-18 Cristina Palmero , Javier Selva , Mohammad Ali Bagheri , Sergio Escalera