English
Related papers

Related papers: Appearance-based Gaze Estimation With Deep Learnin…

200 papers

Eye movements can reveal valuable insights into various aspects of human mental processes, physical well-being, and actions. Recently, several datasets have been made available that simultaneously record EEG activity and eye movements. This…

Signal Processing · Electrical Eng. & Systems 2023-08-14 Nina Weng , Martyna Plomecka , Manuel Kaufmann , Ard Kastrati , Roger Wattenhofer , Nicolas Langer

This paper presents a method that utilizes multiple camera views for the gaze target estimation (GTE) task. The approach integrates information from different camera views to improve accuracy and expand applicability, addressing limitations…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Qiaomu Miao , Vivek Raju Golani , Jingyi Xu , Progga Paromita Dutta , Minh Hoai , Dimitris Samaras

An increasing number of works explore collaborative human-computer systems in which human gaze is used to enhance computer vision systems. For object detection these efforts were so far restricted to late integration approaches that have…

Computer Vision and Pattern Recognition · Computer Science 2015-05-22 Iaroslav Shcherbatyi , Andreas Bulling , Mario Fritz

Facial pose estimation has gained a lot of attentions in many practical applications, such as human-robot interaction, gaze estimation and driver monitoring. Meanwhile, end-to-end deep learning-based facial pose estimation is becoming more…

Computer Vision and Pattern Recognition · Computer Science 2020-10-13 Zhaoxiang Liu , Zezhou Chen , Jinqiang Bai , Shaohua Li , Shiguo Lian

Joint attention is a core, early-developing form of social interaction. It is based on our ability to discriminate the third party objects that other people are looking at. While it has been shown that people can accurately determine…

Artificial Intelligence · Computer Science 2014-12-09 Tao Gao , Daniel Harari , Joshua Tenenbaum , Shimon Ullman

Vision-based autonomous driving through imitation learning mimics the behaviors of human drivers by training on pairs of data of raw driver-view images and actions. However, there are other cues, e.g. gaze behavior, available from human…

Computer Vision and Pattern Recognition · Computer Science 2019-08-28 Congcong Liu , Yuying Chen , Lei Tai , Ming Liu , Bertram Shi

As an indicator of human attention gaze is a subtle behavioral cue which can be exploited in many applications. However, inferring 3D gaze direction is challenging even for deep neural networks given the lack of large amount of data…

Computer Vision and Pattern Recognition · Computer Science 2019-04-25 Yu Yu , Gang Liu , Jean-Marc Odobez

Appearance-based gaze estimation, aiming to predict accurate 3D gaze direction from a single facial image, has made promising progress in recent years. However, most methods suffer significant performance degradation in cross-domain…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Qida Tan , Hongyu Yang , Wenchao Du

We present a novel multistream network that learns robust eye representations for gaze estimation. We first create a synthetic dataset containing eye region masks detailing the visible eyeball and iris using a simulator. We then perform eye…

Computer Vision and Pattern Recognition · Computer Science 2021-12-16 Zunayed Mahmud , Paul Hungler , Ali Etemad

Accurately knowing uncertainties in appearance-based gaze tracking is critical for ensuring reliable downstream applications. Due to the lack of individual uncertainty labels, current uncertainty-aware approaches adopt probabilistic models…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Qiaojie Zheng , Jiucai Zhang , Xiaoli Zhang

Unconstrained remote gaze tracking using off-the-shelf cameras is a challenging problem. Recently, promising algorithms for appearance-based gaze estimation using convolutional neural networks (CNN) have been proposed. Improving their…

Computer Vision and Pattern Recognition · Computer Science 2018-04-24 Rajeev Ranjan , Shalini De Mello , Jan Kautz

We present PicoEyes, a unified gaze estimation framework that directly predicts all key attributes of gaze, including 3D eye parameters, eye-region segmentation, optical axis, visual axis, and depth maps, from either monocular or binocular…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Fuxin Duan , Hui Wang

The gaze behaviour of a reader is helpful in solving several NLP tasks such as automatic essay grading. However, collecting gaze behaviour from readers is costly in terms of time and money. In this paper, we propose a way to improve…

Computation and Language · Computer Science 2021-02-02 Sandeep Mathias , Rudra Murthy , Diptesh Kanojia , Abhijit Mishra , Pushpak Bhattacharyya

Face recognition has long been an active research area in the field of artificial intelligence, particularly since the rise of deep learning in recent years. In some practical situations, each identity has only a single sample available for…

Computer Vision and Pattern Recognition · Computer Science 2022-08-11 Fan Liu , Delong Chen , Fei Wang , Zewen Li , Feng Xu

Recent research has demonstrated the ability to estimate gaze on mobile devices by performing inference on the image from the phone's front-facing camera, and without requiring specialized hardware. While this offers wide potential…

Computer Vision and Pattern Recognition · Computer Science 2017-11-28 Matan Sela , Pingmei Xu , Junfeng He , Vidhya Navalpakkam , Dmitry Lagun

In general, biometry-based control systems may not rely on individual expected behavior or cooperation to operate appropriately. Instead, such systems should be aware of malicious procedures for unauthorized access attempts. Some works…

Gaze behaviour has been used as a way to gather cognitive information for a number of years. In this paper, we discuss the use of gaze behaviour in solving different tasks in natural language processing (NLP) without having to record it at…

Computation and Language · Computer Science 2022-01-04 Sandeep Mathias , Diptesh Kanojia , Abhijit Mishra , Pushpak Bhattacharyya

Gaze is the essential manifestation of human attention. In recent years, a series of work has achieved high accuracy in gaze estimation. However, the inter-personal difference limits the reduction of the subject-independent gaze estimation…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Zidong Guo , Zejian Yuan , Chong Zhang , Wanchao Chi , Yonggen Ling , Shenghao Zhang

Recent studies on appearance based gaze estimation indicate the ability of Neural Networks to decode gaze information from facial images encompassing pose information. In this paper, we propose Gaze-Net: A capsule network capable of…

Computer Vision and Pattern Recognition · Computer Science 2020-04-17 Bhanuka Mahanama , Yasith Jayawardana , Sampath Jayarathna

Deep learning-based appearance gaze estimation methods are gaining popularity due to their high accuracy and fewer constraints from the environment. However, existing high-precision models often rely on deeper networks, leading to problems…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Zhang Cheng , Yanxia Wang