English
Related papers

Related papers: RAZE: Region Guided Self-Supervised Gaze Represent…

200 papers

Developing gaze estimation models that generalize well to unseen domains and in-the-wild conditions remains a challenge with no known best solution. This is mostly due to the difficulty of acquiring ground truth data that cover the…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Evangelos Ververas , Polydefkis Gkagkos , Jiankang Deng , Michail Christos Doukas , Jia Guo , Stefanos Zafeiriou

We explore techniques for eye gaze estimation using machine learning. Eye gaze estimation is a common problem for various behavior analysis and human-computer interfaces. The purpose of this work is to discuss various model types for eye…

Computer Vision and Pattern Recognition · Computer Science 2022-08-01 Aveena Kottwani , Ayush Kumar

Despite decades of research on data collection and model architectures, current gaze estimation models encounter significant challenges in generalizing across diverse data domains. Recent advances in self-supervised pre-training have shown…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Jiawei Qin , Xucong Zhang , Yusuke Sugano

Gaze estimation, which is a method to determine where a person is looking at given the person's full face, is a valuable clue for understanding human intention. Similarly to other domains of computer vision, deep learning (DL) methods have…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Longzhao Huang , Yujie Li , Xu Wang , Haoyu Wang , Ahmed Bouridane , Ahmad Chaddad

Inspired by human visual attention, deep neural networks have widely adopted attention mechanisms to learn locally discriminative attributes for challenging visual classification tasks. However, existing approaches primarily emphasize the…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Jiahang Li , Shibo Xue , Yong Su

Understanding user intent during magnified reading is critical for accessible interface design. Yet magnification collapses visual context and forces continual viewport dragging, producing fragmented, noisy gaze and obscuring reading…

Human-Computer Interaction · Computer Science 2025-09-25 Seongsil Heo , Roberto Manduchi

We propose a novel neural pipeline, MSGazeNet, that learns gaze representations by taking advantage of the eye anatomy information through a multistream framework. Our proposed solution comprises two components, first a network for…

Computer Vision and Pattern Recognition · Computer Science 2024-03-04 Zunayed Mahmud , Paul Hungler , Ali Etemad

Video-based gaze estimation methods aim to capture the inherently temporal dynamics of human eye gaze from multiple image frames. However, since models must capture both spatial and temporal relationships, performance is limited by the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Alexandre Personnic , Mihai Bâce

In recent years, predicting driver's focus of attention has been a very active area of research in the autonomous driving community. Unfortunately, existing state-of-the-art techniques achieve this by relying only on human gaze information,…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Anwesan Pal , Sayan Mondal , Henrik I. Christensen

Human eye gaze estimation is an important cognitive ingredient for successful human-robot interaction, enabling the robot to read and predict human behavior. We approach this problem using artificial neural networks and build a modular…

Computer Vision and Pattern Recognition · Computer Science 2024-03-01 Dmytro Herashchenko , Igor Farkaš

Non-invasive gaze estimation methods usually regress gaze directions directly from a single face or eye image. However, due to important variabilities in eye shapes and inner eye structures amongst individuals, universal models obtain…

Computer Vision and Pattern Recognition · Computer Science 2020-02-07 Gang Liu , Yu Yu , Kenneth A. Funes Mora , Jean-Marc Odobez

Self-supervised learning (SSL) has become prevalent for learning representations in computer vision. Notably, SSL exploits contrastive learning to encourage visual representations to be invariant under various image transformations. The…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Swati Jindal , Roberto Manduchi

Gaze reflects how humans process visual scenes and is therefore increasingly used in computer vision systems. Previous works demonstrated the potential of gaze for object-centric tasks, such as object localization and recognition, but it…

Computer Vision and Pattern Recognition · Computer Science 2016-08-19 Yusuke Sugano , Andreas Bulling

Gaze is the essential manifestation of human attention. In recent years, a series of work has achieved high accuracy in gaze estimation. However, the inter-personal difference limits the reduction of the subject-independent gaze estimation…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Zidong Guo , Zejian Yuan , Chong Zhang , Wanchao Chi , Yonggen Ling , Shenghao Zhang

Personal variations severely limit the performance of appearance-based gaze tracking. Adapting to these variations using standard neural network model adaptation methods is difficult. The problems range from overfitting, due to small…

Computer Vision and Pattern Recognition · Computer Science 2019-09-04 Erik Lindén , Jonas Sjöstrand , Alexandre Proutiere

Real-time object detection in AR/VR systems faces critical computational constraints, requiring sub-10\,ms latency within tight power budgets. Inspired by biological foveal vision, we propose a two-stage pipeline that combines…

Hardware Architecture · Computer Science 2026-03-18 Neeraj Solanki , Hong Ding , Sepehr Tabrizchi , Ali Shafiee Sarvestani , Shaahin Angizi , David Z. Pan , Arman Roohi

Online egocentric gaze estimation predicts where a camera wearer is looking from first-person video using only past and current frames, a task essential for augmented reality and assistive technologies. Unlike third-person gaze estimation,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Jia Li , Wenjie Zhao , Shijian Deng , Bolin Lai , Yuheng Wu , RUijia Chen , Jon E. Froehlich , Yuhang Zhao , Yapeng Tian

When deep neural network (DNN) was first introduced to the medical image analysis community, researchers were impressed by its performance. However, it is evident now that a large number of manually labeled data is often a must to train a…

Image and Video Processing · Electrical Eng. & Systems 2022-05-16 Sheng Wang , Xi Ouyang , Tianming Liu , Qian Wang , Dinggang Shen

Traditional gaze estimation methods typically require explicit user calibration to achieve high accuracy. This process is cumbersome and recalibration is often required when there are changes in factors such as illumination and pose. To…

Computer Vision and Pattern Recognition · Computer Science 2019-10-24 Zhuoqing Chang , Matias Di Martino , Qiang Qiu , Steven Espinosa , Guillermo Sapiro

Automated estimation of the allocation of a driver's visual attention may be a critical component of future Advanced Driver Assistance Systems. In theory, vision-based tracking of the eye can provide a good estimate of gaze location. In…

Computer Vision and Pattern Recognition · Computer Science 2016-03-02 Lex Fridman , Philipp Langhans , Joonbum Lee , Bryan Reimer