English
Related papers

Related papers: GazeShift: Unsupervised Gaze Estimation and Datase…

200 papers

Estimating eye-gaze from images alone is a challenging task, in large parts due to un-observable person-specific factors. Achieving high accuracy typically requires labeled data from test users which may not be attainable in real…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Seonwook Park , Emre Aksan , Xucong Zhang , Otmar Hilliges

Online egocentric gaze estimation predicts where a camera wearer is looking from first-person video using only past and current frames, a task essential for augmented reality and assistive technologies. Unlike third-person gaze estimation,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Jia Li , Wenjie Zhao , Shijian Deng , Bolin Lai , Yuheng Wu , RUijia Chen , Jon E. Froehlich , Yuhang Zhao , Yapeng Tian

Gaze is an essential prompt for analyzing human behavior and attention. Recently, there has been an increasing interest in determining gaze direction from facial videos. However, video gaze estimation faces significant challenges, such as…

Computer Vision and Pattern Recognition · Computer Science 2024-04-11 Swati Jindal , Mohit Yadav , Roberto Manduchi

Appearance-based gaze estimation systems have shown great progress recently, yet the performance of these techniques depend on the datasets used for training. Most of the existing gaze estimation datasets setup in interactive settings were…

Computer Vision and Pattern Recognition · Computer Science 2023-02-15 Murthy L. R. D. , Abhishek Mukhopadhyay , Shambhavi Aggarwal , Ketan Anand , Pradipta Biswas

Driver's eye gaze holds a wealth of cognitive and intentional cues crucial for intelligent vehicles. Despite its significance, research on in-vehicle gaze estimation remains limited due to the scarcity of comprehensive and well-annotated…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Yihua Cheng , Yaning Zhu , Zongji Wang , Hongquan Hao , Yongwei Liu , Shiqing Cheng , Xi Wang , Hyung Jin Chang

Accurate 3D gaze estimation in unconstrained real-world environments remains a significant challenge due to variations in appearance, head pose, occlusion, and the limited availability of in-the-wild 3D gaze datasets. To address these…

Computer Vision and Pattern Recognition · Computer Science 2025-02-28 Pierre Vuillecard , Jean-Marc Odobez

Gaze estimation is of great importance to many scientific fields and daily applications, ranging from fundamental research in cognitive psychology to attention-aware mobile systems. While recent advancements in deep learning have yielded…

Computer Vision and Pattern Recognition · Computer Science 2022-09-15 Lingyu Du , Guohao Lan

Despite decades of research on data collection and model architectures, current gaze estimation models encounter significant challenges in generalizing across diverse data domains. Recent advances in self-supervised pre-training have shown…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Jiawei Qin , Xucong Zhang , Yusuke Sugano

We address the challenge of unsupervised mistake detection in egocentric video of skilled human activities through the analysis of gaze signals. While traditional methods rely on manually labeled mistakes, our approach does not require…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 Michele Mazzamuto , Antonino Furnari , Yoichi Sato , Giovanni Maria Farinella

Human gaze provides valuable information on human focus and intentions, making it a crucial area of research. Recently, deep learning has revolutionized appearance-based gaze estimation. However, due to the unique features of gaze…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Yihua Cheng , Haofei Wang , Yiwei Bao , Feng Lu

Although automatic gaze estimation is very important to a large variety of application areas, it is difficult to train accurate and robust gaze models, in great part due to the difficulty in collecting large and diverse data (annotating 3D…

Computer Vision and Pattern Recognition · Computer Science 2020-04-06 Yu Yu , Jean-Marc Odobez

A major challenge for physically unconstrained gaze estimation is acquiring training data with 3D gaze annotations for in-the-wild and outdoor scenarios. In contrast, videos of human interactions in unconstrained environments are abundantly…

Computer Vision and Pattern Recognition · Computer Science 2021-05-21 Rakshit Kothari , Shalini De Mello , Umar Iqbal , Wonmin Byeon , Seonwook Park , Jan Kautz

This paper performs the crucial work of establishing a baseline for gaze-driven authentication performance to begin answering fundamental research questions using a very large dataset of gaze recordings from 9202 people with a level of eye…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Dillon Lohr , Michael J. Proulx , Oleg Komogortsev

We study gaze estimation on tablets, our key design goal is uncalibrated gaze estimation using the front-facing camera during natural use of tablets, where the posture and method of holding the tablet is not constrained. We collected the…

Computer Vision and Pattern Recognition · Computer Science 2016-07-19 Qiong Huang , Ashok Veeraraghavan , Ashutosh Sabharwal

With the escalated demand of human-machine interfaces for intelligent systems, development of gaze controlled system have become a necessity. Gaze, being the non-intrusive form of human interaction, is one of the best suited approach.…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Somsukla Maiti , Akshansh Gupta

Medical eye-tracking data is an important information source for understanding how radiologists visually interpret medical images. This information not only improves the accuracy of deep learning models for X-ray analysis but also their…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Trong Thang Pham , Tien-Phat Nguyen , Yuki Ikebe , Akash Awasthi , Zhigang Deng , Carol C. Wu , Hien Nguyen , Ngan Le

Gaze redirection methods aim to generate realistic human face images with controllable eye movement. However, recent methods often struggle with 3D consistency, efficiency, or quality, limiting their practical applications. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Hengfei Wang , Zhongqun Zhang , Yihua Cheng , Hyung Jin Chang

Inter-personal anatomical differences limit the accuracy of person-independent gaze estimation networks. Yet there is a need to lower gaze errors further to enable applications requiring higher quality. Further gains can be achieved by…

Computer Vision and Pattern Recognition · Computer Science 2019-10-15 Seonwook Park , Shalini De Mello , Pavlo Molchanov , Umar Iqbal , Otmar Hilliges , Jan Kautz

We introduce GazeD, a new 3D gaze estimation method that jointly provides 3D gaze and human pose from a single RGB image. Leveraging the ability of diffusion models to deal with uncertainty, it generates multiple plausible 3D gaze and pose…

Computer Vision and Pattern Recognition · Computer Science 2026-01-26 Riccardo Catalini , Davide Di Nucci , Guido Borghi , Davide Davoli , Lorenzo Garattoni , Gianpiero Francesca , Yuki Kawana , Roberto Vezzani

Eye gaze estimation and simultaneous semantic understanding of a user through eye images is a crucial component in Virtual and Mixed Reality; enabling energy efficient rendering, multi-focal displays and effective interaction with 3D…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Zhengyang Wu , Srivignesh Rajendran , Tarrence van As , Joelle Zimmermann , Vijay Badrinarayanan , Andrew Rabinovich