English
Related papers

Related papers: Unsupervised Representation Learning for Gaze Esti…

200 papers

The task of predicting 3D eye gaze from eye images can be performed either by (a) end-to-end learning for image-to-gaze mapping or by (b) fitting a 3D eye model onto images. The former case requires 3D gaze labels, while the latter requires…

Computer Vision and Pattern Recognition · Computer Science 2023-11-22 Nikola Popovic , Dimitrios Christodoulou , Danda Pani Paudel , Xi Wang , Luc Van Gool

With the escalated demand of human-machine interfaces for intelligent systems, development of gaze controlled system have become a necessity. Gaze, being the non-intrusive form of human interaction, is one of the best suited approach.…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Somsukla Maiti , Akshansh Gupta

Estimating human gaze from natural eye images only is a challenging task. Gaze direction can be defined by the pupil- and the eyeball center where the latter is unobservable in 2D images. Hence, achieving highly accurate gaze estimates is…

Computer Vision and Pattern Recognition · Computer Science 2018-12-31 Seonwook Park , Adrian Spurr , Otmar Hilliges

Eye gaze that reveals human observational patterns has increasingly been incorporated into solutions for vision tasks. Despite recent explorations on leveraging gaze to aid deep networks, few studies exploit gaze as an efficient annotation…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Yuan Zhong , Chenhui Tang , Yumeng Yang , Ruoxi Qi , Kang Zhou , Yuqi Gong , Pheng Ann Heng , Janet H. Hsiao , Qi Dou

Gaze redirection aims at manipulating the gaze of a given face image with respect to a desired direction (i.e., a reference angle) and it can be applied to many real life scenarios, such as video-conferencing or taking group photos.…

Computer Vision and Pattern Recognition · Computer Science 2020-11-30 Jingjing Chen , Jichao Zhang , Enver Sangineto , Jiayuan Fan , Tao Chen , Nicu Sebe

Unconstrained remote gaze estimation remains challenging mostly due to its vulnerability to the large variability in head-pose. Prior solutions struggle to maintain reliable accuracy in unconstrained remote gaze tracking. Among them,…

Computer Vision and Pattern Recognition · Computer Science 2020-04-09 Zhecan Wang , Jian Zhao , Cheng Lu , Han Huang , Fan Yang , Lianji Li , Yandong Guo

Gaze redirection methods aim to generate realistic human face images with controllable eye movement. However, recent methods often struggle with 3D consistency, efficiency, or quality, limiting their practical applications. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Hengfei Wang , Zhongqun Zhang , Yihua Cheng , Hyung Jin Chang

High-fidelity gaze redirection is critical for generating augmented data to improve the generalization of gaze estimators. 3D Gaussian Splatting (3DGS) models like GazeGaussian represent the state-of-the-art but can struggle with rendering…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Abiram Panchalingam , Indu Bodala , Stuart Middleton

Appearance-based gaze estimation has shown great promise in many applications by using a single general-purpose camera as the input device. However, its success is highly depending on the availability of large-scale well-annotated gaze…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Lingyu Du , Xucong Zhang , Guohao Lan

We consider the problem of user-adaptive 3D gaze estimation. The performance of person-independent gaze estimation is limited due to interpersonal anatomical differences. Our goal is to provide a personalized gaze estimation model…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Yong Wu , Yang Wang , Sanqing Qu , Zhijun Li , Guang Chen

Although the number of gaze estimation datasets is growing, the application of appearance-based gaze estimation methods is mostly limited to estimating the point of gaze on a screen. This is in part because most datasets are generated in a…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Cedric Leblond-Menard , Gabriel Picard-Krashevski , Sofiane Achiche

Accurate 3D gaze estimation in unconstrained real-world environments remains a significant challenge due to variations in appearance, head pose, occlusion, and the limited availability of in-the-wild 3D gaze datasets. To address these…

Computer Vision and Pattern Recognition · Computer Science 2025-02-28 Pierre Vuillecard , Jean-Marc Odobez

Robust gaze estimation is a challenging task, even for deep CNNs, due to the non-availability of large-scale labeled data. Moreover, gaze annotation is a time-consuming process and requires specialized hardware setups. We propose MTGLS: a…

Computer Vision and Pattern Recognition · Computer Science 2021-12-14 Shreya Ghosh , Munawar Hayat , Abhinav Dhall , Jarrod Knibbe

Gaze estimation methods learn eye gaze from facial features. However, among rich information in the facial image, real gaze-relevant features only correspond to subtle changes in eye region, while other gaze-irrelevant features like…

Computer Vision and Pattern Recognition · Computer Science 2021-12-24 Yihua Cheng , Yiwei Bao , Feng Lu

A major challenge for physically unconstrained gaze estimation is acquiring training data with 3D gaze annotations for in-the-wild and outdoor scenarios. In contrast, videos of human interactions in unconstrained environments are abundantly…

Computer Vision and Pattern Recognition · Computer Science 2021-05-21 Rakshit Kothari , Shalini De Mello , Umar Iqbal , Wonmin Byeon , Seonwook Park , Jan Kautz

Although recent gaze estimation methods lay great emphasis on attentively extracting gaze-relevant features from facial or eye images, how to define features that include gaze-relevant components has been ambiguous. This obscurity makes the…

Computer Vision and Pattern Recognition · Computer Science 2022-09-22 Isack Lee , Jun-Seok Yun , Hee Hyeon Kim , Youngju Na , Seok Bong Yoo

Despite the recent development of learning-based gaze estimation methods, most methods require one or more eye or face region crops as inputs and produce a gaze direction vector as output. Cropping results in a higher resolution in the eye…

Computer Vision and Pattern Recognition · Computer Science 2023-05-10 Haldun Balim , Seonwook Park , Xi Wang , Xucong Zhang , Otmar Hilliges

Gaze estimation is a crucial task in computer vision, however, existing methods suffer from high computational costs, which limit their practical deployment in resource-limited environments. In this paper, we propose a novel lightweight…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Tao Xu , Bo Wu , Ruilong Fan , Yun Zhou , Di Huang

Gaze estimation is instrumental in modern virtual reality (VR) systems. Despite significant progress in remote-camera gaze estimation, VR gaze research remains constrained by data scarcity, particularly the lack of large-scale, accurately…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Gil Shapira , Ishay Goldin , Evgeny Artyomov , Donghoon Kim , Yosi Keller , Niv Zehngut

Appearance-based gaze estimation from RGB images provides relatively unconstrained gaze tracking. We have previously proposed a gaze decomposition method that decomposes the gaze angle into the sum of a subject-independent gaze estimate…

Computer Vision and Pattern Recognition · Computer Science 2022-02-15 Zhaokang Chen , Bertram E. Shi