English
Related papers

Related papers: Gaze-LLE: Gaze Target Estimation via Large-Scale L…

200 papers

Although gaze estimation methods have been developed with deep learning techniques, there has been no such approach as aim to attain accurate performance in low-resolution face images with a pixel width of 50 pixels or less. To solve a…

Computer Vision and Pattern Recognition · Computer Science 2022-09-22 Jun-Seok Yun , Youngju Na , Hee Hyeon Kim , Hyung-Il Kim , Seok Bong Yoo

Human gaze is a crucial cue used in various applications such as human-robot interaction and virtual reality. Recently, convolution neural network (CNN) approaches have made notable progress in predicting gaze direction. However, estimating…

Computer Vision and Pattern Recognition · Computer Science 2022-03-08 Ahmed A. Abdelrahman , Thorsten Hempel , Aly Khalifa , Ayoub Al-Hamadi

Inter-personal anatomical differences limit the accuracy of person-independent gaze estimation networks. Yet there is a need to lower gaze errors further to enable applications requiring higher quality. Further gains can be achieved by…

Computer Vision and Pattern Recognition · Computer Science 2019-10-15 Seonwook Park , Shalini De Mello , Pavlo Molchanov , Umar Iqbal , Otmar Hilliges , Jan Kautz

Despite the recent development of learning-based gaze estimation methods, most methods require one or more eye or face region crops as inputs and produce a gaze direction vector as output. Cropping results in a higher resolution in the eye…

Computer Vision and Pattern Recognition · Computer Science 2023-05-10 Haldun Balim , Seonwook Park , Xi Wang , Xucong Zhang , Otmar Hilliges

Non-invasive gaze estimation methods usually regress gaze directions directly from a single face or eye image. However, due to important variabilities in eye shapes and inner eye structures amongst individuals, universal models obtain…

Computer Vision and Pattern Recognition · Computer Science 2020-02-07 Gang Liu , Yu Yu , Kenneth A. Funes Mora , Jean-Marc Odobez

Eye-tracking applications that utilize the human gaze in video understanding tasks have become increasingly important. To effectively automate the process of video analysis based on eye-tracking data, it is important to accurately replicate…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Suleyman Ozdel , Yao Rong , Berat Mert Albaba , Yen-Ling Kuo , Xi Wang , Enkelejda Kasneci

Precisely detecting which object a person is paying attention to is critical for human-robot interaction since it provides important cues for the next action from the human user. We propose an end-to-end approach for gaze target detection:…

Computer Vision and Pattern Recognition · Computer Science 2025-02-06 Zhi-Yi Lin , Jouh Yeong Chew , Jan van Gemert , Xucong Zhang

Gaze estimation involves predicting where the person is looking at within an image or video. Technically, the gaze information can be inferred from two different magnification levels: face orientation and eye orientation. The inference is…

Computer Vision and Pattern Recognition · Computer Science 2021-10-27 Ashesh , Chu-Song Chen , Hsuan-Tien Lin

Automatic eye gaze estimation is an important problem in vision based assistive technology with use cases in different emerging topics such as augmented reality, virtual reality and human-computer interaction. Over the past few years, there…

Computer Vision and Pattern Recognition · Computer Science 2022-08-08 Neeru Dubey , Shreya Ghosh , Abhinav Dhall

Human gaze provides essential cues for interpreting attention, intention, and social interaction in visual scenes, yet gaze understanding remains largely unexplored in current vision-language models (VLMs). While recent VLMs achieve strong…

Computer Vision and Pattern Recognition · Computer Science 2025-12-25 Shijing Wang , Chaoqun Cui , Yaping Huang , Hyung Jin Chang , Yihua Cheng

We present a real-time gaze tracking system that directly acquires task-relevant latent features using a fully passive optical encoder. Instead of forming and processing full-resolution images, our approach leverages a microlens array with…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Yidan Zheng , Matheus Souza , Kaizhang Kang , Qiang Fu , Hadi Amata , Wolfgang Heidrich

Gaze is an essential prompt for analyzing human behavior and attention. Recently, there has been an increasing interest in determining gaze direction from facial videos. However, video gaze estimation faces significant challenges, such as…

Computer Vision and Pattern Recognition · Computer Science 2024-04-11 Swati Jindal , Mohit Yadav , Roberto Manduchi

Gaze estimation, which predicts gaze direction, commonly faces the challenge of interference from complex gaze-irrelevant information in face images. In this work, we propose DMAGaze, a novel gaze estimation framework that exploits…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Haohan Chen , Hongjia Liu , Shiyong Lan , Wenwu Wang , Yixin Qiao , Yao Li , Guonan Deng

Gaze following aims to interpret human-scene interactions by predicting the person's focal point of gaze. Prevailing approaches often adopt a two-stage framework, whereby multi-modality information is extracted in the initial stage for gaze…

Computer Vision and Pattern Recognition · Computer Science 2024-11-15 Yuehao Song , Xinggang Wang , Jingfeng Yao , Wenyu Liu , Jinglin Zhang , Xiangmin Xu

Despite decades of research on data collection and model architectures, current gaze estimation models encounter significant challenges in generalizing across diverse data domains. Recent advances in self-supervised pre-training have shown…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Jiawei Qin , Xucong Zhang , Yusuke Sugano

Vision-language models (VLMs) have rapidly evolved into general-purpose multimodal reasoners with strong zero-shot generalization. In this context, VLMs could greatly benefit the analysis of human gaze and attention, a central task in human…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Hengfei Wang , Anshul Gupta , Pierre Vuillecard , Jean-Marc Odobez

Appearance-based gaze estimation aims to predict the 3D eye gaze direction from a single image. While recent deep learning-based approaches have demonstrated excellent performance, they usually assume one calibrated face in each input image…

Computer Vision and Pattern Recognition · Computer Science 2022-04-21 Mingfang Zhang , Yunfei Liu , Feng Lu

The ability of gaze estimation models to generalize is often significantly hindered by various factors unrelated to gaze, especially when the training dataset is limited. Current strategies aim to address this challenge through different…

Computer Vision and Pattern Recognition · Computer Science 2024-11-14 Pengwei Yin , Jingjing Wang , Guanzhong Zeng , Di Xie , Jiang Zhu

Following the gaze of people inside videos is an important signal for understanding people and their actions. In this paper, we present an approach for following gaze across views by predicting where a particular person is looking…

Computer Vision and Pattern Recognition · Computer Science 2016-12-12 Adrià Recasens , Carl Vondrick , Aditya Khosla , Antonio Torralba

Gaze estimation is a fundamental task in many applications of computer vision, human computer interaction and robotics. Many state-of-the-art methods are trained and tested on custom datasets, making comparison across methods challenging.…

Computer Vision and Pattern Recognition · Computer Science 2020-08-03 Xucong Zhang , Seonwook Park , Thabo Beeler , Derek Bradley , Siyu Tang , Otmar Hilliges