English
Related papers

Related papers: Gaze estimation problem tackled through synthetic …

200 papers

As a critical cue for understanding human intention, human gaze provides a key signal for Human-Computer Interaction(HCI) applications. Appearance-based gaze estimation, which directly regresses the gaze vector from eye images, has made…

Computer Vision and Pattern Recognition · Computer Science 2021-11-24 Shaobo Guo , Xiao Jiang , Zhizhong Su , Rui Wu , Xin Wang

Eye tracking has become increasingly important in virtual and augmented reality applications; however, the current gaze accuracy falls short of meeting the requirements for spatial computing. We designed a gaze collection framework and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Xiaoyin Yang

3D and 2D gaze estimation share the fundamental objective of capturing eye movements but are traditionally treated as two distinct research domains. In this paper, we introduce a novel cross-task few-shot 2D gaze estimation approach, aiming…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Yihua Cheng , Hengfei Wang , Zhongqun Zhang , Yang Yue , Bo Eun Kim , Feng Lu , Hyung Jin Chang

Appearance-based gaze estimation systems have shown great progress recently, yet the performance of these techniques depend on the datasets used for training. Most of the existing gaze estimation datasets setup in interactive settings were…

Computer Vision and Pattern Recognition · Computer Science 2023-02-15 Murthy L. R. D. , Abhishek Mukhopadhyay , Shambhavi Aggarwal , Ketan Anand , Pradipta Biswas

Data-driven depth estimation methods struggle with the generalization outside their training scenes due to the immense variability of the real-world scenes. This problem can be partially addressed by utilising synthetically generated…

Computer Vision and Pattern Recognition · Computer Science 2020-05-20 Maxim Maximov , Kevin Galim , Laura Leal-Taixé

Achieving accurate and reliable gaze predictions in complex and diverse environments remains challenging. Fortunately, it is straightforward to access diverse gaze datasets in real-world applications. We discover that training these…

Computer Vision and Pattern Recognition · Computer Science 2025-01-24 Shijing Wang , Yaping Huang , Jun Xie , Yi Tian , Feng Chen , Zhepeng Wang

Traditional gaze estimation methods typically require explicit user calibration to achieve high accuracy. This process is cumbersome and recalibration is often required when there are changes in factors such as illumination and pose. To…

Computer Vision and Pattern Recognition · Computer Science 2019-10-24 Zhuoqing Chang , Matias Di Martino , Qiang Qiu , Steven Espinosa , Guillermo Sapiro

Gaze correction aims to redirect the person's gaze into the camera by manipulating the eye region, and it can be considered as a specific image resynthesis problem. Gaze correction has a wide range of applications in real life, such as…

Computer Vision and Pattern Recognition · Computer Science 2019-06-04 Jichao Zhang , Meng Sun , Jingjing Chen , Hao Tang , Yan Yan , Xueying Qin , Nicu Sebe

Multiple datasets have been created for training and testing appearance-based gaze estimators. Intuitively, more data should lead to better performance. However, combining datasets to train a single esti-mator rarely improves gaze…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Liang Wu , Bertram E. Shi

Human gaze is a crucial cue used in various applications such as human-robot interaction and virtual reality. Recently, convolution neural network (CNN) approaches have made notable progress in predicting gaze direction. However, estimating…

Computer Vision and Pattern Recognition · Computer Science 2022-03-08 Ahmed A. Abdelrahman , Thorsten Hempel , Aly Khalifa , Ayoub Al-Hamadi

The complex application scenarios have raised critical requirements for precise and generalizable gaze estimation methods. Recently, the pre-trained CLIP has achieved remarkable performance on various vision tasks, but its potentials have…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Lin Zhang , Yi Tian , XiYun Wang , Wanru Xu , Yi Jin , Yaping Huang

We tackle the problem of predicting saliency maps for videos of dynamic scenes. We note that the accuracy of the maps reconstructed from the gaze data of a fixed number of observers varies with the frame, as it depends on the content of the…

Computer Vision and Pattern Recognition · Computer Science 2021-11-23 Ekta Prashnani , Orazio Gallo , Joohwan Kim , Josef Spjut , Pradeep Sen , Iuri Frosio

Gaze following and social gaze prediction are fundamental tasks providing insights into human communication behaviors, intent, and social interactions. Most previous approaches addressed these tasks separately, either by designing highly…

Computer Vision and Pattern Recognition · Computer Science 2024-03-18 Anshul Gupta , Samy Tafasca , Arya Farkhondeh , Pierre Vuillecard , Jean-Marc Odobez

Indoor scene understanding is central to applications such as robot navigation and human companion assistance. Over the last years, data-driven deep neural networks have outperformed many traditional approaches thanks to their…

Computer Vision and Pattern Recognition · Computer Science 2017-07-04 Yinda Zhang , Shuran Song , Ersin Yumer , Manolis Savva , Joon-Young Lee , Hailin Jin , Thomas Funkhouser

Appearance-based gaze estimation (AGE) has achieved remarkable performance in constrained settings, yet we reveal a significant generalization gap where existing AGE models often fail in practical, unconstrained scenarios, particularly…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Zhenhao Li , Zheng Liu , Seunghyun Lee , Amin Fadaeinejad , Yuanhao Yu

Recent studies on appearance based gaze estimation indicate the ability of Neural Networks to decode gaze information from facial images encompassing pose information. In this paper, we propose Gaze-Net: A capsule network capable of…

Computer Vision and Pattern Recognition · Computer Science 2020-04-17 Bhanuka Mahanama , Yasith Jayawardana , Sampath Jayarathna

We address the problem of gaze target estimation, which aims to predict where a person is looking in a scene. Predicting a person's gaze target requires reasoning both about the person's appearance and the contents of the scene. Prior works…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Fiona Ryan , Ajay Bati , Sangmin Lee , Daniel Bolya , Judy Hoffman , James M. Rehg

We propose a novel 3D gaze estimation approach that learns spatial relationships between the subject and objects in the scene, and outputs 3D gaze direction. Our method targets unconstrained settings, including cases where close-up views of…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Yuki Kawana , Shintaro Shiba , Quan Kong , Norimasa Kobori

This paper proposes a statistical approach to 2D pose estimation from human images. The main problems with the standard supervised approach, which is based on a deep recognition (image-to-pose) model, are that it often yields anatomically…

Computer Vision and Pattern Recognition · Computer Science 2020-04-09 Takayuki Nakatsuka , Kazuyoshi Yoshii , Yuki Koyama , Satoru Fukayama , Masataka Goto , Shigeo Morishima

We present a novel, web-based visual eye-tracking analytics tool called Gazealytics. Our open-source toolkit features a unified combination of gaze analytics features that support flexible exploratory analysis, along with annotation of…