English
Related papers

Related papers: PCFGaze: Physics-Consistent Feature for Appearance…

200 papers

Gaze estimation methods commonly use facial appearances to predict the direction of a person gaze. However, previous studies show three major challenges with convolutional neural network (CNN)-based, transformer-based, and contrastive…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 Xinyuan Zhao , Yihang Wu , Ahmad Chaddad , Sarah A. Alkhodair , Reem Kateb

Predicting gaze behavior in virtual reality environments remains a significant challenge with implications for rendering optimization and interface design. This paper introduces a multimodal approach to VR gaze prediction that combines…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Farhaan Ebadulla , Chiraag Mudlpaur , Shreya Chaurasia , Gaurav BV

Despite recent advances in appearance-based gaze estimation techniques, the need for training data that covers the target head pose and gaze distribution remains a crucial challenge for practical deployment. This work examines a novel…

Computer Vision and Pattern Recognition · Computer Science 2022-04-28 Jiawei Qin , Takuru Shimoyama , Yusuke Sugano

Predicting human gaze behavior within computer vision is integral for developing interactive systems that can anticipate user attention, address fundamental questions in cognitive science, and hold implications for fields like…

Image and Video Processing · Electrical Eng. & Systems 2024-07-02 Akash Awasthi , Ngan Le , Zhigang Deng , Rishi Agrawal , Carol C. Wu , Hien Van Nguyen

Multiple datasets have been created for training and testing appearance-based gaze estimators. Intuitively, more data should lead to better performance. However, combining datasets to train a single esti-mator rarely improves gaze…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Liang Wu , Bertram E. Shi

Analyzing the gaze accuracy characteristics of an eye tracker is a critical task as its gaze data is frequently affected by non-ideal operating conditions in various consumer eye tracking applications. In this study, gaze error patterns…

Signal Processing · Electrical Eng. & Systems 2020-05-11 Anuradha Kar

A driver's gaze is critical for determining their attention, state, situational awareness, and readiness to take over control from partially automated vehicles. Estimating the gaze direction is the most obvious way to gauge a driver's state…

Computer Vision and Pattern Recognition · Computer Science 2021-06-17 Akshay Rangesh , Bowen Zhang , Mohan M. Trivedi

This paper addresses the challenging problem of estimating the general visual attention of people in images. Our proposed method is designed to work across multiple naturalistic social scenarios and provides a full picture of the subject's…

Computer Vision and Pattern Recognition · Computer Science 2018-07-30 Eunji Chong , Nataniel Ruiz , Yongxin Wang , Yun Zhang , Agata Rozga , James Rehg

Protein function is executed at the molecular surface, where shape and chemistry act together to govern interaction. Yet most comparison methods treat these aspects separately, privileging either global fold or local descriptors and missing…

Biomolecules · Quantitative Biology 2026-03-11 Himanshu Swami , John M. McBride , Jean-Pierre Eckmann , Tsvi Tlusty

Gaze following aims to predict where a person is looking in a scene, by predicting the target location, or indicating that the target is located outside the image. Recent works detect the gaze target by training a heatmap regression task…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Qiaomu Miao , Minh Hoai , Dimitris Samaras

Enabling robots to understand human gaze target is a crucial step to allow capabilities in downstream tasks, for example, attention estimation and movement anticipation in real-world human-robot interactions. Prior works have addressed the…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Zhuangzhuang Dai , Vincent Gbouna Zakka , Luis J. Manso , Chen Li

In this paper, we evaluate a synthetic framework to be used in the field of gaze estimation employing deep learning techniques. The lack of sufficient annotated data could be overcome by the utilization of a synthetic evaluation framework…

Computer Vision and Pattern Recognition · Computer Science 2020-06-15 Gonzalo Garde , Andoni Larumbe-Bergera , Benoît Bossavit , Rafael Cabeza , Sonia Porta , Arantxa Villanueva

Eye gaze is an important non-verbal cue for human affect analysis. Recent gaze estimation work indicated that information from the full face region can benefit performance. Pushing this idea further, we propose an appearance-based method…

Computer Vision and Pattern Recognition · Computer Science 2023-05-17 Xucong Zhang , Yusuke Sugano , Mario Fritz , Andreas Bulling

Appearance-based gaze estimation has been actively studied in recent years. However, its generalization performance for unseen head poses is still a significant limitation for existing methods. This work proposes a generalizable multi-view…

Computer Vision and Pattern Recognition · Computer Science 2023-11-16 Yoichiro Hisadome , Tianyi Wu , Jiawei Qin , Yusuke Sugano

Appearance-based gaze estimation methods that only require an off-the-shelf camera have significantly improved but they are still not yet widely used in the human-computer interaction (HCI) community. This is partly because it remains…

Human-Computer Interaction · Computer Science 2019-01-31 Xucong Zhang , Yusuke Sugano , Andreas Bulling

Efficiency and ease of use are essential for practical applications of camera based eye/gaze-tracking. Gaze tracking involves estimating where a person is looking on a screen based on face images from a computer-facing camera. In this paper…

Computer Vision and Pattern Recognition · Computer Science 2020-09-04 Amogh Gudi , Xin Li , Jan van Gemert

Gaze object prediction is a newly proposed task that aims to discover the objects being stared at by humans. It is of great application significance but still lacks a unified solution framework. An intuitive solution is to incorporate an…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Binglu Wang , Tao Hu , Baoshan Li , Xiaojuan Chen , Zhijie Zhang

We present a new and accurate approach for gaze estimation on consumer computing devices. We take advantage of continued strides in the quality of user-facing cameras found in e.g., smartphones, laptops, and desktops - 4K or greater in…

Human-Computer Interaction · Computer Science 2026-03-23 Taejun Kim , Vimal Mollyn , Riku Arakawa , Chris Harrison

Recent studies on appearance based gaze estimation indicate the ability of Neural Networks to decode gaze information from facial images encompassing pose information. In this paper, we propose Gaze-Net: A capsule network capable of…

Computer Vision and Pattern Recognition · Computer Science 2020-04-17 Bhanuka Mahanama , Yasith Jayawardana , Sampath Jayarathna

A major challenge for physically unconstrained gaze estimation is acquiring training data with 3D gaze annotations for in-the-wild and outdoor scenarios. In contrast, videos of human interactions in unconstrained environments are abundantly…

Computer Vision and Pattern Recognition · Computer Science 2021-05-21 Rakshit Kothari , Shalini De Mello , Umar Iqbal , Wonmin Byeon , Seonwook Park , Jan Kautz