English
Related papers

Related papers: End-to-end Video Gaze Estimation via Capturing Hea…

200 papers

Enabling robots to understand human gaze target is a crucial step to allow capabilities in downstream tasks, for example, attention estimation and movement anticipation in real-world human-robot interactions. Prior works have addressed the…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Zhuangzhuang Dai , Vincent Gbouna Zakka , Luis J. Manso , Chen Li

State-of-the-art appearance-based gaze estimation methods, usually based on deep learning techniques, mainly rely on static features. However, temporal trace of eye gaze contains useful information for estimating a given gaze point. For…

Computer Vision and Pattern Recognition · Computer Science 2020-05-26 Cristina Palmero , Oleg V. Komogortsev , Sachin S. Talathi

Robust gaze estimation is a challenging task, even for deep CNNs, due to the non-availability of large-scale labeled data. Moreover, gaze annotation is a time-consuming process and requires specialized hardware setups. We propose MTGLS: a…

Computer Vision and Pattern Recognition · Computer Science 2021-12-14 Shreya Ghosh , Munawar Hayat , Abhinav Dhall , Jarrod Knibbe

In this work, we address two coupled tasks of gaze prediction and action recognition in egocentric videos by exploring their mutual context. Our assumption is that in the procedure of performing a manipulation task, what a person is doing…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Yifei Huang , Zhenqiang Li , Minjie Cai , Yoichi Sato

Despite the recent development of learning-based gaze estimation methods, most methods require one or more eye or face region crops as inputs and produce a gaze direction vector as output. Cropping results in a higher resolution in the eye…

Computer Vision and Pattern Recognition · Computer Science 2023-05-10 Haldun Balim , Seonwook Park , Xi Wang , Xucong Zhang , Otmar Hilliges

Gaze estimation involves predicting where the person is looking at within an image or video. Technically, the gaze information can be inferred from two different magnification levels: face orientation and eye orientation. The inference is…

Computer Vision and Pattern Recognition · Computer Science 2021-10-27 Ashesh , Chu-Song Chen , Hsuan-Tien Lin

Predicting gaze behavior in virtual reality environments remains a significant challenge with implications for rendering optimization and interface design. This paper introduces a multimodal approach to VR gaze prediction that combines…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Farhaan Ebadulla , Chiraag Mudlpaur , Shreya Chaurasia , Gaurav BV

This paper addresses the challenging problem of estimating the general visual attention of people in images. Our proposed method is designed to work across multiple naturalistic social scenarios and provides a full picture of the subject's…

Computer Vision and Pattern Recognition · Computer Science 2018-07-30 Eunji Chong , Nataniel Ruiz , Yongxin Wang , Yun Zhang , Agata Rozga , James Rehg

In this paper a review is presented of the research on eye gaze estimation techniques and applications, that has progressed in diverse ways over the past two decades. Several generic eye gaze use-cases are identified: desktop, TV,…

Human-Computer Interaction · Computer Science 2017-08-08 Anuradha Kar , Peter Corcoran

Gaze estimation methods estimate gaze from facial appearance with a single camera. However, due to the limited view of a single camera, the captured facial appearance cannot provide complete facial information and thus complicate the gaze…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Yihua Cheng , Feng Lu

Human gaze provides valuable information on human focus and intentions, making it a crucial area of research. Recently, deep learning has revolutionized appearance-based gaze estimation. However, due to the unique features of gaze…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Yihua Cheng , Haofei Wang , Yiwei Bao , Feng Lu

Eye gaze estimation has become increasingly significant in computer vision.In this paper,we systematically study the mainstream of eye gaze estimation methods,propose a novel methodology to estimate eye gaze points and eye gaze directions…

Computer Vision and Pattern Recognition · Computer Science 2021-01-19 Yong Huang , Ben Chen , Daiming Qu

We present GazeOnce360, a novel end-to-end model for multi-person gaze estimation from a single tabletop-mounted upward-facing fisheye camera. Unlike conventional approaches that rely on forward-facing cameras in constrained viewpoints, we…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Zhuojiang Cai , Zhenghui Sun , Feng Lu

Recent studies on appearance based gaze estimation indicate the ability of Neural Networks to decode gaze information from facial images encompassing pose information. In this paper, we propose Gaze-Net: A capsule network capable of…

Computer Vision and Pattern Recognition · Computer Science 2020-04-17 Bhanuka Mahanama , Yasith Jayawardana , Sampath Jayarathna

Emotion recognition,as a step toward mind reading,seeks to infer internal states from external cues.Most existing methods rely on explicit signals-such as facial expressions,speech,or gestures-that reflect only bodily responses and overlook…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Mengke Song , Yuge Xie , Qi Cui , Luming Li , Xinyu Liu , Guotao Wang , Chenglizhao Chen , Shanchen Pang

Gaze following aims to interpret human-scene interactions by predicting the person's focal point of gaze. Prevailing approaches often adopt a two-stage framework, whereby multi-modality information is extracted in the initial stage for gaze…

Computer Vision and Pattern Recognition · Computer Science 2024-11-15 Yuehao Song , Xinggang Wang , Jingfeng Yao , Wenyu Liu , Jinglin Zhang , Xiangmin Xu

The complex application scenarios have raised critical requirements for precise and generalizable gaze estimation methods. Recently, the pre-trained CLIP has achieved remarkable performance on various vision tasks, but its potentials have…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Lin Zhang , Yi Tian , XiYun Wang , Wanru Xu , Yi Jin , Yaping Huang

Gaze behavior is an important non-verbal cue in social signal processing and human-computer interaction. In this paper, we tackle the problem of person- and head pose-independent 3D gaze estimation from remote cameras, using a multi-modal…

Computer Vision and Pattern Recognition · Computer Science 2018-09-18 Cristina Palmero , Javier Selva , Mohammad Ali Bagheri , Sergio Escalera

Gaze estimation is a fundamental task in many applications of computer vision, human computer interaction and robotics. Many state-of-the-art methods are trained and tested on custom datasets, making comparison across methods challenging.…

Computer Vision and Pattern Recognition · Computer Science 2020-08-03 Xucong Zhang , Seonwook Park , Thabo Beeler , Derek Bradley , Siyu Tang , Otmar Hilliges

Gaze estimation is pivotal in human scene comprehension tasks, particularly in medical diagnostic analysis. Eye-tracking technology facilitates the recording of physicians' ocular movements during image interpretation, thereby elucidating…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Shaonan Liu , Wenting Chen , Jie Liu , Xiaoling Luo , Linlin Shen