English
Related papers

Related papers: Towards Pixel-Level Prediction for Gaze Following:…

200 papers

Predicting gaze behavior in virtual reality environments remains a significant challenge with implications for rendering optimization and interface design. This paper introduces a multimodal approach to VR gaze prediction that combines…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Farhaan Ebadulla , Chiraag Mudlpaur , Shreya Chaurasia , Gaurav BV

Determining the direction in which a person is looking is an important problem in a wide range of HCI applications. In this paper we describe a highly accurate algorithm that performs gaze estimation using an affordable and widely available…

Computer Vision and Pattern Recognition · Computer Science 2016-04-07 Reza Shoja Ghiass , Ognjen Arandjelovic

Gaze reflects how humans process visual scenes and is therefore increasingly used in computer vision systems. Previous works demonstrated the potential of gaze for object-centric tasks, such as object localization and recognition, but it…

Computer Vision and Pattern Recognition · Computer Science 2016-08-19 Yusuke Sugano , Andreas Bulling

From scientific research to commercial applications, eye tracking is an important tool across many domains. Despite its range of applications, eye tracking has yet to become a pervasive technology. We believe that we can put the power of…

Computer Vision and Pattern Recognition · Computer Science 2016-06-21 Kyle Krafka , Aditya Khosla , Petr Kellnhofer , Harini Kannan , Suchendra Bhandarkar , Wojciech Matusik , Antonio Torralba

This paper addresses the gaze target detection problem in single images captured from the third-person perspective. We present a multimodal deep architecture to infer where a person in a scene is looking. This spatial model is trained on…

Computer Vision and Pattern Recognition · Computer Science 2022-08-24 Francesco Tonini , Cigdem Beyan , Elisa Ricci

A user's eyes provide means for Human Computer Interaction (HCI) research as an important modal. The time to time scientific explorations of the eye has already seen an upsurge of the benefits in HCI applications from gaze estimation to the…

Computer Vision and Pattern Recognition · Computer Science 2021-06-10 Atul Sahay , Imon Mukherjee , Kavi Arya

Eye-tracking has potential to provide rich behavioral data about human cognition in ecologically valid environments. However, analyzing this rich data is often challenging. Most automated analyses are specific to simplistic artificial…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Karan Uppal , Jaeah Kim , Shashank Singh

Effective assisted living environments must be able to perform inferences on how their occupants interact with one another as well as with surrounding objects. To accomplish this goal using a vision-based automated approach, multiple tasks…

Computer Vision and Pattern Recognition · Computer Science 2019-09-23 Philipe A. Dias , Damiano Malafronte , Henry Medeiros , Francesca Odone

Despite the recent development of learning-based gaze estimation methods, most methods require one or more eye or face region crops as inputs and produce a gaze direction vector as output. Cropping results in a higher resolution in the eye…

Computer Vision and Pattern Recognition · Computer Science 2023-05-10 Haldun Balim , Seonwook Park , Xi Wang , Xucong Zhang , Otmar Hilliges

Over the past few years, there has been an increasing interest to interpret gaze direction in an unconstrained environment with limited supervision. Owing to data curation and annotation issues, replicating gaze estimation method to other…

Computer Vision and Pattern Recognition · Computer Science 2022-08-15 Shreya Ghosh , Abhinav Dhall , Jarrod Knibbe , Munawar Hayat

Gaze tracking is an essential component of next generation displays for virtual reality and augmented reality applications. Traditional camera-based gaze trackers used in next generation displays are known to be lacking in one or multiple…

Systems and Control · Electrical Eng. & Systems 2021-02-03 Richard Li , Eric Whitmire , Michael Stengel , Ben Boudaoud , Jan Kautz , David Luebke , Shwetak Patel , Kaan Akşit

Active perception and foveal vision are the foundations of the human visual system. While foveal vision reduces the amount of information to process during a gaze fixation, active perception will change the gaze direction to the most…

Computer Vision and Pattern Recognition · Computer Science 2022-08-25 Alexandre M. F. Dias , Luís Simões , Plinio Moreno , Alexandre Bernardino

Gaze estimation, the task of predicting where an individual is looking, is a critical task with direct applications in areas such as human-computer interaction and virtual reality. Estimating the direction of looking in unconstrained…

Computer Vision and Pattern Recognition · Computer Science 2024-02-14 Andy Cătrună , Adrian Cosma , Emilian Rădoi

Eye movements play a vital role in perceiving the world. Eye gaze can give a direct indication of the users point of attention, which can be useful in improving human-computer interaction. Gaze estimation in a non-intrusive manner can make…

Computer Vision and Pattern Recognition · Computer Science 2019-07-11 Anjith George

This study introduced a novel system, called Gaze2Segment, integrating biological and computer vision techniques to support radiologists' reading experience with an automatic image segmentation task. During diagnostic assessment of lung CT…

Visual gaze estimation, with its wide-ranging application scenarios, has garnered increasing attention within the research community. Although existing approaches infer gaze solely from image signals, recent advances in visual-language…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Jun Wang , Hao Ruan , Liangjian Wen , Yong Dai , Mingjie Wang

Purpose: Gaze-following, the task of inferring where individuals are looking, has been widely studied in computer vision, advancing research in visual attention modeling, social scene understanding, and human-robot interaction. However,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Keqi Chen , Séraphin Baributsa , Lilien Schewski , Vinkle Srivastav , Didier Mutter , Guido Beldi , Sandra Keller , Nicolas Padoy

Introduction: In the realm of human-computer interaction and behavioral research, accurate real-time gaze estimation is critical. Traditional methods often rely on expensive equipment or large datasets, which are impractical in many…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Esther Enhui Ye , John Enzhou Ye , Joseph Ye , Jacob Ye , Runzhou Ye

Vision-language models (VLMs) have rapidly evolved into general-purpose multimodal reasoners with strong zero-shot generalization. In this context, VLMs could greatly benefit the analysis of human gaze and attention, a central task in human…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Hengfei Wang , Anshul Gupta , Pierre Vuillecard , Jean-Marc Odobez

Automatic eye gaze estimation is an important problem in vision based assistive technology with use cases in different emerging topics such as augmented reality, virtual reality and human-computer interaction. Over the past few years, there…

Computer Vision and Pattern Recognition · Computer Science 2022-08-08 Neeru Dubey , Shreya Ghosh , Abhinav Dhall