English
Related papers

Related papers: TimeGazer: Temporal Modeling of Predictive Gaze St…

200 papers

Gaze estimation, the task of predicting where an individual is looking, is a critical task with direct applications in areas such as human-computer interaction and virtual reality. Estimating the direction of looking in unconstrained…

Computer Vision and Pattern Recognition · Computer Science 2024-02-14 Andy Cătrună , Adrian Cosma , Emilian Rădoi

Gaze estimation is a fundamental task in many applications of computer vision, human computer interaction and robotics. Many state-of-the-art methods are trained and tested on custom datasets, making comparison across methods challenging.…

Computer Vision and Pattern Recognition · Computer Science 2020-08-03 Xucong Zhang , Seonwook Park , Thabo Beeler , Derek Bradley , Siyu Tang , Otmar Hilliges

This paper digs deeper into factors that influence egocentric gaze. Instead of training deep models for this purpose in a blind manner, we propose to inspect factors that contribute to gaze guidance during daily tasks. Bottom-up saliency…

Computer Vision and Pattern Recognition · Computer Science 2019-04-15 Hamed R. Tavakoli , Esa Rahtu , Juho Kannala , Ali Borji

The visual focus of attention (VFOA) has been recognized as a prominent conversational cue. We are interested in estimating and tracking the VFOAs associated with multi-party social interactions. We note that in this type of situations the…

Computer Vision and Pattern Recognition · Computer Science 2018-12-21 Benoît Massé , Silèye Ba , Radu Horaud

While zero-shot appearance-based 3D gaze estimation offers significant cost-efficiency by directly mapping RGB images to gaze vectors, its reliability in Human-Robot Interaction (HRI) settings remains uncertain. Existing benchmarks…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Berk Sezer , Ali Görkem Küçük , Erol Şahin , Sinan Kalkan

Conventional mobile eye-tracking maps gaze to static screen coordinates, failing to capture user attention when content is dynamic. As users pinch, zoom, and rotate images, static coordinates lose their semantic meaning relative to the…

Human-Computer Interaction · Computer Science 2026-04-20 Yaxiong Lei , Rishab Talwar , Shijing He , Xinya Gong , Yuheng Wang , Xudong Cai , Zhongliang Guo , Juan Ye

Gaze stabilization is fundamental for humanoid robots. By stabilizing vision, it enhances perception of the environment and keeps points of interest in the field of view. In this contribution, a multimodal gaze stabilization combining…

Robotics · Computer Science 2017-03-02 Timothee Habra , Markus Grotz , David Sippel , Tamim Asfour , Renaud Ronsse

We present the first data-driven approach to model temporal gaze-head coordination from large-scale in-the-wild facial videos. To obtain training data for generalizable learning, we propose an automatic pipeline that extracts natural yet…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Xiaohan Liu , Yilin Wen , Yusuke Sugano

Precise temporal and spatial alignment is critical in collaborative Augmented Reality (AR) where users rely on shared visual information to coordinate actions. System latency and object misalignment can disrupt communication, reduce task…

Human-Computer Interaction · Computer Science 2025-12-09 Michael Stern , Maurizio Vergari , Julia Schorlemmer , Francesco Vona , David Grieshammer , Jan-Niklas Voigt-Antons

Individuals with upper limb mobility impairments often require assistive technologies to perform activities of daily living. While gaze-tracking has emerged as a promising method for robotic assistance, existing solutions lack sufficient…

Robotics · Computer Science 2025-05-08 Rafael R. Baptista , Nina R. Gerszberg , Ricardo V. Godoy , Gustavo J. G. Lahr

Gaze behaviors such as eye-contact or shared attention are important markers for diagnosing developmental disorders in children. While previous studies have looked at some of these elements, the analysis is usually performed on private…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Samy Tafasca , Anshul Gupta , Jean-Marc Odobez

Gaze tracking is increasingly becoming an essential component in Augmented and Virtual Reality. Modern gaze tracking al gorithms are heavyweight; they operate at most 5 Hz on mobile processors despite that near-eye cameras comfortably…

Human-Computer Interaction · Computer Science 2022-01-20 Yu Feng , Nathan Goulding-Hotta , Asif Khan , Hans Reyserhove , Yuhao Zhu

Driver gaze estimation serves as a fundamental metric for evaluating driver attentiveness in modern monitoring systems. Beyond being vulnerable to sudden lighting changes and sensor noise, spatial-domain models struggle to disentangle…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Jun Ma , Zhenye Yang , Ruichen Zhou , Pei Zhang , Huan Li , Jinpeng Chen

Gaze following estimates gaze targets of in-scene person by understanding human behavior and scene information. Existing methods usually analyze scene images for gaze following. However, compared with visual images, audio also provides…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Yuqi Hou , Zhongqun Zhang , Nora Horanyi , Jaewon Moon , Yihua Cheng , Hyung Jin Chang

Gaze stabilization is an important requisite for humanoid robots. Previous work on this topic has focused on the integration of inertial and visual information. Little attention has been given to a third component, which is the knowledge…

Robotics · Computer Science 2016-11-18 Alessandro Roncone , Ugo Pattacini , Giorgio Metta , Lorenzo Natale

For computer systems to effectively interact with humans using spoken language, they need to understand how the words being generated affect the users' moment-by-moment attention. Our study focuses on the incremental prediction of attention…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Sounak Mondal , Seoyoung Ahn , Zhibo Yang , Niranjan Balasubramanian , Dimitris Samaras , Gregory Zelinsky , Minh Hoai

Gaze prediction plays a critical role in Virtual Reality (VR) applications by reducing sensor-induced latency and enabling computationally demanding techniques such as foveated rendering, which rely on anticipating user attention. However,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Christos Petrou , Harris Partaourides , Athanasios Balomenos , Yannis Kopsinis , Sotirios Chatzis

The primary objective of the dataset is to provide a better understanding of the coupling between human actions and gaze in a shared working environment with a cobot, with the aim of signifcantly enhancing the effciency and safety of…

Robotics · Computer Science 2025-03-17 Maxence Grand , Damien Pellier , Francis Jambon

Effective assisted living environments must be able to perform inferences on how their occupants interact with one another as well as with surrounding objects. To accomplish this goal using a vision-based automated approach, multiple tasks…

Computer Vision and Pattern Recognition · Computer Science 2019-09-23 Philipe A. Dias , Damiano Malafronte , Henry Medeiros , Francesca Odone

Automated estimation of the allocation of a driver's visual attention may be a critical component of future Advanced Driver Assistance Systems. In theory, vision-based tracking of the eye can provide a good estimate of gaze location. In…

Computer Vision and Pattern Recognition · Computer Science 2016-03-02 Lex Fridman , Philipp Langhans , Joonbum Lee , Bryan Reimer