English
Related papers

Related papers: Learning to Detect Head Movement in Unconstrained …

200 papers

Unconstrained gaze estimation is the process of determining where a subject is directing their visual attention in uncontrolled environments. Gaze estimation systems are important for a myriad of tasks such as driver distraction monitoring,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Franko Šikić , Donik Vršnak , Sven Lončarić

Appearance-based gaze estimation has been actively studied in recent years. However, its generalization performance for unseen head poses is still a significant limitation for existing methods. This work proposes a generalizable multi-view…

Computer Vision and Pattern Recognition · Computer Science 2023-11-16 Yoichiro Hisadome , Tianyi Wu , Jiawei Qin , Yusuke Sugano

We propose a novel 3D gaze estimation approach that learns spatial relationships between the subject and objects in the scene, and outputs 3D gaze direction. Our method targets unconstrained settings, including cases where close-up views of…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Yuki Kawana , Shintaro Shiba , Quan Kong , Norimasa Kobori

In human-robot collaboration, one challenging task is to teach a robot new yet unknown objects enabling it to interact with them. Thereby, gaze can contain valuable information. We investigate if it is possible to detect objects (object or…

Robotics · Computer Science 2023-01-26 Daniel Weber , Wolfgang Fuhl , Andreas Zell , Enkelejda Kasneci

The relationship between a driver's glance pattern and corresponding head rotation is highly complex due to its nonlinear dependence on the individual, task, and driving context. This study explores the ability of head pose to serve as an…

Other Computer Science · Computer Science 2018-02-21 Joonbum Lee , Mauricio Muñoz , Lex Fridman , Trent Victor , Bryan Reimer , Bruce Mehler

Human eye gaze detection plays an important role in various fields, including human-computer interaction, virtual reality and cognitive science. Although different relatively accurate systems of eye tracking and gaze detection exist, they…

Human-Computer Interaction · Computer Science 2017-09-13 Ehsan Arbabi , Mohammad Shabani , Ali Yarigholi

Appearance-based supervised methods with full-face image input have made tremendous advances in recent gaze estimation tasks. However, intensive human annotation requirement inhibits current methods from achieving industrial level accuracy…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Yangzhou Jiang , Yinxin Lin , Yaoming Wang , Teng Li , Bilian Ke , Bingbing Ni

We present HOIGaze - a novel learning-based approach for gaze estimation during hand-object interactions (HOI) in extended reality (XR). HOIGaze addresses the challenging HOI setting by building on one key insight: The eye, hand, and head…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Zhiming Hu , Daniel Haeufle , Syn Schmitt , Andreas Bulling

Due to the recent outbreak of COVID-19, many classes, exams, and meetings have been conducted non-face-to-face. However, the foundation for video conferencing solutions is still insufficient. So this technology has become an important…

Computer Vision and Pattern Recognition · Computer Science 2021-07-15 Suneung-Kim , Seong-Whan Lee

We introduce GazeD, a new 3D gaze estimation method that jointly provides 3D gaze and human pose from a single RGB image. Leveraging the ability of diffusion models to deal with uncertainty, it generates multiple plausible 3D gaze and pose…

Computer Vision and Pattern Recognition · Computer Science 2026-01-26 Riccardo Catalini , Davide Di Nucci , Guido Borghi , Davide Davoli , Lorenzo Garattoni , Gianpiero Francesca , Yuki Kawana , Roberto Vezzani

Automated estimation of the allocation of a driver's visual attention may be a critical component of future Advanced Driver Assistance Systems. In theory, vision-based tracking of the eye can provide a good estimate of gaze location. In…

Computer Vision and Pattern Recognition · Computer Science 2016-03-02 Lex Fridman , Philipp Langhans , Joonbum Lee , Bryan Reimer

Human eye gaze estimation is an important cognitive ingredient for successful human-robot interaction, enabling the robot to read and predict human behavior. We approach this problem using artificial neural networks and build a modular…

Computer Vision and Pattern Recognition · Computer Science 2024-03-01 Dmytro Herashchenko , Igor Farkaš

Although gaze estimation methods have been developed with deep learning techniques, there has been no such approach as aim to attain accurate performance in low-resolution face images with a pixel width of 50 pixels or less. To solve a…

Computer Vision and Pattern Recognition · Computer Science 2022-09-22 Jun-Seok Yun , Youngju Na , Hee Hyeon Kim , Hyung-Il Kim , Seok Bong Yoo

Mobile gaze tracking involves inferring a user's gaze point or direction on a mobile device's screen from facial images captured by the device's front camera. While this technology inspires an increasing number of gaze-interaction…

Human-Computer Interaction · Computer Science 2025-05-30 Yaxiong Lei , Yuheng Wang , Fergus Buchanan , Mingyue Zhao , Yusuke Sugano , Shijing He , Mohamed Khamis , Juan Ye

This study presents a novel framework for 3D gaze tracking tailored for mixed-reality settings, aimed at enhancing joint attention and collaborative efforts in team-based scenarios. Conventional gaze tracking, often limited by monocular…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Eduardo Davalos , Yike Zhang , Ashwin T. S. , Joyce H. Fonteles , Umesh Timalsina , Guatam Biswas

State-of-the-art appearance-based gaze estimation methods, usually based on deep learning techniques, mainly rely on static features. However, temporal trace of eye gaze contains useful information for estimating a given gaze point. For…

Computer Vision and Pattern Recognition · Computer Science 2020-05-26 Cristina Palmero , Oleg V. Komogortsev , Sachin S. Talathi

Appearance-based gaze estimation has attracted more and more attention because of its wide range of applications. The use of deep convolutional neural networks has improved the accuracy significantly. In order to improve the estimation…

Computer Vision and Pattern Recognition · Computer Science 2019-03-19 Zhaokang Chen , Bertram E. Shi

3D gaze information is important for scene-centric attention analysis but accurate estimation and analysis of 3D gaze in real-world environments remains challenging. We present a novel 3D gaze estimation method for monocular head-mounted…

Human-Computer Interaction · Computer Science 2017-02-07 Mohsen Mansouryar , Julian Steil , Yusuke Sugano , Andreas Bulling

Humans are remarkably adept at interpreting the gaze direction of other individuals in their surroundings. This skill is at the core of the ability to engage in joint visual attention, which is essential for establishing social…

Neurons and Cognition · Quantitative Biology 2016-11-30 Daniel Harari , Tao Gao , Nancy Kanwisher , Joshua Tenenbaum , Shimon Ullman

This paper proposes a gaze correction and animation method for high-resolution, unconstrained portrait images, which can be trained without the gaze angle and the head pose annotations. Common gaze-correction methods usually require…

Computer Vision and Pattern Recognition · Computer Science 2022-08-31 Jichao Zhang , Jingjing Chen , Hao Tang , Enver Sangineto , Peng Wu , Yan Yan , Nicu Sebe , Wei Wang