English
Related papers

Related papers: Continuous Gaze Tracking With Implicit Saliency-Aw…

200 papers

Appearance-based gaze estimation aims to predict the 3D eye gaze direction from a single image. While recent deep learning-based approaches have demonstrated excellent performance, they usually assume one calibrated face in each input image…

Computer Vision and Pattern Recognition · Computer Science 2022-04-21 Mingfang Zhang , Yunfei Liu , Feng Lu

A custom head-mounted system to track smooth eye movements for control of a mouse cursor is implemented and evaluated. The system comprises a head-mounted infrared camera, an infrared light source, and a computer. Software-based image…

Human-Computer Interaction · Computer Science 2020-12-01 Adam Pantanowitz , Kimoon Kim , Chelsey Chewins , Isabel N. K. Tollman , David M. Rubin

Recent studies on appearance based gaze estimation indicate the ability of Neural Networks to decode gaze information from facial images encompassing pose information. In this paper, we propose Gaze-Net: A capsule network capable of…

Computer Vision and Pattern Recognition · Computer Science 2020-04-17 Bhanuka Mahanama , Yasith Jayawardana , Sampath Jayarathna

Previous studies have illustrated the potential of analysing gaze behaviours in collaborative learning to provide educationally meaningful information for students to reflect on their learning. Over the past decades, machine learning…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Junyuan Liang , Qi Zhou , Sahan Bulathwela , Mutlu Cukurova

Gaze estimation methods estimate gaze from facial appearance with a single camera. However, due to the limited view of a single camera, the captured facial appearance cannot provide complete facial information and thus complicate the gaze…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Yihua Cheng , Feng Lu

Appearance-based gaze estimation from RGB images provides relatively unconstrained gaze tracking. We have previously proposed a gaze decomposition method that decomposes the gaze angle into the sum of a subject-independent gaze estimate…

Computer Vision and Pattern Recognition · Computer Science 2022-02-15 Zhaokang Chen , Bertram E. Shi

Gaze estimation is instrumental in modern virtual reality (VR) systems. Despite significant progress in remote-camera gaze estimation, VR gaze research remains constrained by data scarcity, particularly the lack of large-scale, accurately…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Gil Shapira , Ishay Goldin , Evgeny Artyomov , Donghoon Kim , Yosi Keller , Niv Zehngut

To address this gap, we conduct a Virtual Reality experiment in which pedestrians interact with automated shuttles under varying approach angles (45{\deg}, 90{\deg}, 135{\deg}) and continuous-traffic conditions (single shuttle, two shuttles…

Machine Learning · Computer Science 2026-05-25 Danya Li , Yan Feng , Rico Krueger

Appearance-based gaze estimation methods that only require an off-the-shelf camera have significantly improved but they are still not yet widely used in the human-computer interaction (HCI) community. This is partly because it remains…

Human-Computer Interaction · Computer Science 2019-01-31 Xucong Zhang , Yusuke Sugano , Andreas Bulling

Driver's eye gaze holds a wealth of cognitive and intentional cues crucial for intelligent vehicles. Despite its significance, research on in-vehicle gaze estimation remains limited due to the scarcity of comprehensive and well-annotated…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Yihua Cheng , Yaning Zhu , Zongji Wang , Hongquan Hao , Yongwei Liu , Shiqing Cheng , Xi Wang , Hyung Jin Chang

Augmented Reality (AR) see-through vision is an interesting research topic since it enables users to see through a wall and see the occluded objects. Most existing research focuses on the visual effects of see-through vision, while the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-07 Zhimin Wang , Yuxin Zhao , Feng Lu

The existing approaches to identify personalized salience zones of a Web page do not consider the dynamic behavior in time of the Web user's gaze or the alterations of its content. For this reason, this paper proposes the concept of visit…

Human-Computer Interaction · Computer Science 2022-11-18 F. Diaz-Guerra , A. Jimenez-Molina

We present GazeMotion, a novel method for human motion forecasting that combines information on past human poses with human eye gaze. Inspired by evidence from behavioural sciences showing that human eye and body movements are closely…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Zhiming Hu , Syn Schmitt , Daniel Haeufle , Andreas Bulling

As head-mounted displays (HMDs) with eye-tracking become increasingly accessible, the need for effective gaze-based interfaces in virtual reality (VR) grows. Traditional gaze- or hand-based navigation often limits user precision or impairs…

Human-Computer Interaction · Computer Science 2025-04-03 Mona Zavichi , André Santos , Catarina Moreira , Anderson Maciel , Joaquim Jorge

Charts are a crucial visual medium for communicating and representing information. While Large Vision-Language Models (LVLMs) have made progress on chart question answering (CQA), the task remains challenging, particularly when models…

Computation and Language · Computer Science 2025-09-17 Ali Salamatian , Amirhossein Abaskohi , Wan-Cyuan Fan , Mir Rayat Imtiaz Hossain , Leonid Sigal , Giuseppe Carenini

This paper proposes an approach to detect information relevance during decision-making from eye movements in order to enable user interface adaptation. This is a challenging task because gaze behavior varies greatly across individual users…

Human-Computer Interaction · Computer Science 2020-07-28 Anna Maria Feit , Lukas Vordemann , Seonwook Park , Caterina Bérubé , Otmar Hilliges

A driver's gaze is critical for determining their attention, state, situational awareness, and readiness to take over control from partially automated vehicles. Estimating the gaze direction is the most obvious way to gauge a driver's state…

Computer Vision and Pattern Recognition · Computer Science 2021-06-17 Akshay Rangesh , Bowen Zhang , Mohan M. Trivedi

Eye movements hold information about human perception, intention, and cognitive state. We propose a novel eye movement simulator that i) probabilistically simulates saccade movements as gamma distributions considering different peak…

Human-Computer Interaction · Computer Science 2018-09-11 Wolfgang Fuhl , Enkelejda Kasneci

Personal variations severely limit the performance of appearance-based gaze tracking. Adapting to these variations using standard neural network model adaptation methods is difficult. The problems range from overfitting, due to small…

Computer Vision and Pattern Recognition · Computer Science 2019-09-04 Erik Lindén , Jonas Sjöstrand , Alexandre Proutiere

Algorithms for the estimation of gaze direction from mobile and video-based eye trackers typically involve tracking a feature of the eye that moves through the eye camera image in a way that covaries with the shifting gaze direction, such…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Kevin Barkevich , Reynold Bailey , Gabriel J. Diaz