English
Related papers

Related papers: Towards End-to-end Video-based Eye-Tracking

200 papers

Technical progress in hardware and software enables us to record gaze data in everyday situations and over long time spans. Among a multitude of research opportunities, this technology enables visualization researchers to catch a glimpse…

Human-Computer Interaction · Computer Science 2023-12-05 Maurice Koch , Kuno Kurzhals , Michael Burch , Daniel Weiskopf

Eye movement biometrics (EMB) use subject-specific gaze dynamics for user authentication and identification. Recent deep learning-based EMB systems achieve strong performance by modeling temporal eye movement behavior. However, these…

Human-Computer Interaction · Computer Science 2026-05-11 Hashim Aziz , Mehedi Hasan Raju , Oleg V. Komogortsev

This paper presents a method that utilizes multiple camera views for the gaze target estimation (GTE) task. The approach integrates information from different camera views to improve accuracy and expand applicability, addressing limitations…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Qiaomu Miao , Vivek Raju Golani , Jingyi Xu , Progga Paromita Dutta , Minh Hoai , Dimitris Samaras

Electroencephalography-based eye tracking (EEG-ET) leverages eye movement artifacts in EEG signals as an alternative to camera-based tracking. While EEG-ET offers advantages such as robustness in low-light conditions and better integration…

Signal Processing · Electrical Eng. & Systems 2025-03-19 Tiago Vasconcelos Afonso , Florian Heinrichs

We address the task of jointly determining what a person is doing and where they are looking based on the analysis of video captured by a headworn camera. To facilitate our research, we first introduce the EGTEA Gaze+ dataset. Our dataset…

Computer Vision and Pattern Recognition · Computer Science 2020-11-03 Yin Li , Miao Liu , James M. Rehg

Human gaze offers rich supervisory signals for understanding visual attention in complex visual environments. In this paper, we propose Eyes on Target, a novel depth-aware and gaze-guided object detection framework designed for egocentric…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Vishakha Lall , Yisi Liu

Despite significant advances in improving the gaze tracking accuracy under controlled conditions, the tracking robustness under real-world conditions, such as large head pose and movements, use of eyeglasses, illumination and eye type…

Computer Vision and Pattern Recognition · Computer Science 2018-01-04 Nuri Murat Arar , Jean-Philippe Thiran

Eye tracking is a key technology for gaze-based interactions in Extended Reality (XR), but traditional frame-based systems struggle to meet XR's demands for high accuracy, low latency, and power efficiency. Event cameras offer a promising…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Junyuan Ding , Ziteng Wang , Chang Gao , Min Liu , Qinyu Chen

Eye-gaze tracking research offers significant promise in enhancing various healthcare-related tasks, above all in medical image analysis and interpretation. Eye tracking, a technology that monitors and records the movement of the eyes,…

Image and Video Processing · Electrical Eng. & Systems 2024-03-13 Sahar Moradizeyveh , Mehnaz Tabassum , Sidong Liu , Robert Ahadizad Newport , Amin Beheshti , Antonio Di Ieva

Following the gaze of other people and analyzing the target they are looking at can help us understand what they are thinking, and doing, and predict the actions that may follow. Existing methods for gaze following struggle to perform well…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Feiyang Liu , Dan Guo , Jingyuan Xu , Zihao He , Shengeng Tang , Kun Li , Meng Wang

We propose a novel method on refining cross-person gaze prediction task with eye/face images only by explicitly modelling the person-specific differences. Specifically, we first assume that we can obtain some initial gaze prediction results…

Computer Vision and Pattern Recognition · Computer Science 2022-05-25 Jun Bao , Buyu Liu , Jun Yu

Webcam eye tracking for the collection of gaze data in the context of user studies is convenient - it can be used in remote tests where participants do not need special hardware. The approach has strong limitations, especially regarding the…

Human-Computer Interaction · Computer Science 2022-08-01 Sezen Lim , Tina Walber , Christoph Schaefer , Lena Riehl

We present the second edition of OpenEDS dataset, OpenEDS2020, a novel dataset of eye-image sequences captured at a frame rate of 100 Hz under controlled illumination, using a virtual-reality head-mounted display mounted with two…

Computer Vision and Pattern Recognition · Computer Science 2020-05-11 Cristina Palmero , Abhishek Sharma , Karsten Behrendt , Kapil Krishnakumar , Oleg V. Komogortsev , Sachin S. Talathi

Eye movements can provide informative cues to understand human visual scan/search behavior and cognitive load during varying tasks. Visualizations of real-time gaze measures during tasks, provide an understanding of human behavior as the…

Human-Computer Interaction · Computer Science 2024-09-11 Gavindya Jayawardena , Vikas Ashok , Sampath Jayarathna

Eye movements play a vital role in perceiving the world. Eye gaze can give a direct indication of the users point of attention, which can be useful in improving human-computer interaction. Gaze estimation in a non-intrusive manner can make…

Computer Vision and Pattern Recognition · Computer Science 2019-07-11 Anjith George

Gaze estimation is instrumental in modern virtual reality (VR) systems. Despite significant progress in remote-camera gaze estimation, VR gaze research remains constrained by data scarcity, particularly the lack of large-scale, accurately…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Gil Shapira , Ishay Goldin , Evgeny Artyomov , Donghoon Kim , Yosi Keller , Niv Zehngut

Gaze and face tracking algorithms have traditionally battled a compromise between computational complexity and accuracy; the most accurate neural net algorithms cannot be implemented in real time, but less complex real-time algorithms…

Computer Vision and Pattern Recognition · Computer Science 2017-11-21 George He , Sami Oueida , Tucker Ward

Eye tracking has become increasingly important in virtual and augmented reality applications; however, the current gaze accuracy falls short of meeting the requirements for spatial computing. We designed a gaze collection framework and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Xiaoyin Yang

We present a novel, automatic eye gaze tracking scheme inspired by smooth pursuit eye motion while playing mobile games or watching virtual reality contents. Our algorithm continuously calibrates an eye tracking system for a head mounted…

Computer Vision and Pattern Recognition · Computer Science 2016-12-22 Subarna Tripathi , Brian Guenter

Gaze estimation involves predicting where the person is looking at within an image or video. Technically, the gaze information can be inferred from two different magnification levels: face orientation and eye orientation. The inference is…

Computer Vision and Pattern Recognition · Computer Science 2021-10-27 Ashesh , Chu-Song Chen , Hsuan-Tien Lin