English
Related papers

Related papers: GazeBaseVR, a large-scale, longitudinal, binocular…

200 papers

Understanding where people are looking is an informative social cue. In this work, we present Gaze360, a large-scale gaze-tracking dataset and method for robust 3D gaze estimation in unconstrained images. Our dataset consists of 238…

Computer Vision and Pattern Recognition · Computer Science 2019-10-23 Petr Kellnhofer , Adria Recasens , Simon Stent , Wojciech Matusik , Antonio Torralba

The primary objective of the dataset is to provide a better understanding of the coupling between human actions and gaze in a shared working environment with a cobot, with the aim of signifcantly enhancing the effciency and safety of…

Robotics · Computer Science 2025-03-17 Maxence Grand , Damien Pellier , Francis Jambon

We introduce GazeVaLM, a public eye-tracking dataset for studying clinical perception during chest radiograph authenticity assessment. The dataset comprises 960 gaze recordings from 16 expert radiologists interpreting 30 real and 30…

From scientific research to commercial applications, eye tracking is an important tool across many domains. Despite its range of applications, eye tracking has yet to become a pervasive technology. We believe that we can put the power of…

Computer Vision and Pattern Recognition · Computer Science 2016-06-21 Kyle Krafka , Aditya Khosla , Petr Kellnhofer , Harini Kannan , Suchendra Bhandarkar , Wojciech Matusik , Antonio Torralba

The permanence of eye movements as a biometric modality remains largely unexplored in the literature. The present study addresses this limitation by evaluating a novel exponentially-dilated convolutional neural network for eye movement…

Human-Computer Interaction · Computer Science 2024-10-28 Dillon Lohr , Henry Griffith , Oleg V Komogortsev

We present a new dataset with annotated eye movements. The dataset consists of over 800,000 gaze points recorded during a car ride in the real world and in the simulator. In total, the eye movements of 19 subjects were annotated. In this…

Computer Vision and Pattern Recognition · Computer Science 2021-01-13 Wolfgang Fuhl , Enkelejda Kasneci

We present TEyeD, the world's largest unified public data set of eye images taken with head-mounted devices. TEyeD was acquired with seven different head-mounted eye trackers. Among them, two eye trackers were integrated into virtual…

Image and Video Processing · Electrical Eng. & Systems 2026-01-07 Wolfgang Fuhl , Gjergji Kasneci , Enkelejda Kasneci

Estimating eye-gaze from images alone is a challenging task, in large parts due to un-observable person-specific factors. Achieving high accuracy typically requires labeled data from test users which may not be attainable in real…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Seonwook Park , Emre Aksan , Xucong Zhang , Otmar Hilliges

Eye Tracking (ET) can help to understand visual attention and cognitive processes in interactive environments. In attention tasks, distinguishing between relevant target objects and distractors is crucial for effective performance, yet the…

Human-Computer Interaction · Computer Science 2025-08-29 Abdul Rehman , Ilona Heldal , Jerry Chun-Wei Lin

Existing event stream based trackers undergo evaluation on short-term tracking datasets, however, the tracking of real-world scenarios involves long-term tracking, and the performance of existing tracking algorithms in these scenarios…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Xiao Wang , Xufeng Lou , Shiao Wang , Ju Huang , Lan Chen , Bo Jiang

Eye gaze estimation and simultaneous semantic understanding of a user through eye images is a crucial component in Virtual and Mixed Reality; enabling energy efficient rendering, multi-focal displays and effective interaction with 3D…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Zhengyang Wu , Srivignesh Rajendran , Tarrence van As , Joelle Zimmermann , Vijay Badrinarayanan , Andrew Rabinovich

With the emergence of Virtual and Mixed Reality (XR) devices, eye tracking has received significant attention in the computer vision community. Eye gaze estimation is a crucial component in XR -- enabling energy efficient rendering,…

Computer Vision and Pattern Recognition · Computer Science 2020-03-20 Zhengyang Wu , Srivignesh Rajendran , Tarrence van As , Joelle Zimmermann , Vijay Badrinarayanan , Andrew Rabinovich

Event-based cameras are becoming a popular solution for efficient, low-power eye tracking. Due to the sparse and asynchronous nature of event data, they require less processing power and offer latencies in the microsecond range. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-10 Andrea Aspesi , Andrea Simpsi , Aaron Tognoli , Simone Mentasti , Luca Merigo , Matteo Matteucci

We address the task of jointly determining what a person is doing and where they are looking based on the analysis of video captured by a headworn camera. To facilitate our research, we first introduce the EGTEA Gaze+ dataset. Our dataset…

Computer Vision and Pattern Recognition · Computer Science 2020-11-03 Yin Li , Miao Liu , James M. Rehg

Virtual Reality (VR) has been a beneficial training tool in fields such as advanced manufacturing. However, users may experience a high cognitive load due to various factors, such as the use of VR hardware or tasks within the VR…

Human-Computer Interaction · Computer Science 2024-11-21 Mahsa Nasri , Mehmet Kosa , Leanne Chukoskie , Mohsen Moghaddam , Casper Harteveld

Eye-tracking has potential to provide rich behavioral data about human cognition in ecologically valid environments. However, analyzing this rich data is often challenging. Most automated analyses are specific to simplistic artificial…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Karan Uppal , Jaeah Kim , Shashank Singh

We introduce HOT3D, a publicly available dataset for egocentric hand and object tracking in 3D. The dataset offers over 833 minutes (3.7M+ images) of recordings that feature 19 subjects interacting with 33 diverse rigid objects. In addition…

The cameras in modern gaze-tracking systems suffer from fundamental bandwidth and power limitations, constraining data acquisition speed to 300 Hz realistically. This obstructs the use of mobile eye trackers to perform, e.g., low latency…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Anastasios N. Angelopoulos , Julien N. P. Martel , Amit P. S. Kohli , Jorg Conradt , Gordon Wetzstein

We introduce Ego4D, a massive-scale egocentric video dataset and benchmark suite. It offers 3,670 hours of daily-life activity video spanning hundreds of scenarios (household, outdoor, workplace, leisure, etc.) captured by 931 unique camera…

With advancements in hardware, high-quality HMD devices are being developed by numerous companies, driving increased consumer interest in AR, VR, and MR applications. In this work, we present a new dataset, called VRBiom, of periocular…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Ketan Kotwal , Ibrahim Ulucan , Gokhan Ozbulak , Janani Selliah , Sebastien Marcel