English
Related papers

Related papers: Towards End-to-end Video-based Eye-Tracking

200 papers

Medical eye-tracking data is an important information source for understanding how radiologists visually interpret medical images. This information not only improves the accuracy of deep learning models for X-ray analysis but also their…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Trong Thang Pham , Tien-Phat Nguyen , Yuki Ikebe , Akash Awasthi , Zhigang Deng , Carol C. Wu , Hien Nguyen , Ngan Le

Technical progress in hardware and software enables us to record gaze data in everyday situations and over long time spans. Among a multitude of research opportunities, this technology enables visualization researchers to catch a glimpse…

Human-Computer Interaction · Computer Science 2020-10-01 Kuno Kurzhals , Michael Burch , Daniel Weiskopf

Video-based human pose estimation models aim to address scenarios that cannot be effectively solved by static image models such as motion blur, out-of-focus and occlusion. Most existing approaches consist of two stages: detecting human…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Zhihong Wei

Practical video analytics systems that are deployed in bandwidth constrained environments like autonomous vehicles perform computer vision tasks such as face detection and recognition. In an end-to-end face analytics system, inputs are…

Image and Video Processing · Electrical Eng. & Systems 2023-10-12 Praneet Singh , Edward J. Delp , Amy R. Reibman

Vision Language Models (VLMs) have demonstrated strong capabilities in understanding visual content, yet their ability to predict where humans look on user interfaces remains unexplored. We present UIGaze, a study investigating how closely…

Human-Computer Interaction · Computer Science 2026-04-30 Min Song , Yoonseong Lee , Yeonhu Seo

Algorithms for the estimation of gaze direction from mobile and video-based eye trackers typically involve tracking a feature of the eye that moves through the eye camera image in a way that covaries with the shifting gaze direction, such…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Kevin Barkevich , Reynold Bailey , Gabriel J. Diaz

A user's eyes provide means for Human Computer Interaction (HCI) research as an important modal. The time to time scientific explorations of the eye has already seen an upsurge of the benefits in HCI applications from gaze estimation to the…

Computer Vision and Pattern Recognition · Computer Science 2021-06-10 Atul Sahay , Imon Mukherjee , Kavi Arya

Eye movements can reveal valuable insights into various aspects of human mental processes, physical well-being, and actions. Recently, several datasets have been made available that simultaneously record EEG activity and eye movements. This…

Signal Processing · Electrical Eng. & Systems 2023-08-14 Nina Weng , Martyna Plomecka , Manuel Kaufmann , Ard Kastrati , Roger Wattenhofer , Nicolas Langer

From scientific research to commercial applications, eye tracking is an important tool across many domains. Despite its range of applications, eye tracking has yet to become a pervasive technology. We believe that we can put the power of…

Computer Vision and Pattern Recognition · Computer Science 2016-06-21 Kyle Krafka , Aditya Khosla , Petr Kellnhofer , Harini Kannan , Suchendra Bhandarkar , Wojciech Matusik , Antonio Torralba

Information Visualization (InfoVis) systems utilize visual representations to enhance data interpretation. Understanding how visual attention is allocated is essential for optimizing interface design. However, collecting Eye-tracking (ET)…

Human-Computer Interaction · Computer Science 2025-11-26 Angela Lopez-Cardona , Parvin Emami , Sebastian Idesis , Saravanakumar Duraisamy , Luis A. Leiva , Ioannis Arapakis

In this paper, we present two approaches and algorithms that adapt areas of interest We present a new deep neural network (DNN) that can be used to directly determine gaze position using EEG data. EEG-based eye tracking is a new and…

Signal Processing · Electrical Eng. & Systems 2023-03-13 Wolfgang Fuhl , Susanne Zabel , Theresa Harbig , Julia Astrid Moldt , Teresa Festl Wiete , Anne Herrmann Werner , Kay Nieselt

Distinguishing target from non-target fixations during visual search is a fundamental building block to understand users' intended actions and to build effective assistance systems. While prior research indicated the feasibility of…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Mansi Sharma , Camilo Andrés Martínez Martínez , Benedikt Emanuel Wirth , Antonio Krüger , Philipp Müller

Unconstrained remote gaze estimation remains challenging mostly due to its vulnerability to the large variability in head-pose. Prior solutions struggle to maintain reliable accuracy in unconstrained remote gaze tracking. Among them,…

Computer Vision and Pattern Recognition · Computer Science 2020-04-09 Zhecan Wang , Jian Zhao , Cheng Lu , Han Huang , Fan Yang , Lianji Li , Yandong Guo

Charts are a crucial visual medium for communicating and representing information. While Large Vision-Language Models (LVLMs) have made progress on chart question answering (CQA), the task remains challenging, particularly when models…

Computation and Language · Computer Science 2025-09-17 Ali Salamatian , Amirhossein Abaskohi , Wan-Cyuan Fan , Mir Rayat Imtiaz Hossain , Leonid Sigal , Giuseppe Carenini

Appearance-based gaze estimation aims to predict the 3D eye gaze direction from a single image. While recent deep learning-based approaches have demonstrated excellent performance, they usually assume one calibrated face in each input image…

Computer Vision and Pattern Recognition · Computer Science 2022-04-21 Mingfang Zhang , Yunfei Liu , Feng Lu

This paper addresses the challenging problem of estimating the general visual attention of people in images. Our proposed method is designed to work across multiple naturalistic social scenarios and provides a full picture of the subject's…

Computer Vision and Pattern Recognition · Computer Science 2018-07-30 Eunji Chong , Nataniel Ruiz , Yongxin Wang , Yun Zhang , Agata Rozga , James Rehg

By borrowing the wisdom of human in gaze following, we propose a two-stage solution for gaze point prediction of the target persons in a scene. Specifically, in the first stage, both head image and its position are fed into a gaze direction…

Computer Vision and Pattern Recognition · Computer Science 2019-07-05 Dongze Lian , Zehao Yu , Shenghua Gao

Prolonged exposure to virtual reality (VR) systems leads to visual fatigue, impairs user comfort, performance, and safety, particularly in high-stakes or long-duration applications. Existing fatigue detection approaches rely on subjective…

Human-Computer Interaction · Computer Science 2026-01-21 Numan Zafar , Johnathan Locke , Shafique Ahmad Chaudhry

Visualizing gaze data is an effective way for the quick interpretation of eye tracking results. This paper presents a study investigation benefits and limitations of visual gaze analysis among eye tracking professionals and researchers. The…

Human-Computer Interaction · Computer Science 2010-04-05 Sophie Stellmach , Lennart E. Nacke , Raimund Dachselt , Craig A. Lindley

In this paper, we consider the problem of tracking the eye-gaze of individuals while they engage in reading. Particularly, we develop ways to accurately track the line being read by an individual using commercially available eye tracking…

Human-Computer Interaction · Computer Science 2019-02-12 Stephen Bottos , Balakumar Balasingam