English
Related papers

Related papers: Practical Saccade Prediction for Head-Mounted Disp…

200 papers

Leveraging real-time eye-tracking, foveated rendering optimizes hardware efficiency and enhances visual quality virtual reality (VR). This approach leverages eye-tracking techniques to determine where the user is looking, allowing the…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Wenxuan Liu , Monde Duinkharjav , Qi Sun , Sai Qian Zhang

We aid in neurocognitive monitoring outside the hospital environment by enabling app-based measurements of visual reaction time (saccade latency) and error rate in a cohort of subjects spanning the adult age spectrum. Methods: We developed…

Neurons and Cognition · Quantitative Biology 2020-12-18 Hsin-Yu Lai , Gladynel Saavedra-Pena , Charles G. Sodini , Thomas Heldt , Vivienne Sze

Saccades are extremely rapid movements of both eyes that occur simultaneously, typically observed when an individual shifts their focus from one object to another. These movements are among the swiftest produced by humans and possess the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Khadija Iddrisu , Waseem Shariff , Suzanne Little

Recent work in XAI for eye tracking data has evaluated the suitability of feature attribution methods to explain the output of deep neural sequence models for the task of oculomotric biometric identification. These methods provide saliency…

Machine Learning · Computer Science 2023-04-27 Daniel G. Krakowczyk , Paul Prasse , David R. Reich , Sebastian Lapuschkin , Tobias Scheffer , Lena A. Jäger

Augmented reality (AR) technology provides means for embedding visualization in a real-world context. Such techniques allow situated analyses of live data in their spatial domain. However, as existing techniques have to be adapted for this…

Human-Computer Interaction · Computer Science 2022-09-07 Kuno Kurzhals , Michael Becher , Nelusa Pathmanathan , Guido Reina

Although the number of gaze estimation datasets is growing, the application of appearance-based gaze estimation methods is mostly limited to estimating the point of gaze on a screen. This is in part because most datasets are generated in a…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Cedric Leblond-Menard , Gabriel Picard-Krashevski , Sofiane Achiche

Despite significant advances in improving the gaze tracking accuracy under controlled conditions, the tracking robustness under real-world conditions, such as large head pose and movements, use of eyeglasses, illumination and eye type…

Computer Vision and Pattern Recognition · Computer Science 2018-01-04 Nuri Murat Arar , Jean-Philippe Thiran

Eye movements play a vital role in perceiving the world. Eye gaze can give a direct indication of the users point of attention, which can be useful in improving human-computer interaction. Gaze estimation in a non-intrusive manner can make…

Computer Vision and Pattern Recognition · Computer Science 2019-07-11 Anjith George

Efficiency and ease of use are essential for practical applications of camera based eye/gaze-tracking. Gaze tracking involves estimating where a person is looking on a screen based on face images from a computer-facing camera. In this paper…

Computer Vision and Pattern Recognition · Computer Science 2020-09-04 Amogh Gudi , Xin Li , Jan van Gemert

Speed and consistency of target-shifting play a crucial role in human ability to perform complex tasks. Shifting our gaze between objects of interest quickly and consistently requires changes both in depth and direction. Gaze changes in…

Graphics · Computer Science 2023-10-04 Budmonde Duinkharjav , Benjamin Liang , Anjul Patney , Rachel Brown , Qi Sun

Ultra-high-resolution 360-degree video streaming is severely constrained by the massive bandwidth required to deliver immersive experiences. Current viewport prediction techniques predominately rely on kinematics or low-level visual…

Multimedia · Computer Science 2026-01-12 Arman Nik Khah , Arvin Bahreini , Ravi Prakash

In humans and in foveated animals visual acuity is highly concentrated at the center of gaze, so that choosing where to look next is an important example of online, rapid decision making. Computational neuroscientists have developed…

Neurons and Cognition · Quantitative Biology 2014-12-05 Ralf Engbert , Hans A. Trukenbrod , Simon Barthelmé , Felix A. Wichmann

Advanced multimodal AI agents can now collaborate with users to solve challenges in the world. Yet, these emerging contextual AI systems rely on explicit communication channels between the user and system. We hypothesize that implicit…

Human gaze provides valuable information on human focus and intentions, making it a crucial area of research. Recently, deep learning has revolutionized appearance-based gaze estimation. However, due to the unique features of gaze…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Yihua Cheng , Haofei Wang , Yiwei Bao , Feng Lu

In recent years, head-mounted near-eye display devices have become the key hardware foundation for virtual reality and augmented reality. Thus head-mounted gaze tracking technology has received attention as an essential part of…

Computer Vision and Pattern Recognition · Computer Science 2022-11-02 Wei Zhang , Jiaxi Cao , Xiang Wang , Enqi Tian , Bin Li

Over the past decade, many computational saliency prediction models have been proposed for 2D images and videos. Considering that the human visual system has evolved in a natural 3D environment, it is only natural to want to design visual…

Computer Vision and Pattern Recognition · Computer Science 2018-03-14 Amin Banitalebi-Dehkordi , Mahsa T. Pourazad , Panos Nasiopoulos

The cameras in modern gaze-tracking systems suffer from fundamental bandwidth and power limitations, constraining data acquisition speed to 300 Hz realistically. This obstructs the use of mobile eye trackers to perform, e.g., low latency…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Anastasios N. Angelopoulos , Julien N. P. Martel , Amit P. S. Kohli , Jorg Conradt , Gordon Wetzstein

We present a new and accurate approach for gaze estimation on consumer computing devices. We take advantage of continued strides in the quality of user-facing cameras found in e.g., smartphones, laptops, and desktops - 4K or greater in…

Human-Computer Interaction · Computer Science 2026-03-23 Taejun Kim , Vimal Mollyn , Riku Arakawa , Chris Harrison

In this paper we introduce a novel Depth-Aware Video Saliency approach to predict human focus of attention when viewing RGBD videos on regular 2D screens. We train a generative convolutional neural network which predicts a saliency map for…

Computer Vision and Pattern Recognition · Computer Science 2016-03-14 G. Leifman , D. Rudoy , T. Swedish , E. Bayro-Corrochano , R. Raskar

How people look at visual information reveals fundamental information about themselves, their interests and their state of mind. While previous visual attention models output static 2-dimensional saliency maps, saccadic models aim to…

Computer Vision and Pattern Recognition · Computer Science 2017-02-16 Olivier Le Meur , Antoine Coutrot , Zhi Liu , Adrien Le Roch , Andrea Helo , Pia Rama