English
Related papers

Related papers: GAZEploit: Remote Keystroke Inference Attack by Ga…

200 papers

Nowadays smartphones come embedded with multiple motion sensors, such as an accelerometer, a gyroscope and an orientation sensor. With these sensors, apps can gather more information and therefore provide end users with more functionality.…

Cryptography and Security · Computer Science 2014-10-29 Yihang Song , Madhur Kukreti , Rahul Rawat , Urs Hengartner

Gaze-based virtual keyboards provide an effective interface for text entry by eye movements. The efficiency and usability of these keyboards have traditionally been evaluated with conventional text entry performance measures such as words…

Human-Computer Interaction · Computer Science 2018-04-10 Korok Sengupta , Jun Sun , Raphael Menges , Chandan Kumar , Steffen Staab

Predicting gaze behavior in virtual reality environments remains a significant challenge with implications for rendering optimization and interface design. This paper introduces a multimodal approach to VR gaze prediction that combines…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Farhaan Ebadulla , Chiraag Mudlpaur , Shreya Chaurasia , Gaurav BV

Although eye-tracking technology is being integrated into more VR and MR headsets, the true potential of eye tracking in enhancing user interactions within XR settings remains relatively untapped. Presently, one of the most prevalent gaze…

Human-Computer Interaction · Computer Science 2024-05-24 Naveen Sendhilnathan , Ajoy S. Fernandes , Michael J. Proulx , Tanya R. Jonker

A highly secure, foolproof, user authentication system is still a primary focus of research in the field of User Privacy and Security. Shoulder-surfing is an act of spying when an authorized user is logging into a system, and is promoted by…

Human-Computer Interaction · Computer Science 2018-03-22 Vijay Rajanna , Tracy Hammond

Gaze tracking is increasingly becoming an essential component in Augmented and Virtual Reality. Modern gaze tracking al gorithms are heavyweight; they operate at most 5 Hz on mobile processors despite that near-eye cameras comfortably…

Human-Computer Interaction · Computer Science 2022-01-20 Yu Feng , Nathan Goulding-Hotta , Asif Khan , Hans Reyserhove , Yuhao Zhu

We present a model for inferring where users look during interaction based on keypress data only. Given a key log, it outputs a scanpath that tells, moment-by-moment, how the user had moved eyes while entering those keys. The model can be…

Human-Computer Interaction · Computer Science 2025-07-25 Yujun Zhu , Danqing Shi , Hee-Seung Moon , Antti Oulasvirta

Eye tracking (ET) is a foundational technology for advanced AR/VR applications. However, training ET models for every new ET device is challenging: real data collection is costly and time-consuming, while existing synthetic data generation…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Corentin Dumery , David Colmenares , Alexander Fix , Pascal Fua , Ali Behrooz , Jogendra Kundu

Gaze interaction presents a promising avenue in Virtual Reality (VR) due to its intuitive and efficient user experience. Yet, the depth control inherent in our visual system remains underutilized in current methods. In this study, we…

Human-Computer Interaction · Computer Science 2024-05-08 Chenyang Zhang , Tiansu Chen , Eric Shaffer , Elahe Soltanaghai

With advancements in AI, new gaze estimation methods are exceeding state-of-the-art (SOTA) benchmarks, but their real-world application reveals a gap with commercial eye-tracking solutions. Factors like model size, inference time, and…

Computer Vision and Pattern Recognition · Computer Science 2025-08-28 Eduardo Davalos , Yike Zhang , Namrata Srivastava , Yashvitha Thatigotla , Jorge A. Salas , Sara McFadden , Sun-Joo Cho , Amanda Goodwin , Ashwin TS , Gautam Biswas

The use of ML models to predict a user's cognitive state from behavioral data has been studied for various applications which includes predicting the intent to perform selections in VR. We developed a novel technique that uses gaze-based…

Human-Computer Interaction · Computer Science 2024-04-23 Anish S. Narkar , Jan J. Michalak , Candace E. Peacock , Brendan David-John

Eye tracking has become increasingly important in virtual and augmented reality applications; however, the current gaze accuracy falls short of meeting the requirements for spatial computing. We designed a gaze collection framework and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Xiaoyin Yang

The latest developments in computer hardware, sensor technologies, and artificial intelligence can make virtual reality (VR) and virtual spaces an important part of human everyday life. Eye tracking offers not only a hands-free way of…

Human-Computer Interaction · Computer Science 2026-01-21 Efe Bozkir , Süleyman Özdel , Mengdi Wang , Brendan David-John , Hong Gao , Kevin Butler , Eakta Jain , Enkelejda Kasneci

Gaze estimation models are widely used in applications such as driver attention monitoring and human-computer interaction. While many methods for gaze estimation exist, they rely heavily on data-hungry deep learning to achieve high…

Computer Vision and Pattern Recognition · Computer Science 2025-02-28 Lingyu Du , Yupei Liu , Jinyuan Jia , Guohao Lan

Frustrating text entry interface has been a major obstacle in participating in social activities in augmented reality (AR). Popular options, such as mid-air keyboard interface, wireless keyboards or voice input, either suffer from poor…

Computer Vision and Pattern Recognition · Computer Science 2023-11-03 Xingyu Fu , Mingze Xi

Keystroke inference attacks are a form of side-channel attacks in which an attacker leverages various techniques to recover a user's keystrokes as she inputs information into some display (e.g., while sending a text message or entering her…

Computer Vision and Pattern Recognition · Computer Science 2022-04-07 John Lim , Jan-Michael Frahm , Fabian Monrose

Introduction: In the realm of human-computer interaction and behavioral research, accurate real-time gaze estimation is critical. Traditional methods often rely on expensive equipment or large datasets, which are impractical in many…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Esther Enhui Ye , John Enzhou Ye , Joseph Ye , Jacob Ye , Runzhou Ye

This paper performs the crucial work of establishing a baseline for gaze-driven authentication performance to begin answering fundamental research questions using a very large dataset of gaze recordings from 9202 people with a level of eye…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Dillon Lohr , Michael J. Proulx , Oleg Komogortsev

Appearance-based gaze estimation has achieved significant improvement by using deep learning. However, many deep learning-based methods suffer from the vulnerability property, i.e., perturbing the raw image using noise confuses the gaze…

Computer Vision and Pattern Recognition · Computer Science 2021-03-25 Mingjie Xu , Haofei Wang , Yunfei Liu , Feng Lu

Privacy is a highly subjective concept and perceived variably by different individuals. Previous research on quantifying user-perceived privacy has primarily relied on questionnaires. Furthermore, applying user-perceived privacy to optimise…

Human-Computer Interaction · Computer Science 2025-09-11 Mayar Elfares , Pascal Reisert , Ralf Küsters , Andreas Bulling