English

Beyond Gaze Points: Augmenting Eye Movement with Brainwave Data for Multimodal User Authentication in Extended Reality

Cryptography and Security 2025-01-22 v2

Abstract

Extended Reality (XR) technologies are becoming integral to daily life. However, password-based authentication in XR disrupts immersion due to poor usability, as entering credentials with XR controllers is cumbersome and error-prone. This leads users to choose weaker passwords, compromising security. To improve both usability and security, we introduce a multimodal biometric authentication system that combines eye movements and brainwave patterns using consumer-grade sensors that can be integrated into XR devices. Our prototype, developed and evaluated with 30 participants, achieves an Equal Error Rate (EER) of 0.29%, outperforming eye movement (1.82%) and brainwave (4.92%) modalities alone, as well as state-of-the-art biometric alternatives (EERs between 2.5% and 7%). Furthermore, this system enables seamless authentication through visual stimuli without complex interaction.

Keywords

Cite

@article{arxiv.2404.18694,
  title  = {Beyond Gaze Points: Augmenting Eye Movement with Brainwave Data for Multimodal User Authentication in Extended Reality},
  author = {Matin Fallahi and Patricia Arias-Cabarcos and Thorsten Strufe},
  journal= {arXiv preprint arXiv:2404.18694},
  year   = {2025}
}
R2 v1 2026-06-28T16:09:46.997Z