While text entry is an essential and frequent task in Augmented Reality (AR) applications, devising an efficient and easy-to-use text entry method for AR remains an open challenge. This research presents STAR, a smartphone-analogous AR text entry technique that leverages a user's familiarity with smartphone two-thumb typing. With STAR, a user performs thumb typing on a virtual QWERTY keyboard that is overlain on the skin of their hands. During an evaluation study of STAR, participants achieved a mean typing speed of 21.9 WPM (i.e., 56% of their smartphone typing speed), and a mean error rate of 0.3% after 30 minutes of practice. We further analyze the major factors implicated in the performance gap between STAR and smartphone typing, and discuss ways this gap could be narrowed.
Cite
@article{arxiv.2511.21143,
title = {STAR: Smartphone-analogous Typing in Augmented Reality},
author = {Taejun Kim and Amy Karlson and Aakar Gupta and Tovi Grossman and Jason Wu and Parastoo Abtahi and Christopher Collins and Michael Glueck and Hemant Bhaskar Surale},
journal= {arXiv preprint arXiv:2511.21143},
year = {2025}
}