Optical see-through head-mounted displays (OST HMDs) are a popular output medium for mobile Augmented Reality (AR) applications. To date, they lack efficient text entry techniques. Smartphones are a major text entry medium in mobile contexts but attentional demands can contribute to accidents while typing on the go. Mobile multi-display ecologies, such as combined OST HMD-smartphone systems, promise performance and situation awareness benefits over single-device use. We study the joint performance of text entry on mobile phones with text output on optical see-through head-mounted displays. A series of five experiments with a total of 86 participants indicate that, as of today, the challenges in such a joint interactive system outweigh the potential benefits.
@article{arxiv.2309.03977,
title = {Text Entry Performance and Situation Awareness of a Joint Optical See-Through Head-Mounted Display and Smartphone System},
author = {Jens Grubert and Lukas Witzani and Alexander Otte and Travis Gesslein and Matthias Kranz and Per Ola Kristensson},
journal= {arXiv preprint arXiv:2309.03977},
year = {2023}
}
Comments
To appear in IEEE Transactions on Visualization and Computer Graphics On page(s): 1-17 Print ISSN: 1077-2626 Online ISSN: 1077-2626