English

GraspR: A Computational Model of Spatial User Preferences for Adaptive Grasp UI Design

Human-Computer Interaction 2025-09-11 v2

Abstract

Grasp User Interfaces (grasp UIs) enable dual-tasking in XR by allowing interaction with digital content while holding physical objects. However, current grasp UI design practices face a fundamental challenge: existing approaches either capture user preferences through labor-intensive elicitation studies that are difficult to scale or rely on biomechanical models that overlook subjective factors. We introduce GraspR, the first computational model that predicts user preferences for single-finger microgestures in grasp UIs. Our data-driven approach combines the scalability of computational methods with human preference modeling, trained on 1,520 preferences collected via a two-alternative forced choice paradigm across eight participants and four frequently used grasp variations. We demonstrate GraspR's effectiveness through a working prototype that dynamically adjusts interface layouts across four everyday tasks. We release both the dataset and code to support future research in adaptive grasp UIs.

Keywords

Cite

@article{arxiv.2501.05434,
  title  = {GraspR: A Computational Model of Spatial User Preferences for Adaptive Grasp UI Design},
  author = {Arthur Caetano and Yunhao Luo and Adwait Sharma and Misha Sra},
  journal= {arXiv preprint arXiv:2501.05434},
  year   = {2025}
}
R2 v1 2026-06-28T21:01:42.375Z