This paper investigates multi-selection in XR interfaces based on eye and hand interaction. We propose enabling multi-selection using different variations of techniques that combine gaze with a semi-pinch gesture, allowing users to select multiple objects, while on the way to a full-pinch. While our exploration is based on the semi-pinch mode for activating a quasi-mode, we explore four methods for confirming subselections in multi-selection mode, varying in effort and complexity: dwell-time (SemiDwell), swipe (SemiSwipe), tilt (SemiTilt), and non-dominant hand input (SemiNDH), and compare them to a baseline technique. In the user study, we evaluate their effectiveness in reducing task completion time, errors, and effort. The results indicate the strengths and weaknesses of each technique, with SemiSwipe and SemiDwell as the most preferred methods by participants. We also demonstrate their utility in file managing and RTS gaming application scenarios. This study provides valuable insights to advance 3D input systems in XR.
Cite
@article{arxiv.2503.05456,
title = {PinchCatcher: Enabling Multi-selection for Gaze+Pinch},
author = {Jinwook Kim and Sangmin Park and Qiushi Zhou and Mar Gonzalez-Franco and Jeongmi Lee and Ken Pfeuffer},
journal= {arXiv preprint arXiv:2503.05456},
year = {2025}
}
Comments
16 pages, CHI Conference on Human Factors in Computing Systems, 2025