English

EclipseTouch: Touch Segmentation on Ad Hoc Surfaces using Worn Infrared Shadow Casting

Human-Computer Interaction 2025-09-04 v1 Computer Vision and Pattern Recognition Graphics Robotics

Abstract

The ability to detect touch events on uninstrumented, everyday surfaces has been a long-standing goal for mixed reality systems. Prior work has shown that virtual interfaces bound to physical surfaces offer performance and ergonomic benefits over tapping at interfaces floating in the air. A wide variety of approaches have been previously developed, to which we contribute a new headset-integrated technique called \systemname. We use a combination of a computer-triggered camera and one or more infrared emitters to create structured shadows, from which we can accurately estimate hover distance (mean error of 6.9~mm) and touch contact (98.0\% accuracy). We discuss how our technique works across a range of conditions, including surface material, interaction orientation, and environmental lighting.

Keywords

Cite

@article{arxiv.2509.03430,
  title  = {EclipseTouch: Touch Segmentation on Ad Hoc Surfaces using Worn Infrared Shadow Casting},
  author = {Vimal Mollyn and Nathan DeVrio and Chris Harrison},
  journal= {arXiv preprint arXiv:2509.03430},
  year   = {2025}
}

Comments

Accepted to UIST 2025

R2 v1 2026-07-01T05:19:29.588Z