English

IRIS: Wireless Ring for Vision-based Smart Home Interaction

Human-Computer Interaction 2024-07-26 v1 Emerging Technologies Machine Learning Image and Video Processing

Abstract

Integrating cameras into wireless smart rings has been challenging due to size and power constraints. We introduce IRIS, the first wireless vision-enabled smart ring system for smart home interactions. Equipped with a camera, Bluetooth radio, inertial measurement unit (IMU), and an onboard battery, IRIS meets the small size, weight, and power (SWaP) requirements for ring devices. IRIS is context-aware, adapting its gesture set to the detected device, and can last for 16-24 hours on a single charge. IRIS leverages the scene semantics to achieve instance-level device recognition. In a study involving 23 participants, IRIS consistently outpaced voice commands, with a higher proportion of participants expressing a preference for IRIS over voice commands regarding toggling a device's state, granular control, and social acceptability. Our work pushes the boundary of what is possible with ring form-factor devices, addressing system challenges and opening up novel interaction capabilities.

Keywords

Cite

@article{arxiv.2407.18141,
  title  = {IRIS: Wireless Ring for Vision-based Smart Home Interaction},
  author = {Maruchi Kim and Antonio Glenn and Bandhav Veluri and Yunseo Lee and Eyoel Gebre and Aditya Bagaria and Shwetak Patel and Shyamnath Gollakota},
  journal= {arXiv preprint arXiv:2407.18141},
  year   = {2024}
}

Comments

15 pages, 17 figures, 6 tables, to be published in UIST 2024

R2 v1 2026-06-28T17:53:40.313Z