We introduce a lightweight, real-time motion recognition system that enables synergic human-machine performance through wearable IMU sensor data, MiniRocket time-series classification, and responsive multimedia control. By mapping dancer-specific movement to sound through somatic memory and association, we propose an alternative approach to human-machine collaboration, one that preserves the expressive depth of the performing body while leveraging machine learning for attentive observation and responsiveness. We demonstrate that this human-centered design reliably supports high accuracy classification (<50 ms latency), offering a replicable framework to integrate dance-literate machines into creative, educational, and live performance contexts.
@article{arxiv.2511.02351,
title = {Human-Machine Ritual: Synergic Performance through Real-Time Motion Recognition},
author = {Zhuodi Cai and Ziyu Xu and Juan Pampin},
journal= {arXiv preprint arXiv:2511.02351},
year = {2025}
}
Comments
8 pages, 5 figures. Camera-ready manuscript for the Creative AI Track of NeurIPS 2025