English

Enhancing Wearable Tap Water Audio Detection through Subclass Annotation in the HD-Epic Dataset

Human-Computer Interaction 2025-07-29 v2 Machine Learning

Abstract

Wearable human activity recognition has been shown to benefit from the inclusion of acoustic data, as the sounds around a person often contain valuable context. However, due to privacy concerns, it is usually not ethically feasible to record and save microphone data from the device, since the audio could, for instance, also contain private conversations. Rather, the data should be processed locally, which in turn requires processing power and consumes energy on the wearable device. One special use case of contextual information that can be utilized to augment special tasks in human activity recognition is water flow detection, which can, e.g., be used to aid wearable hand washing detection. We created a new label called tap water for the recently released HD-Epic data set, creating 717 hand-labeled annotations of tap water flow, based on existing annotations of the water class. We analyzed the relation of tap water and water in the dataset and additionally trained and evaluated two lightweight classifiers to evaluate the newly added label class, showing that the new class can be learned more easily.

Keywords

Cite

@article{arxiv.2505.20788,
  title  = {Enhancing Wearable Tap Water Audio Detection through Subclass Annotation in the HD-Epic Dataset},
  author = {Robin Burchard and Kristof Van Laerhoven},
  journal= {arXiv preprint arXiv:2505.20788},
  year   = {2025}
}

Comments

To be published in Companion of the 2025 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp Companion '25), Beyond Sound workshop. Replacement version identical to the one to be published with ACM