English

Wearable-based Human Activity Recognition with Spatio-Temporal Spiking Neural Networks

Neural and Evolutionary Computing 2022-12-06 v1 Machine Learning Signal Processing

Abstract

We study the Human Activity Recognition (HAR) task, which predicts user daily activity based on time series data from wearable sensors. Recently, researchers use end-to-end Artificial Neural Networks (ANNs) to extract the features and perform classification in HAR. However, ANNs pose a huge computation burden on wearable devices and lack temporal feature extraction. In this work, we leverage Spiking Neural Networks (SNNs)--an architecture inspired by biological neurons--to HAR tasks. SNNs allow spatio-temporal extraction of features and enjoy low-power computation with binary spikes. We conduct extensive experiments on three HAR datasets with SNNs, demonstrating that SNNs are on par with ANNs in terms of accuracy while reducing up to 94% energy consumption. The code is publicly available in https://github.com/Intelligent-Computing-Lab-Yale/SNN_HAR

Keywords

Cite

@article{arxiv.2212.02233,
  title  = {Wearable-based Human Activity Recognition with Spatio-Temporal Spiking Neural Networks},
  author = {Yuhang Li and Ruokai Yin and Hyoungseob Park and Youngeun Kim and Priyadarshini Panda},
  journal= {arXiv preprint arXiv:2212.02233},
  year   = {2022}
}

Comments

Workshop on Learning from Time Series for Health

R2 v1 2026-06-28T07:22:22.357Z