English

Ultrasensitive Textile Strain Sensors Redefine Wearable Silent Speech Interfaces with High Machine Learning Efficiency

Audio and Speech Processing 2024-05-09 v2 Sound Signal Processing

Abstract

Our research presents a wearable Silent Speech Interface (SSI) technology that excels in device comfort, time-energy efficiency, and speech decoding accuracy for real-world use. We developed a biocompatible, durable textile choker with an embedded graphene-based strain sensor, capable of accurately detecting subtle throat movements. This sensor, surpassing other strain sensors in sensitivity by 420%, simplifies signal processing compared to traditional voice recognition methods. Our system uses a computationally efficient neural network, specifically a one-dimensional convolutional neural network with residual structures, to decode speech signals. This network is energy and time-efficient, reducing computational load by 90% while achieving 95.25% accuracy for a 20-word lexicon and swiftly adapting to new users and words with minimal samples. This innovation demonstrates a practical, sensitive, and precise wearable SSI suitable for daily communication applications.

Keywords

Cite

@article{arxiv.2311.15683,
  title  = {Ultrasensitive Textile Strain Sensors Redefine Wearable Silent Speech Interfaces with High Machine Learning Efficiency},
  author = {Chenyu Tang and Muzi Xu and Wentian Yi and Zibo Zhang and Edoardo Occhipinti and Chaoqun Dong and Dafydd Ravenscroft and Sung-Min Jung and Sanghyo Lee and Shuo Gao and Jong Min Kim and Luigi G. Occhipinti},
  journal= {arXiv preprint arXiv:2311.15683},
  year   = {2024}
}

Comments

5 figures in the article; 11 figures and 4 tables in supplementary information