Poster: Recognizing Hidden-in-the-Ear Private Key for Reliable Silent Speech Interface Using Multi-Task Learning
Human-Computer Interaction
2025-12-19 v1 Audio and Speech Processing
Abstract
Silent speech interface (SSI) enables hands-free input without audible vocalization, but most SSI systems do not verify speaker identity. We present HEar-ID, which uses consumer active noise-canceling earbuds to capture low-frequency "whisper" audio and high-frequency ultrasonic reflections. Features from both streams pass through a shared encoder, producing embeddings that feed a contrastive branch for user authentication and an SSI head for silent spelling recognition. This design supports decoding of 50 words while reliably rejecting impostors, all on commodity earbuds with a single model. Experiments demonstrate that HEar-ID achieves strong spelling accuracy and robust authentication.
Cite
@article{arxiv.2512.16518,
title = {Poster: Recognizing Hidden-in-the-Ear Private Key for Reliable Silent Speech Interface Using Multi-Task Learning},
author = {Xuefu Dong and Liqiang Xu and Lixing He and Zengyi Han and Ken Christofferson and Yifei Chen and Akihito Taya and Yuuki Nishiyama and Kaoru Sezaki},
journal= {arXiv preprint arXiv:2512.16518},
year = {2025}
}
Comments
UbiComp Poster 2025