English

Speaking Without Sound: Multi-speaker Silent Speech Voicing with Facial Inputs Only

Sound 2026-02-03 v1

Abstract

In this paper, we introduce a novel framework for generating multi-speaker speech without relying on any audible inputs. Our approach leverages silent electromyography (EMG) signals to capture linguistic content, while facial images are used to match with the vocal identity of the target speaker. Notably, we present a pitch-disentangled content embedding that enhances the extraction of linguistic content from EMG signals. Extensive analysis demonstrates that our method can generate multi-speaker speech without any audible inputs and confirms the effectiveness of the proposed pitch-disentanglement approach.

Keywords

Cite

@article{arxiv.2602.01879,
  title  = {Speaking Without Sound: Multi-speaker Silent Speech Voicing with Facial Inputs Only},
  author = {Jaejun Lee and Yoori Oh and Kyogu Lee},
  journal= {arXiv preprint arXiv:2602.01879},
  year   = {2026}
}

Comments

This paper was presented at ICASSP 2025