English

SupertonicTTS: Towards Highly Efficient and Streamlined Text-to-Speech System

Audio and Speech Processing 2025-09-24 v3 Machine Learning Sound

Abstract

We introduce SupertonicTTS, a novel text-to-speech (TTS) system designed for efficient and streamlined speech synthesis. SupertonicTTS comprises three components: a speech autoencoder for continuous latent representation, a text-to-latent module leveraging flow-matching for text-to-latent mapping, and an utterance-level duration predictor. To enable a lightweight architecture, we employ a low-dimensional latent space, temporal compression of latents, and ConvNeXt blocks. The TTS pipeline is further simplified by operating directly on raw character-level text and employing cross-attention for text-speech alignment, thus eliminating the need for grapheme-to-phoneme (G2P) modules and external aligners. In addition, we propose context-sharing batch expansion that accelerates loss convergence and stabilizes text-speech alignment with minimal memory and I/O overhead. Experimental results demonstrate that SupertonicTTS delivers performance comparable to contemporary zero-shot TTS models with only 44M parameters, while significantly reducing architectural complexity and computational cost. Audio samples are available at: https://supertonictts.github.io/.

Keywords

Cite

@article{arxiv.2503.23108,
  title  = {SupertonicTTS: Towards Highly Efficient and Streamlined Text-to-Speech System},
  author = {Hyeongju Kim and Jinhyeok Yang and Yechan Yu and Seunghun Ji and Jacob Morton and Frederik Bous and Joon Byun and Juheon Lee},
  journal= {arXiv preprint arXiv:2503.23108},
  year   = {2025}
}

Comments

22 pages, preprint

R2 v1 2026-06-28T22:39:01.963Z