English

CTC-TTS: LLM-based dual-streaming text-to-speech with CTC alignment

Audio and Speech Processing 2026-02-24 v1 Artificial Intelligence Sound

Abstract

Large-language-model (LLM)-based text-to-speech (TTS) systems can generate natural speech, but most are not designed for low-latency dual-streaming synthesis. High-quality dual-streaming TTS depends on accurate text--speech alignment and well-designed training sequences that balance synthesis quality and latency. Prior work often relies on GMM-HMM based forced-alignment toolkits (e.g., MFA), which are pipeline-heavy and less flexible than neural aligners; fixed-ratio interleaving of text and speech tokens struggles to capture text--speech alignment regularities. We propose CTC-TTS, which replaces MFA with a CTC based aligner and introduces a bi-word based interleaving strategy. Two variants are designed: CTC-TTS-L (token concatenation along the sequence length) for higher quality and CTC-TTS-F (embedding stacking along the feature dimension) for lower latency. Experiments show that CTC-TTS outperforms fixed-ratio interleaving and MFA-based baselines on streaming synthesis and zero-shot tasks. Speech samples are available at https://ctctts.github.io/.

Keywords

Cite

@article{arxiv.2602.19574,
  title  = {CTC-TTS: LLM-based dual-streaming text-to-speech with CTC alignment},
  author = {Hanwen Liu and Saierdaer Yusuyin and Hao Huang and Zhijian Ou},
  journal= {arXiv preprint arXiv:2602.19574},
  year   = {2026}
}

Comments

Submitted to INTERSPEECH 2026

R2 v1 2026-07-01T10:46:58.812Z