English

Hierarchical Decoding for Discrete Speech Synthesis with Multi-Resolution Spoof Detection

Sound 2026-04-14 v2 Audio and Speech Processing

Abstract

Neural codec language models enable high-quality discrete speech synthesis, yet their inference remains vulnerable to token-level artifacts and distributional drift that degrade perceptual realism. Rather than relying on preference optimization or retraining, we propose MSpoof-TTS, a training-free inference framework that improves zero-shot synthesis through multi-resolution spoof guidance. We introduce a Multi-Resolution Token-based Spoof Detection framework that evaluates codec sequences at different temporal granularities to detect locally inconsistent or unnatural patterns. We then integrate the spoof detectors into a hierarchical decoding strategy, progressively pruning low-quality candidates and re-ranking hypotheses. This discriminator-guided generation enhances robustness without modifying model parameters. Experiments validate the effectiveness of our framework for robust and high-quality codec-based speech generation. Audio samples are available at https://danny-nus.github.io/MSpoofTTS.github.io/.

Keywords

Cite

@article{arxiv.2603.05373,
  title  = {Hierarchical Decoding for Discrete Speech Synthesis with Multi-Resolution Spoof Detection},
  author = {Junchuan Zhao and Minh Duc Vu and Ye Wang},
  journal= {arXiv preprint arXiv:2603.05373},
  year   = {2026}
}

Comments

7 pages, 3 figures, 3 tables, 2 algorithms

R2 v1 2026-07-01T11:05:13.879Z