English

Improve Cross-lingual Voice Cloning Using Low-quality Code-switched Data

Sound 2022-11-18 v2 Computation and Language Audio and Speech Processing

Abstract

Recently, sequence-to-sequence (seq-to-seq) models have been successfully applied in text-to-speech (TTS) to synthesize speech for single-language text. To synthesize speech for multiple languages usually requires multi-lingual speech from the target speaker. However, it is both laborious and expensive to collect high-quality multi-lingual TTS data for the target speakers. In this paper, we proposed to use low-quality code-switched found data from the non-target speakers to achieve cross-lingual voice cloning for the target speakers. Experiments show that our proposed method can generate high-quality code-switched speech in the target voices in terms of both naturalness and speaker consistency. More importantly, we find that our method can achieve a comparable result to the state-of-the-art (SOTA) performance in cross-lingual voice cloning.

Keywords

Cite

@article{arxiv.2110.07210,
  title  = {Improve Cross-lingual Voice Cloning Using Low-quality Code-switched Data},
  author = {Haitong Zhang and Yue Lin},
  journal= {arXiv preprint arXiv:2110.07210},
  year   = {2022}
}
R2 v1 2026-06-24T06:52:50.692Z