English

Accented Text-to-Speech Synthesis with a Conditional Variational Autoencoder

Audio and Speech Processing 2024-10-01 v3 Machine Learning Sound

Abstract

Accent plays a significant role in speech communication, influencing one's capability to understand as well as conveying a person's identity. This paper introduces a novel and efficient framework for accented Text-to-Speech (TTS) synthesis based on a Conditional Variational Autoencoder. It has the ability to synthesize a selected speaker's voice, and convert this to any desired target accent. Our thorough experiments validate the effectiveness of the proposed framework using both objective and subjective evaluations. The results also show remarkable performance in terms of the model's ability to manipulate accents in the synthesized speech. Overall, our proposed framework presents a promising avenue for future accented TTS research.

Keywords

Cite

@article{arxiv.2211.03316,
  title  = {Accented Text-to-Speech Synthesis with a Conditional Variational Autoencoder},
  author = {Jan Melechovsky and Ambuj Mehrish and Berrak Sisman and Dorien Herremans},
  journal= {arXiv preprint arXiv:2211.03316},
  year   = {2024}
}

Comments

Accepted at IEEE TENCON 2024

R2 v1 2026-06-28T05:18:06.892Z