English

ZSDEVC: Zero-Shot Diffusion-based Emotional Voice Conversion with Disentangled Mechanism

Audio and Speech Processing 2025-09-29 v5

Abstract

The human voice conveys not just words but also emotional states and individuality. Emotional voice conversion (EVC) modifies emotional expressions while preserving linguistic content and speaker identity, improving applications like human-machine interaction. While deep learning has advanced EVC models for specific target speakers on well-crafted emotional datasets, existing methods often face issues with emotion accuracy and speech distortion. In addition, the zero-shot scenario, in which emotion conversion is applied to unseen speakers, remains underexplored. This work introduces a novel diffusion framework with disentangled mechanisms and expressive guidance, trained on a large emotional speech dataset and evaluated on unseen speakers across in-domain and out-of-domain datasets. Experimental results show that our method produces expressive speech with high emotional accuracy, naturalness, and quality, showcasing its potential for broader EVC applications.

Keywords

Cite

@article{arxiv.2409.03636,
  title  = {ZSDEVC: Zero-Shot Diffusion-based Emotional Voice Conversion with Disentangled Mechanism},
  author = {Hsing-Hang Chou and Yun-Shao Lin and Ching-Chin Sung and Yu Tsao and Chi-Chun Lee},
  journal= {arXiv preprint arXiv:2409.03636},
  year   = {2025}
}

Comments

5 pages; Proceedings of Interspeech

R2 v1 2026-06-28T18:35:30.175Z