English

PHONEix: Acoustic Feature Processing Strategy for Enhanced Singing Pronunciation with Phoneme Distribution Predictor

Sound 2023-03-16 v1 Audio and Speech Processing

Abstract

Singing voice synthesis (SVS), as a specific task for generating the vocal singing voice from a music score, has drawn much attention in recent years. SVS faces the challenge that the singing has various pronunciation flexibility conditioned on the same music score. Most of the previous works of SVS can not well handle the misalignment between the music score and actual singing. In this paper, we propose an acoustic feature processing strategy, named PHONEix, with a phoneme distribution predictor, to alleviate the gap between the music score and the singing voice, which can be easily adopted in different SVS systems. Extensive experiments in various settings demonstrate the effectiveness of our PHONEix in both objective and subjective evaluations.

Keywords

Cite

@article{arxiv.2303.08607,
  title  = {PHONEix: Acoustic Feature Processing Strategy for Enhanced Singing Pronunciation with Phoneme Distribution Predictor},
  author = {Yuning Wu and Jiatong Shi and Tao Qian and Dongji Gao and Qin Jin},
  journal= {arXiv preprint arXiv:2303.08607},
  year   = {2023}
}

Comments

Accepted by ICASSP 2023