In this paper, we present a solution for providing personalized and instant feedback to English learners through a mobile application, called Flowchase, that is connected to a speech technology able to segment and analyze speech segmental and supra-segmental features. The speech processing pipeline receives linguistic information corresponding to an utterance to analyze along with a speech sample. After validation of the speech sample, a joint forced-alignment and phonetic recognition is performed thanks to a combination of machine learning models based on speech representation learning that provides necessary information for designing a feedback on a series of segmental and supra-segmental pronunciation aspects.
@article{arxiv.2307.02051,
title = {Flowchase: a Mobile Application for Pronunciation Training},
author = {Noé Tits and Zoé Broisson},
journal= {arXiv preprint arXiv:2307.02051},
year = {2023}
}
Comments
Interspeech 2023 - SLaTE workshop 2023 (Speech and Language Technology in Education)