Analysis and Utilization of Entrainment on Acoustic and Emotion Features in User-agent Dialogue
Abstract
Entrainment is the phenomenon by which an interlocutor adapts their speaking style to align with their partner in conversations. It has been found in different dimensions as acoustic, prosodic, lexical or syntactic. In this work, we explore and utilize the entrainment phenomenon to improve spoken dialogue systems for voice assistants. We first examine the existence of the entrainment phenomenon in human-to-human dialogues in respect to acoustic feature and then extend the analysis to emotion features. The analysis results show strong evidence of entrainment in terms of both acoustic and emotion features. Based on this findings, we implement two entrainment policies and assess if the integration of entrainment principle into a Text-to-Speech (TTS) system improves the synthesis performance and the user experience. It is found that the integration of the entrainment principle into a TTS system brings performance improvement when considering acoustic features, while no obvious improvement is observed when considering emotion features.
Keywords
Cite
@article{arxiv.2212.03398,
title = {Analysis and Utilization of Entrainment on Acoustic and Emotion Features in User-agent Dialogue},
author = {Daxin Tan and Nikos Kargas and David McHardy and Constantinos Papayiannis and Antonio Bonafonte and Marek Strelec and Jonas Rohnke and Agis Oikonomou Filandras and Trevor Wood},
journal= {arXiv preprint arXiv:2212.03398},
year = {2022}
}
Comments
This version has been removed by arXiv administrators because the submitter did not have the right to assign a license at the time of submission