English
Related papers

Related papers: Decoupling entrainment from consistency using deep…

200 papers

Entrainment is a known adaptation mechanism that causes interaction participants to adapt or synchronize their acoustic characteristics. Understanding how interlocutors tend to adapt to each other's speaking style through entrainment…

Audio and Speech Processing · Electrical Eng. & Systems 2019-04-15 Md Nasir , Brian Baucom , Shrikanth Narayanan , Panayiotis Georgiou

Linguistic entrainment is a phenomenon where people tend to mimic each other in conversation. The core instrument to quantify entrainment is a linguistic similarity measure between conversational partners. Most of the current similarity…

Computation and Language · Computer Science 2021-09-07 Mingzhi Yu , Diane Litman , Shuang Ma , Jian Wu

The tendency of people to engage in similar, matching, or synchronized behaviour when interacting is known as entrainment. Many studies examined linguistic (syntactic and lexical structures) and paralinguistic (pitch, intensity)…

Computation and Language · Computer Science 2023-12-29 Jay Kejriwal , Štefan Beňuš

Vocal entrainment is a social adaptation mechanism in human interaction, knowledge of which can offer useful insights to an individual's cognitive-behavioral characteristics. We propose a context-aware approach for measuring vocal…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-08 Rimita Lahiri , Md Nasir , Catherine Lord , So Hyun Kim , Shrikanth Narayanan

Acoustic-prosodic entrainment describes the tendency of humans to align or adapt their speech acoustics to each other in conversation. This alignment of spoken behavior has important implications for conversational success. However,…

Audio and Speech Processing · Electrical Eng. & Systems 2018-07-13 Megan M. Willi , Stephanie A. Borrie , Tyson S. Barrett , Ming Tu , Visar Berisha

Entrainment is the phenomenon by which an interlocutor adapts their speaking style to align with their partner in conversations. It has been found in different dimensions as acoustic, prosodic, lexical or syntactic. In this work, we explore…

Audio and Speech Processing · Electrical Eng. & Systems 2022-12-15 Daxin Tan , Nikos Kargas , David McHardy , Constantinos Papayiannis , Antonio Bonafonte , Marek Strelec , Jonas Rohnke , Agis Oikonomou Filandras , Trevor Wood

Encouraged by the success of deep neural networks on a variety of visual tasks, much theoretical and experimental work has been aimed at understanding and interpreting how vision networks operate. Meanwhile, deep neural networks have also…

Machine Learning · Computer Science 2020-03-05 Cory Stephenson , Jenelle Feather , Suchismita Padhy , Oguz Elibol , Hanlin Tang , Josh McDermott , SueYeon Chung

Speakers tend to engage in adaptive behavior, known as entrainment, when they become similar to their interlocutor in various aspects of speaking. We present an unsupervised deep learning framework that derives meaningful representation…

Computation and Language · Computer Science 2023-12-27 Jay Kejriwal , Stefan Benus , Lina M. Rojas-Barahona

Coherent discourse is distinguished from a mere collection of utterances by the satisfaction of a diverse set of constraints, for example choice of expression, logical relation between denoted events, and implicit compatibility with…

Computation and Language · Computer Science 2021-05-11 Anne Beyer , Sharid Loáiciga , David Schlangen

We present persona-based models for handling the issue of speaker consistency in neural response generation. A speaker model encodes personas in distributed embeddings that capture individual characteristics such as background information…

Computation and Language · Computer Science 2016-06-09 Jiwei Li , Michel Galley , Chris Brockett , Georgios P. Spithourakis , Jianfeng Gao , Bill Dolan

In this paper, we propose an effective training strategy to ex-tract robust speaker representations from a speech signal. Oneof the key challenges in speaker recognition tasks is to learnlatent representations or embeddings containing…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-05 Yoohwan Kwon , Soo-Whan Chung , Hong-Goo Kang

Disentanglement is the task of learning representations that identify and separate factors that explain the variation observed in data. Disentangled representations are useful to increase the generalizability, explainability, and fairness…

Audio and Speech Processing · Electrical Eng. & Systems 2023-08-09 Michael Kuhlmann , Adrian Meise , Fritz Seebauer , Petra Wagner , Reinhold Haeb-Umbach

The primary characteristic of robust speaker representations is that they are invariant to factors of variability not related to speaker identity. Disentanglement of speaker representations is one of the techniques used to improve…

Audio and Speech Processing · Electrical Eng. & Systems 2020-04-09 Raghuveer Peri , Haoqi Li , Krishna Somandepalli , Arindam Jati , Shrikanth Narayanan

Learning speaker-specific features is vital in many applications like speaker recognition, diarization and speech recognition. This paper provides a novel approach, we term Neural Predictive Coding (NPC), to learn speaker-specific…

Sound · Computer Science 2019-07-18 Arindam Jati , Panayiotis Georgiou

Deep neural networks have shown recent promise in many language-related tasks such as the modeling of conversations. We extend RNN-based sequence to sequence models to capture the long range discourse across many turns of conversation. We…

Computation and Language · Computer Science 2016-07-18 John M. Pierre , Mark Butler , Jacob Portnoff , Luis Aguilar

Generating responses that are consistent with the dialogue context is one of the central challenges in building engaging conversational agents. We demonstrate that neural conversation models can be geared towards generating consistent…

Computation and Language · Computer Science 2021-08-13 Yizhe Zhang , Xiang Gao , Sungjin Lee , Chris Brockett , Michel Galley , Jianfeng Gao , Bill Dolan

In this work, we systematically investigate how well current models of coherence can capture aspects of text implicated in discourse organisation. We devise two datasets of various linguistic alterations that undermine coherence and test…

Computation and Language · Computer Science 2020-11-13 Youmna Farag , Josef Valvoda , Helen Yannakoudakis , Ted Briscoe

In spoken conversations, spontaneous behaviors like filled pause and prolongations always happen. Conversational partner tends to align features of their speech with their interlocutor which is known as entrainment. To produce human-like…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-22 Jian Cong , Shan Yang , Na Hu , Guangzhi Li , Lei Xie , Dan Su

In traditional software programs, it is easy to trace program logic from variables back to input, apply assertion statements to block erroneous behavior, and compose programs together. Although deep learning programs have demonstrated…

Machine Learning · Computer Science 2021-10-27 Mike Wu , Noah Goodman , Stefano Ermon

We address the problem of inferring a speaker's level of certainty based on prosodic information in the speech signal, which has application in speech-based dialogue systems. We show that using phrase-level prosodic features centered around…

Computation and Language · Computer Science 2011-03-11 Heather Pon-Barry , Stuart M. Shieber
‹ Prev 1 2 3 10 Next ›