English
Related papers

Related papers: Dialogue Coherence Assessment Without Explicit Dia…

200 papers

Recognising dialogue acts (DA) is important for many natural language processing tasks such as dialogue generation and intention recognition. In this paper, we propose a dual-attention hierarchical recurrent neural network for DA…

Computation and Language · Computer Science 2019-10-11 Ruizhe Li , Chenghua Lin , Matthew Collinson , Xiao Li , Guanyi Chen

We present three enhancements to existing encoder-decoder models for open-domain conversational agents, aimed at effectively modeling coherence and promoting output diversity: (1) We introduce a measure of coherence as the GloVe embedding…

Computation and Language · Computer Science 2018-11-22 Xinnuo Xu , Ondřej Dušek , Ioannis Konstas , Verena Rieser

Dialogue data has been a key source for understanding learning processes, offering critical insights into how students engage in collaborative discussions and how these interactions shape their knowledge construction. The advent of Large…

Computation and Language · Computer Science 2025-04-29 Ying Na , Shihui Feng

We investigate evaluation metrics for dialogue response generation systems where supervised labels, such as task completion, are not available. Recent works in response generation have adopted metrics from machine translation to compare a…

Computation and Language · Computer Science 2017-01-04 Chia-Wei Liu , Ryan Lowe , Iulian V. Serban , Michael Noseworthy , Laurent Charlin , Joelle Pineau

Automatically evaluating text-based, non-task-oriented dialogue systems (i.e., `chatbots') remains an open problem. Previous approaches have suffered challenges ranging from poor correlation with human judgment to poor generalization and…

Computation and Language · Computer Science 2021-04-14 Ian Berlot-Attwell , Frank Rudzicz

In this work, we evaluate various existing dialogue relevance metrics, find strong dependency on the dataset, often with poor correlation with human scores of relevance, and propose modifications to reduce data requirements and domain…

Computation and Language · Computer Science 2022-06-07 Ian Berlot-Attwell , Frank Rudzicz

We present a joint modeling approach to identify salient discussion points in spoken meetings as well as to label the discourse relations between speaker turns. A variation of our model is also discussed when discourse relations are treated…

Computation and Language · Computer Science 2017-05-16 Kechen Qin , Lu Wang , Joseph Kim

We present an empirical investigation of various ways to automatically identify phrases in a tagged corpus that are useful for dialogue act tagging. We found that a new method (which measures a phrase's deviation from an…

Artificial Intelligence · Computer Science 2007-05-23 Ken Samuel , Sandra Carberry , K. Vijay-Shanker

The task of joint dialog sentiment classification (DSC) and act recognition (DAR) aims to simultaneously predict the sentiment label and act label for each utterance in a dialog. In this paper, we put forward a new framework which models…

Computation and Language · Computer Science 2022-03-09 Bowen Xing , Ivor W. Tsang

Encoder-decoder based neural architectures serve as the basis of state-of-the-art approaches in end-to-end open domain dialog systems. Since most of such systems are trained with a maximum likelihood~(MLE) objective they suffer from issues…

An automated metric to evaluate dialogue quality is vital for optimizing data driven dialogue management. The common approach of relying on explicit user feedback during a conversation is intrusive and sparse. Current models to estimate…

Machine Learning · Computer Science 2019-11-21 Praveen Kumar Bodigutla , Lazaros Polymenakos , Spyros Matsoukas

Ever since the successful application of sequence to sequence learning for neural machine translation systems, interest has surged in its applicability towards language generation in other problem domains. Recent work has investigated the…

Computation and Language · Computer Science 2017-10-31 Sharath T. S. , Shubhangi Tandon , Ryan Bauer

Tangled multi-party dialogue contexts lead to challenges for dialogue reading comprehension, where multiple dialogue threads flow simultaneously within a common dialogue record, increasing difficulties in understanding the dialogue history…

Computation and Language · Computer Science 2022-03-16 Xinbei Ma , Zhuosheng Zhang , Hai Zhao

Tuning language models for dialogue generation has been a prevalent paradigm for building capable dialogue agents. Yet, traditional tuning narrowly views dialogue generation as resembling other language generation tasks, ignoring the role…

Computation and Language · Computer Science 2024-05-31 Jian Wang , Chak Tou Leong , Jiashuo Wang , Dongding Lin , Wenjie Li , Xiao-Yong Wei

Coherence of text is an important attribute to be measured for both manually and automatically generated discourse; but well-defined quantitative metrics for it are still elusive. In this paper, we present a metric for scoring topical…

Computation and Language · Computer Science 2018-09-05 Disha Shrivastava , Abhijit Mishra , Karthik Sankaranarayanan

Dialogue Act (DA) classification is the task of classifying utterances with respect to the function they serve in a dialogue. Existing approaches to DA classification model utterances without incorporating the turn changes among speakers…

Computation and Language · Computer Science 2021-09-14 Zihao He , Leili Tavabi , Kristina Lerman , Mohammad Soleymani

Dialog act prediction is an essential language comprehension task for both dialog system building and discourse analysis. Previous dialog act schemes, such as SWBD-DAMSL, are designed for human-human conversations, in which conversation…

Computation and Language · Computer Science 2019-08-28 Dian Yu , Zhou Yu

In task-oriented conversational AI evaluation, unsupervised methods poorly correlate with human judgments, and supervised approaches lack generalization. Recent advances in large language models (LLMs) show robust zeroshot and few-shot…

Computation and Language · Computer Science 2024-06-26 Jinghan Jia , Abi Komma , Timothy Leffel , Xujun Peng , Ajay Nagesh , Tamer Soliman , Aram Galstyan , Anoop Kumar

Recent advances in pre-trained language models have significantly improved neural response generation. However, existing methods usually view the dialogue context as a linear sequence of tokens and learn to generate the next word through…

Computation and Language · Computer Science 2021-12-14 Xiaodong Gu , Kang Min Yoo , Jung-Woo Ha

Spoken language understanding, which extracts intents and/or semantic concepts in utterances, is conventionally formulated as a post-processing of automatic speech recognition. It is usually trained with oracle transcripts, but needs to…

Sound · Computer Science 2020-07-30 Viet-Trung Dang , Tianyu Zhao , Sei Ueno , Hirofumi Inaguma , Tatsuya Kawahara