English
Related papers

Related papers: User Satisfaction Estimation with Sequential Dialo…

200 papers

We consider a new perspective on dialog state tracking (DST), the task of estimating a user's goal through the course of a dialog. By formulating DST as a semantic parsing task over hierarchical representations, we can incorporate semantic…

Prior work has demonstrated that data augmentation is useful for improving dialogue state tracking. However, there are many types of user utterances, while the prior method only considered the simplest one for augmentation, raising the…

Computation and Language · Computer Science 2022-07-27 Chun-Mao Lai , Ming-Hao Hsu , Chao-Wei Huang , Yun-Nung Chen

$ $Dialogue systems are evaluated depending on their type and purpose. Two categories are often distinguished: (1) task-oriented dialogue systems (TDS), which are typically evaluated on utility, i.e., their ability to complete a specified…

Information Retrieval · Computer Science 2022-04-27 Clemencia Siro , Mohammad Aliannejadi , Maarten de Rijke

An open challenge in constructing dialogue systems is developing methods for automatically learning dialogue strategies from large amounts of unlabelled data. Recent work has proposed Next-Utterance-Classification (NUC) as a surrogate task…

Computation and Language · Computer Science 2016-07-26 Ryan Lowe , Iulian V. Serban , Mike Noseworthy , Laurent Charlin , Joelle Pineau

Spoken Language Understanding (SLU) is a key component of goal oriented dialogue systems that would parse user utterances into semantic frame representations. Traditionally SLU does not utilize the dialogue history beyond the previous…

Computation and Language · Computer Science 2017-07-11 Ankur Bapna , Gokhan Tur , Dilek Hakkani-Tur , Larry Heck

Goal-oriented proactive dialogue systems are designed to guide user conversations seamlessly towards specific objectives by planning a goal-oriented path. However, previous research has focused predominantly on optimizing these paths while…

Computation and Language · Computer Science 2025-06-19 Didi Zhang , Yaxin Fan , Peifeng Li , Qiaoming Zhu

We propose a novel methodology to address dialog learning in the context of goal-oriented conversational systems. The key idea is to quantize the dialog space into clusters and create a language model across the clusters, thus allowing for…

Computation and Language · Computer Science 2018-12-27 R. Chulaka Gunasekara , David Nahamoo , Lazaros C. Polymenakos , Jatin Ganhotra , Kshitij P. Fadnis

Digital assistants are experiencing rapid growth due to their ability to assist users with day-to-day tasks where most dialogues are happening multi-turn. However, evaluating multi-turn dialogues remains challenging, especially at scale. We…

Computation and Language · Computer Science 2021-06-21 Ziming Li , Dookun Park , Julia Kiseleva , Young-Bum Kim , Sungjin Lee

Dialogue level quality estimation is vital for optimizing data driven dialogue management. Current automated methods to estimate turn and dialogue level user satisfaction employ hand-crafted features and rely on complex annotation schemes,…

Computation and Language · Computer Science 2020-10-12 Praveen Kumar Bodigutla , Aditya Tiwari , Josep Valls Vargas , Lazaros Polymenakos , Spyros Matsoukas

Task-oriented Dialog (ToD) systems have to solve multiple subgoals to accomplish user goals, whereas feedback is often obtained only at the end of the dialog. In this work, we propose SUIT (SUbgoal-aware ITerative Training), an iterative…

Computation and Language · Computer Science 2024-11-26 Magdalena Kaiser , Patrick Ernst , György Szarvas

There is an increasing demand for task-oriented dialogue systems which can assist users in various activities such as booking tickets and restaurant reservations. In order to complete dialogues effectively, dialogue policy plays a key role…

Computation and Language · Computer Science 2019-09-23 Tian Lan , Xianling Mao , Heyan Huang

Dialogue management (DM) plays a key role in the quality of the interaction with the user in a task-oriented dialogue system. In most existing approaches, the agent predicts only one DM policy action per turn. This significantly limits the…

Computation and Language · Computer Science 2019-09-02 Lei Shu , Hu Xu , Bing Liu , Piero Molino

Sharing ideas through communication with peers is the primary mode of human interaction. Consequently, extensive research has been conducted in the area of conversational AI, leading to an increase in the availability and diversity of…

Computation and Language · Computer Science 2024-05-24 Shivani Kumar , Sumit Bhatia , Milan Aggarwal , Tanmoy Chakraborty

Recent work in Dialogue Act classification has treated the task as a sequence labeling problem using hierarchical deep neural networks. We build on this prior work by leveraging the effectiveness of a context-aware self-attention mechanism…

Computation and Language · Computer Science 2019-05-07 Vipul Raheja , Joel Tetreault

The task of predicting dialog acts (DA) based on conversational dialog is a key component in the development of conversational agents. Accurately predicting DAs requires a precise modeling of both the conversation and the global tag…

Computation and Language · Computer Science 2020-02-27 Pierre Colombo , Emile Chapuis , Matteo Manica , Emmanuel Vignon , Giovanna Varni , Chloe Clavel

User simulation is a promising approach for automatically training and evaluating conversational information access agents, enabling the generation of synthetic dialogues and facilitating reproducible experiments at scale. However, the…

Information Retrieval · Computer Science 2024-06-28 Nolwenn Bernard , Krisztian Balog

Recent works have shown that generative data augmentation, where synthetic samples generated from deep generative models complement the training dataset, benefit NLP tasks. In this work, we extend this approach to the task of dialog state…

Computation and Language · Computer Science 2020-10-08 Kang Min Yoo , Hanbit Lee , Franck Dernoncourt , Trung Bui , Walter Chang , Sang-goo Lee

Task-oriented conversational systems often use dialogue state tracking to represent the user's intentions, which involves filling in values of pre-defined slots. Many approaches have been proposed, often using task-specific architectures…

Computation and Language · Computer Science 2021-09-17 Chia-Hsuan Lee , Hao Cheng , Mari Ostendorf

Most human interactions occur in the form of spoken conversations where the semantic meaning of a given utterance depends on the context. Each utterance in spoken conversation can be represented by many semantic and speaker attributes, and…

Computation and Language · Computer Science 2023-05-02 Siddhant Arora , Hayato Futami , Emiru Tsunoo , Brian Yan , Shinji Watanabe

User embeddings play a crucial role in user engagement forecasting and personalized services. Recent advances in sequence modeling have sparked interest in learning user embeddings from behavioral data. Yet behavior-based user embedding…

Social and Information Networks · Computer Science 2024-03-21 Zhihan Zhou , Qixiang Fang , Leonardo Neves , Francesco Barbieri , Yozen Liu , Han Liu , Maarten W. Bos , Ron Dotsch