English
Related papers

Related papers: Is MultiWOZ a Solved Task? An Interactive TOD Eval…

200 papers

Teaching machines to accomplish tasks by conversing naturally with humans is challenging. Currently, developing task-oriented dialogue systems requires creating multiple components and typically this involves either a large amount of…

Computation and Language · Computer Science 2017-04-25 Tsung-Hsien Wen , David Vandyke , Nikola Mrksic , Milica Gasic , Lina M. Rojas-Barahona , Pei-Hao Su , Stefan Ultes , Steve Young

Task-oriented proactive dialogue agents play a pivotal role in recruitment, particularly for steering conversations towards specific business outcomes, such as acquiring social-media contacts for private-channel conversion. Although…

Artificial Intelligence · Computer Science 2026-01-09 Zhiyong Cao , Dunqiang Liu , Qi Dai , Haojun Xu , Huaiyan Xu , Huan He , Yafei Liu , Siyuan Liu , XiaoLin Lin , Ke Ma , Ruqian Shi , Sijia Yao , Hao Wang , Sicheng Zhou

A significant application of Large Language Models (LLMs), like ChatGPT, is their deployment as chat agents, which respond to human inquiries across a variety of domains. While current LLMs proficiently answer general questions, they often…

Computation and Language · Computer Science 2024-04-16 Lang Cao

State of the art models in intent induction require annotated datasets. However, annotating dialogues is time-consuming, laborious and expensive. In this work, we propose a completely unsupervised framework for intent induction within a…

Computation and Language · Computer Science 2023-07-31 Rita Costa , Bruno Martins , Sérgio Viana , Luisa Coheur

Task-oriented dialogue systems -- handling transactions, reservations, and service requests -- require predictable behavior, yet the moderately-sized LLMs needed for practical latency are prone to hallucination and format errors that…

Task-oriented conversational systems are essential for efficiently addressing diverse user needs, yet their development requires substantial amounts of high-quality conversational data that is challenging and costly to obtain. While large…

Information Retrieval · Computer Science 2025-11-06 Zhefan Wang , Ning Geng , Zhiqiang Guo , Weizhi Ma , Min Zhang

As a recent development, task-oriented dialogues (TODs) have been enriched with chitchat in an effort to make dialogues more diverse and engaging. This enhancement is particularly valuable as TODs are often confined to narrow domains,…

Computation and Language · Computer Science 2024-01-26 Armand Stricker , Patrick Paroubek

Dialogue state tracking (DST) aims to extract essential information from multi-turn dialogue situations and take appropriate actions. A belief state, one of the core pieces of information, refers to the subject and its specific content, and…

Computation and Language · Computer Science 2022-04-01 Takyoung Kim , Hoonsang Yoon , Yukyung Lee , Pilsung Kang , Misuk Kim

Many task-oriented dialogue systems use deep reinforcement learning (DRL) to learn policies that respond to the user appropriately and complete the tasks successfully. Training DRL agents with diverse dialogue trajectories prepare them well…

Computation and Language · Computer Science 2021-06-10 Zhiwen Tang , Hrishikesh Kulkarni , Grace Hui Yang

Recent works have shown considerable improvements in task-oriented dialogue (TOD) systems by utilizing pretrained large language models (LLMs) in an end-to-end manner. However, the biased behavior of each component in a TOD system and the…

Computation and Language · Computer Science 2023-11-15 Hsuan Su , Rebecca Qian , Chinnadhurai Sankar , Shahin Shayandeh , Shang-Tse Chen , Hung-yi Lee , Daniel M. Bikel

Tuning language models for dialogue generation has been a prevalent paradigm for building capable dialogue agents. Yet, traditional tuning narrowly views dialogue generation as resembling other language generation tasks, ignoring the role…

Computation and Language · Computer Science 2024-05-31 Jian Wang , Chak Tou Leong , Jiashuo Wang , Dongding Lin , Wenjie Li , Xiao-Yong Wei

In ad-hoc retrieval, evaluation relies heavily on user actions, including implicit feedback. In a conversational setting such signals are usually unavailable due to the nature of the interactions, and, instead, the evaluation often relies…

Information Retrieval · Computer Science 2024-05-01 Clemencia Siro , Mohammad Aliannejadi , Maarten de Rijke

Training task-oriented dialogue systems typically requires turn-level annotations for interacting with their APIs: e.g. a dialogue state and the system actions taken at each step. These annotations can be costly to produce, error-prone, and…

Computation and Language · Computer Science 2024-10-17 Brendan King , Jeffrey Flanigan

Most prior work in dialogue modeling has been on written conversations mostly because of existing data sets. However, written dialogues are not sufficient to fully capture the nature of spoken conversations as well as the potential speech…

Computation and Language · Computer Science 2021-09-29 Seokhwan Kim , Yang Liu , Di Jin , Alexandros Papangelis , Karthik Gopalakrishnan , Behnam Hedayatnia , Dilek Hakkani-Tur

In task-oriented dialogue (TOD) systems, Slot Schema Induction (SSI) is essential for automatically identifying key information slots from dialogue data without manual intervention. This paper presents a novel state-of-the-art (SoTA)…

Computation and Language · Computer Science 2025-04-28 James D. Finch , Yasasvi Josyula , Jinho D. Choi

Based on the recently proposed transferable dialogue state generator (TRADE) that predicts dialogue states from utterance-concatenated dialogue context, we propose a multi-task learning model with a simple yet effective utterance tagging…

Computation and Language · Computer Science 2020-04-30 Jun Quan , Deyi Xiong

Dialogue policy learning, a subtask that determines the content of system response generation and then the degree of task completion, is essential for task-oriented dialogue systems. However, the unbalanced distribution of system actions in…

Computation and Language · Computer Science 2021-06-29 Yunhao Li , Yunyi Yang , Xiaojun Quan , Jianxing Yu

There is a growing interest in developing goal-oriented dialog systems which serve users in accomplishing complex tasks through multi-turn conversations. Although many methods are devised to evaluate and improve the performance of…

Computation and Language · Computer Science 2020-05-18 Ryuichi Takanobu , Qi Zhu , Jinchao Li , Baolin Peng , Jianfeng Gao , Minlie Huang

Evaluating the quality of multi-turn chatbot interactions remains challenging, as most existing methods assess interactions at the turn level without addressing whether a user's overarching goal was fulfilled. A ``goal'' here refers to an…

Artificial Intelligence · Computer Science 2025-10-07 Deepak Babu Piskala , Sharlene Chen , Udita Patel , Parul Kalra , Rafael Castrillo

Previous attempts to build effective semantic parsers for Wizard-of-Oz (WOZ) conversations suffer from the difficulty in acquiring a high-quality, manually annotated training set. Approaches based only on dialogue synthesis are…

Computation and Language · Computer Science 2022-04-11 Giovanni Campagna , Sina J. Semnani , Ryan Kearns , Lucas Jun Koba Sato , Silei Xu , Monica S. Lam