English
Related papers

Related papers: Improving Dialogue Management: Quality Datasets vs…

200 papers

End-to-end Task-oriented Dialogue Systems (TDSs) have attracted a lot of attention for their superiority (e.g., in terms of global optimization) over pipeline modularized TDSs. Previous studies on end-to-end TDSs use a single-module model…

Computation and Language · Computer Science 2019-07-12 Jiahuan Pei , Pengjie Ren , Maarten de Rijke

Task-oriented dialogue systems have been plagued by the difficulties of obtaining large-scale and high-quality annotated conversations. Furthermore, most of the publicly available datasets only include written conversations, which are…

Computation and Language · Computer Science 2021-12-24 Xin Tian , Xinxian Huang , Dongfeng He , Yingzhan Lin , Siqi Bao , Huang He , Liankai Huang , Qiang Ju , Xiyuan Zhang , Jian Xie , Shuqi Sun , Fan Wang , Hua Wu , Haifeng Wang

The goal of building intelligent dialogue systems has largely been separately pursued under two paradigms: task-oriented dialogue (TOD) systems, which perform goal-oriented functions, and open-domain dialogue (ODD) systems, which focus on…

Computation and Language · Computer Science 2022-04-06 Tom Young , Frank Xing , Vlad Pandelea , Jinjie Ni , Erik Cambria

Large Pre-Trained Language Models have demonstrated state-of-the-art performance in different downstream tasks, including dialogue state tracking and end-to-end response generation. Nevertheless, most of the publicly available datasets and…

Computation and Language · Computer Science 2024-01-05 Seyed Mahed Mousavi , Gabriel Roccabruna , Simone Alghisi , Massimo Rizzoli , Mirco Ravanelli , Giuseppe Riccardi

Traditionally, offline datasets have been used to evaluate task-oriented dialogue (TOD) models. These datasets lack context awareness, making them suboptimal benchmarks for conversational systems. In contrast, user-agents, which are…

Computation and Language · Computer Science 2024-11-18 Taaha Kazi , Ruiliang Lyu , Sizhe Zhou , Dilek Hakkani-Tur , Gokhan Tur

Instruction-tuned language models increasingly rely on large multi-turn dialogue corpora, but these datasets are often noisy and structurally inconsistent, with topic drift, repetitive chitchat, and mismatched answer formats across turns.…

Computation and Language · Computer Science 2026-04-21 Bo Li , Shikun Zhang , Wei Ye

The goal of building intelligent dialogue systems has largely been separately pursued under two motives: task-oriented dialogue (TOD) systems, and open-domain systems for chit-chat (CC). Although previous TOD dialogue systems work well in…

Computation and Language · Computer Science 2022-05-13 Changhong Yu , Chunhong Zhang , Qi Sun

Most task-oriented dialogue (TOD) benchmarks assume users that know exactly how to use the system by constraining the user behaviors within the system's capabilities via strict user goals, namely "user familiarity" bias. This data bias…

Computation and Language · Computer Science 2024-07-02 Takyoung Kim , Jamin Shin , Young-Ho Kim , Sanghwan Bae , Sungdong Kim

To train a statistical spoken dialogue system (SDS) it is essential that an accurate method for measuring task success is available. To date training has relied on presenting a task to either simulated or paid users and inferring the…

Machine Learning · Computer Science 2015-08-17 Pei-Hao Su , David Vandyke , Milica Gasic , Dongho Kim , Nikola Mrksic , Tsung-Hsien Wen , Steve Young

A significant barrier to progress in data-driven approaches to building dialog systems is the lack of high quality, goal-oriented conversational data. To help satisfy this elementary requirement, we introduce the initial release of the…

Task-oriented dialogue (TOD) systems enable users to achieve their goals through natural language interactions. Traditionally, these systems have relied on turn-level manually annotated metadata, such as dialogue states and policy…

Computation and Language · Computer Science 2024-11-05 Adib Mosharrof , A. B. Siddique

Task-oriented dialogue (ToD) benchmarks provide an important avenue to measure progress and develop better conversational agents. However, existing datasets for end-to-end ToD modeling are limited to a single language, hindering the…

Computation and Language · Computer Science 2021-06-08 Zhaojiang Lin , Andrea Madotto , Genta Indra Winata , Peng Xu , Feijun Jiang , Yuxiang Hu , Chen Shi , Pascale Fung

Research on (multi-domain) task-oriented dialog (TOD) has predominantly focused on the English language, primarily due to the shortage of robust TOD datasets in other languages, preventing the systematic investigation of cross-lingual…

Computation and Language · Computer Science 2022-05-24 Chia-Chien Hung , Anne Lauscher , Ivan Vulić , Simone Paolo Ponzetto , Goran Glavaš

Recent advancements in Large Language Models (LLMs) have been reshaping Natural Language Processing (NLP) task in several domains. Their use in the field of Human Resources (HR) has still room for expansions and could be beneficial for…

Computation and Language · Computer Science 2024-02-05 Weijie Xu , Zicheng Huang , Wenxiang Hu , Xi Fang , Rajesh Kumar Cherukuri , Naumaan Nayyar , Lorenzo Malandri , Srinivasan H. Sengamedu

Task-oriented dialogue (TOD) systems are required to identify key information from conversations for the completion of given tasks. Such information is conventionally specified in terms of intents and slots contained in task-specific…

Computation and Language · Computer Science 2022-01-25 Jeffrey Zhao , Raghav Gupta , Yuan Cao , Dian Yu , Mingqiu Wang , Harrison Lee , Abhinav Rastogi , Izhak Shafran , Yonghui Wu

Task-oriented dialogue (TOD) systems are experiencing a revolution driven by Large Language Models (LLMs), yet the evaluation methodologies for these systems remain insufficient for their growing sophistication. While traditional automatic…

Computation and Language · Computer Science 2025-07-17 Emre Can Acikgoz , Carl Guo , Suvodip Dey , Akul Datta , Takyoung Kim , Gokhan Tur , Dilek Hakkani-Tür

The recent development of language models has shown promising results by achieving state-of-the-art performance on various natural language tasks by fine-tuning pretrained models. In task-oriented dialogue (ToD) systems, language models can…

Computation and Language · Computer Science 2022-01-24 Vinsen Marselino Andreas , Genta Indra Winata , Ayu Purwarianti

The task-oriented spoken dialogue system (SDS) aims to assist a human user in accomplishing a specific task (e.g., hotel booking). The dialogue management is a core part of SDS. There are two main missions in dialogue management: dialogue…

Computation and Language · Computer Science 2020-09-23 Zhi Chen , Lu Chen , Xiaoyuan Liu , Kai Yu

Emotions are indispensable in human communication, but are often overlooked in task-oriented dialogue (ToD) modelling, where the task success is the primary focus. While existing works have explored user emotions or similar concepts in some…

Data scarcity is a long-standing and crucial challenge that hinders quick development of task-oriented dialogue systems across multiple domains: task-oriented dialogue models are expected to learn grammar, syntax, dialogue reasoning,…

Computation and Language · Computer Science 2019-08-06 Paweł Budzianowski , Ivan Vulić