English
Related papers

Related papers: What Did You Say? Task-Oriented Dialog Datasets Ar…

200 papers

Goal-oriented dialogue systems are now being widely adopted in industry where it is of key importance to maintain a rapid prototyping cycle for new products and domains. Data-driven dialogue system development has to be adapted to meet this…

Computation and Language · Computer Science 2019-10-04 Igor Shalyminov , Sungjin Lee , Arash Eshghi , Oliver Lemon

Existing benchmarks that assess Language Models (LMs) as Language Agents (LAs) for tool use primarily focus on stateless, single-turn interactions or partial evaluations, such as tool selection in a single turn, overlooking the inherent…

Computation and Language · Computer Science 2025-05-20 Hongru Wang , Wenyu Huang , Yufei Wang , Yuanhao Xi , Jianqiao Lu , Huan Zhang , Nan Hu , Zeming Liu , Jeff Z. Pan , Kam-Fai Wong

Most prior work on task-oriented dialogue systems are restricted to a limited coverage of domain APIs, while users oftentimes have domain related requests that are not covered by the APIs. In this paper, we propose to expand coverage of…

Computation and Language · Computer Science 2020-06-08 Seokhwan Kim , Mihail Eric , Karthik Gopalakrishnan , Behnam Hedayatnia , Yang Liu , Dilek Hakkani-Tur

Most of the current task-oriented dialogue systems (ToD), despite having interesting results, are designed for a handful of languages like Chinese and English. Therefore, their performance in low-resource languages is still a significant…

Computation and Language · Computer Science 2022-03-16 Phi Nguyen Van , Tung Cao Hoang , Dung Nguyen Manh , Quan Nguyen Minh , Long Tran Quoc

Recent advancements in Large Language Models (LLMs) have been reshaping Natural Language Processing (NLP) task in several domains. Their use in the field of Human Resources (HR) has still room for expansions and could be beneficial for…

Computation and Language · Computer Science 2024-02-05 Weijie Xu , Zicheng Huang , Wenxiang Hu , Xi Fang , Rajesh Kumar Cherukuri , Naumaan Nayyar , Lorenzo Malandri , Srinivasan H. Sengamedu

Existing goal-oriented dialogue datasets focus mainly on identifying slots and values. However, customer support interactions in reality often involve agents following multi-step procedures derived from explicitly-defined company policies…

Computation and Language · Computer Science 2021-04-05 Derek Chen , Howard Chen , Yi Yang , Alex Lin , Zhou Yu

Non-task oriented dialogue systems have achieved great success in recent years due to largely accessible conversation data and the development of deep learning techniques. Given a context, current systems are able to yield a relevant and…

Computation and Language · Computer Science 2020-04-10 Leyang Cui , Yu Wu , Shujie Liu , Yue Zhang , Ming Zhou

Dialogue systems benefit greatly from optimizing on detailed annotations, such as transcribed utterances, internal dialogue state representations and dialogue act labels. However, collecting these annotations is expensive and…

Computation and Language · Computer Science 2019-11-27 Bo-Hsiang Tseng , Marek Rei , Paweł Budzianowski , Richard E. Turner , Bill Byrne , Anna Korhonen

MultiWOZ is a well-known task-oriented dialogue dataset containing over 10,000 annotated dialogues spanning 8 domains. It is extensively used as a benchmark for dialogue state tracking. However, recent works have reported presence of…

Computation and Language · Computer Science 2020-07-28 Xiaoxue Zang , Abhinav Rastogi , Srinivas Sunkara , Raghav Gupta , Jianguo Zhang , Jindong Chen

Developing language model-based dialogue agents requires effective data to train models that can follow specific task logic. However, most existing data simulation methods focus on increasing diversity in language, topics, or dialogue acts…

Computation and Language · Computer Science 2025-03-04 Wanyu Du , Song Feng , James Gung , Lijia Sun , Yi Zhang , Saab Mansour , Yanjun Qi

The MultiWOZ 2.0 dataset has greatly stimulated the research of task-oriented dialogue systems. However, its state annotations contain substantial noise, which hinders a proper evaluation of model performance. To address this issue, massive…

Computation and Language · Computer Science 2022-07-12 Fanghua Ye , Jarana Manotumruksa , Emine Yilmaz

Dialogue systems are usually categorized into two types, open-domain and task-oriented. The first one focuses on chatting with users and making them engage in the conversations, where selecting a proper topic to fit the dialogue context is…

Computation and Language · Computer Science 2022-04-25 Ssu Chiu , Maolin Li , Yen-Ting Lin , Yun-Nung Chen

Most prior work in dialogue modeling has been on written conversations mostly because of existing data sets. However, written dialogues are not sufficient to fully capture the nature of spoken conversations as well as the potential speech…

Computation and Language · Computer Science 2021-09-29 Seokhwan Kim , Yang Liu , Di Jin , Alexandros Papangelis , Karthik Gopalakrishnan , Behnam Hedayatnia , Dilek Hakkani-Tur

Data artifacts incentivize machine learning models to learn non-transferable generalizations by taking advantage of shortcuts in the data, and there is growing evidence that data artifacts play a role for the strong results that deep…

Computation and Language · Computer Science 2022-05-24 Shiquan Yang , Xinting Huang , Jey Han Lau , Sarah Erfani

Task-oriented dialog systems have witnessed substantial progress due to conversational pre-training techniques. Yet, two significant challenges persist. First, most systems primarily utilize the latest turn's state label for the generator.…

Computation and Language · Computer Science 2024-01-30 Longxiang Liu , Xiuxing Li , Yang Feng

Existing pipelined task-oriented dialogue systems usually have difficulties adapting to unseen domains, whereas end-to-end systems are plagued by large-scale knowledge bases in practice. In this paper, we introduce a novel query-driven…

Computation and Language · Computer Science 2022-10-17 Xin Tian , Yingzhan Lin , Mengfei Song , Siqi Bao , Fan Wang , Huang He , Shuqi Sun , Hua Wu

Task-oriented dialogue systems have been plagued by the difficulties of obtaining large-scale and high-quality annotated conversations. Furthermore, most of the publicly available datasets only include written conversations, which are…

Computation and Language · Computer Science 2021-12-24 Xin Tian , Xinxian Huang , Dongfeng He , Yingzhan Lin , Siqi Bao , Huang He , Liankai Huang , Qiang Ju , Xiyuan Zhang , Jian Xie , Shuqi Sun , Fan Wang , Hua Wu , Haifeng Wang

In spoken Task-Oriented Dialogue (TOD) systems, the choice of the semantic representation describing the users' requests is key to a smooth interaction. Indeed, the system uses this representation to reason over a database and its domain…

Artificial Intelligence · Computer Science 2024-06-21 Lucas Druart , Valentin Vielzeuf , Yannick Estève

Task-oriented dialogue (TOD) systems are required to identify key information from conversations for the completion of given tasks. Such information is conventionally specified in terms of intents and slots contained in task-specific…

Computation and Language · Computer Science 2022-01-25 Jeffrey Zhao , Raghav Gupta , Yuan Cao , Dian Yu , Mingqiu Wang , Harrison Lee , Abhinav Rastogi , Izhak Shafran , Yonghui Wu

Learning from free-text human feedback is essential for dialog systems, but annotated data is scarce and usually covers only a small fraction of error types known in conversational AI. Instead of collecting and annotating new datasets from…

Computation and Language · Computer Science 2023-10-25 Dominic Petrak , Nafise Sadat Moosavi , Ye Tian , Nikolai Rozanov , Iryna Gurevych