English
Related papers

Related papers: RiSAWOZ: A Large-Scale Multi-Domain Wizard-of-Oz D…

200 papers

Task-oriented dialogue (TOD) systems aim to efficiently handle task-oriented conversations, including information collection. How to utilize TOD accurately, efficiently and effectively for information collection has always been a critical…

Artificial Intelligence · Computer Science 2024-10-15 Ming Zhang , Caishuang Huang , Yilong Wu , Shichun Liu , Huiyuan Zheng , Yurui Dong , Yujiong Shen , Shihan Dou , Jun Zhao , Junjie Ye , Qi Zhang , Tao Gui , Xuanjing Huang

Creating multilingual task-oriented dialogue (TOD) agents is challenging due to the high cost of training data acquisition. Following the research trend of improving training data efficiency, we show for the first time, that in-context…

Semantic Machines (SM) have introduced the use of the dataflow (DF) paradigm to dialogue modelling, using computational graphs to hierarchically represent user requests, data, and the dialogue history [Semantic Machines et al. 2020].…

Computation and Language · Computer Science 2022-11-07 Joram Meron , Victor Guimarães

Learning with minimal data is one of the key challenges in the development of practical, production-ready goal-oriented dialogue systems. In a real-world enterprise setting where dialogue systems are developed rapidly and are expected to…

Computation and Language · Computer Science 2019-08-19 Igor Shalyminov , Sungjin Lee , Arash Eshghi , Oliver Lemon

Task-oriented dialogue systems aim to help users achieve their goals in specific domains. Recent neural dialogue systems use the entire dialogue history for abundant contextual information accumulated over multiple conversational turns.…

Computation and Language · Computer Science 2021-03-12 Hyunmin Jeon , Gary Geunbae Lee

Practical dialog systems need to deal with various knowledge sources, noisy user expressions, and the shortage of annotated data. To better solve the above problems, we propose CGoDial, new challenging and comprehensive Chinese benchmark…

Computation and Language · Computer Science 2022-11-22 Yinpei Dai , Wanwei He , Bowen Li , Yuchuan Wu , Zheng Cao , Zhongqi An , Jian Sun , Yongbin Li

Learning from free-text human feedback is essential for dialog systems, but annotated data is scarce and usually covers only a small fraction of error types known in conversational AI. Instead of collecting and annotating new datasets from…

Computation and Language · Computer Science 2023-10-25 Dominic Petrak , Nafise Sadat Moosavi , Ye Tian , Nikolai Rozanov , Iryna Gurevych

Evaluation is crucial in the development process of task-oriented dialogue systems. As an evaluation method, user simulation allows us to tackle issues such as scalability and cost-efficiency, making it a viable choice for large-scale…

Information Retrieval · Computer Science 2021-05-11 Weiwei Sun , Shuo Zhang , Krisztian Balog , Zhaochun Ren , Pengjie Ren , Zhumin Chen , Maarten de Rijke

Machine learning approaches for building task-oriented dialogue systems require large conversational datasets with labels to train on. We are interested in building task-oriented dialogue systems from human-human conversations, which may be…

Computation and Language · Computer Science 2019-07-09 Shachi Paul , Rahul Goel , Dilek Hakkani-Tür

Tracking dialogue states to better interpret user goals and feed downstream policy learning is a bottleneck in dialogue management. Common practice has been to treat it as a problem of classifying dialogue content into a set of pre-defined…

Artificial Intelligence · Computer Science 2020-06-04 Lizi Liao , Yunshan Ma , Wenqiang Lei , Tat-Seng Chua

Task-oriented dialogue (ToD) benchmarks provide an important avenue to measure progress and develop better conversational agents. However, existing datasets for end-to-end ToD modeling are limited to a single language, hindering the…

Computation and Language · Computer Science 2021-06-08 Zhaojiang Lin , Andrea Madotto , Genta Indra Winata , Peng Xu , Feijun Jiang , Yuxiang Hu , Chen Shi , Pascale Fung

We present CoSQL, a corpus for building cross-domain, general-purpose database (DB) querying dialogue systems. It consists of 30k+ turns plus 10k+ annotated SQL queries, obtained from a Wizard-of-Oz (WOZ) collection of 3k dialogues querying…

Collection of annotated dialogs for training task-oriented dialog systems have been one of the key bottlenecks in improving current models. While dialog response generation has been widely studied on the agent side, it is not evident if…

Computation and Language · Computer Science 2023-10-17 Dustin Axman , Avik Ray , Shubham Garg , Jing Huang

Dialogue act annotations are important to improve response generation quality in task-oriented dialogue systems. However, it can be challenging to use dialogue acts to control response generation in a generalizable way because different…

Computation and Language · Computer Science 2023-08-03 Qingyang Wu , James Gung , Raphael Shu , Yi Zhang

We describe an approach to task-oriented dialogue in which dialogue state is represented as a dataflow graph. A dialogue agent maps each user utterance to a program that extends this graph. Programs include metacomputation operators for…

We describe the adaptation and refinement of a graphical user interface designed to facilitate a Wizard-of-Oz (WoZ) approach to collecting human-robot dialogue data. The data collected will be used to develop a dialogue system for robot…

The goal of this work is to build conversational Question Answering (QA) interfaces for the large body of domain-specific information available in FAQ sites. We present DoQA, a dataset with 2,437 dialogues and 10,917 QA pairs. The dialogues…

Computation and Language · Computer Science 2020-09-08 Jon Ander Campos , Arantxa Otegi , Aitor Soroa , Jan Deriu , Mark Cieliebak , Eneko Agirre

Task-oriented dialogue systems (TODS) have become crucial for users to interact with machines and computers using natural language. One of its key components is the dialogue manager, which guides the conversation towards a good goal for the…

Computation and Language · Computer Science 2023-10-24 Miguel Ángel Medina-Ramírez , Cayetano Guerra-Artal , Mario Hernández-Tejera

Task oriented dialogue systems (TOD) complete particular tasks based on user preferences across natural language interactions. Considering the impressive performance of large language models (LLMs) in natural language processing (NLP)…

Computation and Language · Computer Science 2025-10-08 Arezoo Saedi , Afsaneh Fatemi , Mohammad Ali Nematbakhsh , Sophie Rosset , Anne Vilnat

Dialogue assessment plays a critical role in the development of open-domain dialogue systems. Existing work are uncapable of providing an end-to-end and human-epistemic assessment dataset, while they only provide sub-metrics like coherence…

Computation and Language · Computer Science 2023-10-26 Yukun Zhao , Lingyong Yan , Weiwei Sun , Chong Meng , Shuaiqiang Wang , Zhicong Cheng , Zhaochun Ren , Dawei Yin