English
Related papers

Related papers: SpokenUS: A Spoken User Simulator for Task-Oriente…

200 papers

$ $Dialogue systems are evaluated depending on their type and purpose. Two categories are often distinguished: (1) task-oriented dialogue systems (TDS), which are typically evaluated on utility, i.e., their ability to complete a specified…

Information Retrieval · Computer Science 2022-04-27 Clemencia Siro , Mohammad Aliannejadi , Maarten de Rijke

Recently, pre-training methods have shown remarkable success in task-oriented dialog (TOD) systems. However, most existing pre-trained models for TOD focus on either dialog understanding or dialog generation, but not both. In this paper, we…

Computation and Language · Computer Science 2022-09-15 Wanwei He , Yinpei Dai , Min Yang , Jian Sun , Fei Huang , Luo Si , Yongbin Li

We propose a novel problem within end-to-end learning of task-oriented dialogs (TOD), in which the dialog system mimics a troubleshooting agent who helps a user by diagnosing their problem (e.g., car not starting). Such dialogs are grounded…

Computation and Language · Computer Science 2021-12-08 Dinesh Raghu , Shantanu Agarwal , Sachindra Joshi , Mausam

We introduce TacoBot, a user-centered task-oriented digital assistant designed to guide users through complex real-world tasks with multiple steps. Covering a wide range of cooking and how-to tasks, we aim to deliver a collaborative and…

Computation and Language · Computer Science 2023-08-01 Lingbo Mo , Shijie Chen , Ziru Chen , Xiang Deng , Ashley Lewis , Sunit Singh , Samuel Stevens , Chang-You Tai , Zhen Wang , Xiang Yue , Tianshu Zhang , Yu Su , Huan Sun

Embodied agents need to be able to interact in natural language understanding task descriptions and asking appropriate follow up questions to obtain necessary information to be effective at successfully accomplishing tasks for a wide range…

Computation and Language · Computer Science 2022-09-28 Spandana Gella , Aishwarya Padmakumar , Patrick Lange , Dilek Hakkani-Tur

Due to the significance and value in human-computer interaction and natural language processing, task-oriented dialog systems are attracting more and more attention in both academic and industrial communities. In this paper, we survey…

Computation and Language · Computer Science 2020-06-24 Zheng Zhang , Ryuichi Takanobu , Qi Zhu , Minlie Huang , Xiaoyan Zhu

Medical task-oriented dialogue systems can assist doctors by collecting patient medical history, aiding in diagnosis, or guiding treatment selection, thereby reducing doctor burnout and expanding access to medical services. However,…

Computation and Language · Computer Science 2024-10-21 Vishal Vivek Saley , Goonjan Saha , Rocktim Jyoti Das , Dinesh Raghu , Mausam

Clarifying user needs is essential for existing task-oriented dialogue systems. However, in real-world applications, developers can never guarantee that all possible user demands are taken into account in the design phase. Consequently,…

Computation and Language · Computer Science 2019-06-13 Weikang Wang , Jiajun Zhang , Qian Li , Mei-Yuh Hwang , Chengqing Zong , Zhifei Li

In real-world task-oriented dialogue (TOD) settings, agents are required to strictly adhere to complex instructions while conducting multi-turn conversations with customers. These instructions are typically presented in natural language…

Computation and Language · Computer Science 2025-11-21 Sarik Ghazarian , Abhinav Gullapalli , Swair Shah , Anurag Beniwal , Nanyun Peng , Narayanan Sadagopan , Zhou Yu

Self-supervised learning (SSL) has helped extend speech technologies to more languages by reducing the need for labeled data. However, models are still far from supporting the world's 7000+ languages. We propose XEUS, a Cross-lingual…

Computation and Language · Computer Science 2024-07-03 William Chen , Wangyou Zhang , Yifan Peng , Xinjian Li , Jinchuan Tian , Jiatong Shi , Xuankai Chang , Soumi Maiti , Karen Livescu , Shinji Watanabe

We present the first complete spoken dialogue system driven by a multi-dimensional statistical dialogue manager. This framework has been shown to substantially reduce data needs by leveraging domain-independent dimensions, such as social…

Computation and Language · Computer Science 2019-09-09 Simon Keizer , Ondřej Dušek , Xingkun Liu , Verena Rieser

Modern task-oriented dialogue (TOD) systems increasingly rely on large language model (LLM) agents, leveraging Retrieval-Augmented Generation (RAG) and long-context capabilities for long-term memory utilization. However, these methods are…

Computation and Language · Computer Science 2025-08-14 Yiming Du , Bingbing Wang , Yang He , Bin Liang , Baojun Wang , Zhongyang Li , Lin Gui , Jeff Z. Pan , Ruifeng Xu , Kam-Fai Wong

Large Language Models (LLMs) with API-calling capabilities enabled building effective Language Agents (LA), while also revolutionizing the conventional task-oriented dialogue (TOD) paradigm. However, current approaches face a critical…

Dialogue systems and large language models (LLMs) have gained considerable attention. However, the direct utilization of LLMs as task-oriented dialogue (TOD) models has been found to underperform compared to smaller task-specific models.…

Computation and Language · Computer Science 2023-10-20 Zhiyuan Hu , Yue Feng , Anh Tuan Luu , Bryan Hooi , Aldo Lipani

With robotics rapidly advancing, more effective human-robot interaction is increasingly needed to realize the full potential of robots for society. While spoken language must be part of the solution, our ability to provide spoken language…

Robotics · Computer Science 2024-03-25 Matthew Marge , Carol Espy-Wilson , Nigel Ward

To advance multi-domain (cross-domain) dialogue modeling as well as alleviate the shortage of Chinese task-oriented datasets, we propose CrossWOZ, the first large-scale Chinese Cross-Domain Wizard-of-Oz task-oriented dataset. It contains 6K…

Computation and Language · Computer Science 2020-03-02 Qi Zhu , Kaili Huang , Zheng Zhang , Xiaoyan Zhu , Minlie Huang

Recent open-domain dialogue models have brought numerous breakthroughs. However, building a chat system is not scalable since it often requires a considerable volume of human-human dialogue data, especially when enforcing features such as…

Computation and Language · Computer Science 2022-05-03 Sanghwan Bae , Donghyun Kwak , Sungdong Kim , Donghoon Ham , Soyoung Kang , Sang-Woo Lee , Woomyoung Park

Existing end-to-end modeling methods for modular task-oriented dialog systems are typically tailored to specific datasets, making it challenging to adapt to new dialog scenarios. In this work, we propose ESAinsTOD, a unified End-to-end…

Computation and Language · Computer Science 2026-03-11 Dechuan Teng , Chunlin Lu , Libo Qin , Wanxiang Che

Recent advancements in Large Language Models (LLMs) have significantly enhanced conversational agents, making them applicable to various fields (e.g., education, entertainment). Despite their progress, the evaluation of the agents often…

Computation and Language · Computer Science 2025-09-29 Jiho Kim , Woosog Chay , Hyeonji Hwang , Daeun Kyung , Hyunseung Chung , Eunbyeol Cho , Yeonsu Kwon , Yohan Jo , Edward Choi

Most existing dialogue corpora and models have been designed to fit into 2 predominant categories : task-oriented dialogues portray functional goals, such as making a restaurant reservation or booking a plane ticket, while…

Computation and Language · Computer Science 2023-11-27 Armand Stricker , Patrick Paroubek