English
Related papers

Related papers: Taskmaster-1: Toward a Realistic and Diverse Dialo…

200 papers

We introduce the StatCan Dialogue Dataset consisting of 19,379 conversation turns between agents working at Statistics Canada and online users looking for published data tables. The conversations stem from genuine intents, are held in…

Computation and Language · Computer Science 2024-07-18 Xing Han Lu , Siva Reddy , Harm de Vries

Goal-oriented dialog systems enable users to complete specific goals like requesting information about a movie or booking a ticket. Typically the dialog system pipeline contains multiple ML models, including natural language understanding,…

We present a data-driven, end-to-end approach to transaction-based dialog systems that performs at near-human levels in terms of verbal response quality and factual grounding accuracy. We show that two essential components of the system…

Computation and Language · Computer Science 2020-12-29 Bill Byrne , Karthik Krishnamoorthi , Saravanan Ganesh , Mihir Sanjay Kale

Existing studies in conversational AI mostly treat task-oriented dialog (TOD) and question answering (QA) as separate tasks. Towards the goal of constructing a conversational agent that can complete user tasks and support information…

Computation and Language · Computer Science 2022-06-28 Miaoran Li , Baolin Peng , Jianfeng Gao , Zhu Zhang

Generating spoken dialogue is inherently more complex than monologue text-to-speech (TTS), as it demands both realistic turn-taking and the maintenance of distinct speaker timbres. While existing autoregressive (AR) models have made…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-15 Han Zhu , Wei Kang , Liyong Guo , Zengwei Yao , Fangjun Kuang , Weiji Zhuang , Zhaoqing Li , Zhifeng Han , Dong Zhang , Xin Zhang , Xingchen Song , Lingxuan Ye , Long Lin , Daniel Povey

With the rapid development of large language models, researchers have created increasingly advanced spoken dialogue systems that can naturally converse with humans. However, these systems still struggle to handle the full complexity of…

Computation and Language · Computer Science 2025-01-03 Xize Cheng , Dongjie Fu , Xiaoda Yang , Minghui Fang , Ruofan Hu , Jingyu Lu , Bai Jionghao , Zehan Wang , Shengpeng Ji , Rongjie Huang , Linjun Li , Yu Chen , Tao Jin , Zhou Zhao

The success of large language models has driven interest in developing similar speech processing capabilities. However, a key challenge is the scarcity of high-quality spontaneous speech data, as most existing datasets contain scripted…

Pre-trained conversation models (PCMs) have achieved promising progress in recent years. However, existing PCMs for Task-oriented dialog (TOD) are insufficient for capturing the sequential nature of the TOD-related tasks, as well as for…

Computation and Language · Computer Science 2023-10-03 Lucen Zhong , Hengtong Lu , Caixia Yuan , Xiaojie Wang , Jiashen Sun , Ke Zeng , Guanglu Wan

In this paper, we propose to formulate the task-oriented dialogue system as the purely natural language generation task, so as to fully leverage the large-scale pre-trained models like GPT-2 and simplify complicated delexicalization…

Computation and Language · Computer Science 2022-04-26 Weizhi Wang , Zhirui Zhang , Junliang Guo , Yinpei Dai , Boxing Chen , Weihua Luo

Spoken dialogue systems allow humans to interact with machines using natural speech. As such, they have many benefits. By using speech as the primary communication medium, a computer interface can facilitate swift, human-like acquisition of…

Computation and Language · Computer Science 2016-09-12 Milica Gasic , Nikola Mrksic , Lina M. Rojas-Barahona , Pei-Hao Su , Stefan Ultes , David Vandyke , Tsung-Hsien Wen , Steve Young

We demonstrate that large language models are able to simulate Task Oriented Dialogues in novel domains, provided only with an API implementation and a list of goals. We show these simulations can formulate online, automatic metrics that…

Computation and Language · Computer Science 2021-10-14 Moya Chen , Paul A. Crook , Stephen Roller

Recently, pre-training methods have shown remarkable success in task-oriented dialog (TOD) systems. However, most existing pre-trained models for TOD focus on either dialog understanding or dialog generation, but not both. In this paper, we…

Computation and Language · Computer Science 2022-09-15 Wanwei He , Yinpei Dai , Min Yang , Jian Sun , Fei Huang , Luo Si , Yongbin Li

During the past decade, several areas of speech and language understanding have witnessed substantial breakthroughs from the use of data-driven models. In the area of dialogue systems, the trend is less obvious, and most practical systems…

Computation and Language · Computer Science 2017-03-22 Iulian Vlad Serban , Ryan Lowe , Peter Henderson , Laurent Charlin , Joelle Pineau

Task-oriented dialogue systems aim to help users achieve their goals in specific domains. Recent neural dialogue systems use the entire dialogue history for abundant contextual information accumulated over multiple conversational turns.…

Computation and Language · Computer Science 2021-03-12 Hyunmin Jeon , Gary Geunbae Lee

Acquiring training data to improve the robustness of dialog systems can be a painstakingly long process. In this work, we propose a method to reduce the cost and effort of creating new conversational agents by artificially generating more…

Computation and Language · Computer Science 2022-05-05 Louis Marceau , Raouf Belbahar , Marc Queudot , Nada Naji , Eric Charton , Marie-Jean Meurs

In this paper, we introduce a novel Face-to-Face spoken dialogue model. It processes audio-visual speech from user input and generates audio-visual speech as the response, marking the initial step towards creating an avatar chatbot system…

Computer Vision and Pattern Recognition · Computer Science 2024-08-05 Se Jin Park , Chae Won Kim , Hyeongseop Rha , Minsu Kim , Joanna Hong , Jeong Hun Yeo , Yong Man Ro

We describe a class of tasks called decision-oriented dialogues, in which AI assistants such as large language models (LMs) must collaborate with one or more humans via natural language to help them make complex decisions. We formalize…

Computation and Language · Computer Science 2024-05-07 Jessy Lin , Nicholas Tomlin , Jacob Andreas , Jason Eisner

Creating multilingual task-oriented dialogue (TOD) agents is challenging due to the high cost of training data acquisition. Following the research trend of improving training data efficiency, we show for the first time, that in-context…

Task-oriented dialogue systems aim at providing users with task-specific services. Users of such systems often do not know all the information about the task they are trying to accomplish, requiring them to seek information about the task.…

Computation and Language · Computer Science 2023-05-24 Yue Feng , Hossein A. Rahmani , Aldo Lipani , Emine Yilmaz

Task-oriented dialog presents a difficult challenge encompassing multiple problems including multi-turn language understanding and generation, knowledge retrieval and reasoning, and action prediction. Modern dialog systems typically begin…