English
Related papers

Related papers: A Simple Language Model for Task-Oriented Dialogue

200 papers

Data scarcity is one of the main problems when it comes to real-world applications of transformer-based models. This is especially evident for task-oriented dialogue (TOD) systems, which require specialized datasets, that are usually not…

Computation and Language · Computer Science 2025-02-25 Sebastian Steindl , Ulrich Schäfer , Bernd Ludwig

Traditional end-to-end task-oriented dialogue systems have been built with a modularized design. However, such design often causes misalignment between the agent response and external knowledge, due to inadequate representation of…

Computation and Language · Computer Science 2023-05-24 Qingyang Wu , Deema Alnuhait , Derek Chen , Zhou Yu

Target-Oriented Dialogue (TOD) remains a significant challenge in the LLM era, where strategic dialogue planning is crucial for directing conversations toward specific targets. However, existing dialogue planning methods generate dialogue…

Computation and Language · Computer Science 2025-08-12 Hanwen Du , Bo Peng , Xia Ning

Task-oriented dialogue (TOD) systems have been widely deployed in many industries as they deliver more efficient customer support. These systems are typically constructed for a single domain or language and do not generalise well beyond…

Computation and Language · Computer Science 2023-06-21 Nikita Moghe , Evgeniia Razumovskaia , Liane Guillou , Ivan Vulić , Anna Korhonen , Alexandra Birch

Task-oriented dialogue systems (TODS) have become crucial for users to interact with machines and computers using natural language. One of its key components is the dialogue manager, which guides the conversation towards a good goal for the…

Computation and Language · Computer Science 2023-10-24 Miguel Ángel Medina-Ramírez , Cayetano Guerra-Artal , Mario Hernández-Tejera

Learning with minimal data is one of the key challenges in the development of practical, production-ready goal-oriented dialogue systems. In a real-world enterprise setting where dialogue systems are developed rapidly and are expected to…

Computation and Language · Computer Science 2019-08-19 Igor Shalyminov , Sungjin Lee , Arash Eshghi , Oliver Lemon

The design of dialogue flows is a critical but time-consuming task when developing task-oriented dialogue (TOD) systems. We propose an approach for the unsupervised discovery of flows from dialogue history, thus making the process…

Computation and Language · Computer Science 2024-05-03 Patrícia Ferreira , Daniel Martins , Ana Alves , Catarina Silva , Hugo Gonçalo Oliveira

End-to-end Task-Oriented Dialog (TOD) systems typically require extensive training datasets to perform well. In contrast, large language model (LLM) based TOD systems can excel even with limited data due to their ability to learn tasks…

Computation and Language · Computer Science 2024-10-21 Vishal Vivek Saley , Rocktim Jyoti Das , Dinesh Raghu , Mausam

In task-oriented dialogue (ToD), a user holds a conversation with an artificial agent to complete a concrete task. Although this technology represents one of the central objectives of AI and has been the focus of ever more intense research…

Computation and Language · Computer Science 2022-05-27 Evgeniia Razumovskaia , Goran Glavaš , Olga Majewska , Edoardo M. Ponti , Anna Korhonen , Ivan Vulić

End-to-end task-oriented dialogue (EToD) can directly generate responses in an end-to-end fashion without modular training, which attracts escalating popularity. The advancement of deep neural networks, especially the successful use of…

Computation and Language · Computer Science 2023-11-16 Libo Qin , Wenbo Pan , Qiguang Chen , Lizi Liao , Zhou Yu , Yue Zhang , Wanxiang Che , Min Li

Due to the significance and value in human-computer interaction and natural language processing, task-oriented dialog systems are attracting more and more attention in both academic and industrial communities. In this paper, we survey…

Computation and Language · Computer Science 2020-06-24 Zheng Zhang , Ryuichi Takanobu , Qi Zhu , Minlie Huang , Xiaoyan Zhu

One of the major impediments to the development of new task-oriented dialogue (TOD) systems is the need for human evaluation at multiple stages and iterations of the development process. In an effort to move toward automated evaluation of…

Computation and Language · Computer Science 2023-09-26 Sam Davidson , Salvatore Romeo , Raphael Shu , James Gung , Arshit Gupta , Saab Mansour , Yi Zhang

Pre-training models have been proved effective for a wide range of natural language processing tasks. Inspired by this, we propose a novel dialogue generation pre-training framework to support various kinds of conversations, including…

Computation and Language · Computer Science 2020-05-01 Siqi Bao , Huang He , Fan Wang , Hua Wu , Haifeng Wang

Building end-to-end task bots and maintaining their integration with new functionalities using minimal human efforts is a long-standing challenge in dialog research. Recently large language models (LLMs) have demonstrated exceptional…

Computation and Language · Computer Science 2023-05-17 Xiaoying Zhang , Baolin Peng , Kun Li , Jingyan Zhou , Helen Meng

Recent work has shown that self-supervised dialog-specific pretraining on large conversational datasets yields substantial gains over traditional language modeling (LM) pretraining in downstream task-oriented dialog (TOD). These approaches,…

Computation and Language · Computer Science 2022-05-24 Chia-Chien Hung , Anne Lauscher , Simone Paolo Ponzetto , Goran Glavaš

This paper examines various unsupervised pretraining objectives for learning dialog context representations. Two novel methods of pretraining dialog context encoders are proposed, and a total of four methods are examined. Each pretraining…

Computation and Language · Computer Science 2019-06-05 Shikib Mehri , Evgeniia Razumovskaia , Tiancheng Zhao , Maxine Eskenazi

Conditioned dialogue generation suffers from the scarcity of labeled responses. In this work, we exploit labeled non-dialogue text data related to the condition, which are much easier to collect. We propose a multi-task learning approach to…

Computation and Language · Computer Science 2021-04-27 Yan Zeng , Jian-Yun Nie

Task-oriented Dialogue (TOD) Systems aim to build dialogue systems that assist users in accomplishing specific goals, such as booking a hotel or a restaurant. Traditional TODs rely on domain-specific APIs/DBs or external factual knowledge…

Teaching machines to accomplish tasks by conversing naturally with humans is challenging. Currently, developing task-oriented dialogue systems requires creating multiple components and typically this involves either a large amount of…

Computation and Language · Computer Science 2017-04-25 Tsung-Hsien Wen , David Vandyke , Nikola Mrksic , Milica Gasic , Lina M. Rojas-Barahona , Pei-Hao Su , Stefan Ultes , Steve Young

Intent detection is a key part of any Natural Language Understanding (NLU) system of a conversational assistant. Detecting the correct intent is essential yet difficult for email conversations where multiple directives and intents are…

Computation and Language · Computer Science 2022-08-22 Soham Deshmukh , Charles Lee