English
Related papers

Related papers: Dialogue Evaluation with Offline Reinforcement Lea…

200 papers

Conventionally, generation of natural language for dialogue agents may be viewed as a statistical learning problem: determine the patterns in human-provided data and generate appropriate responses with similar statistical properties.…

Computation and Language · Computer Science 2022-04-19 Siddharth Verma , Justin Fu , Mengjiao Yang , Sergey Levine

How can we train a dialog model to produce better conversations by learning from human feedback, without the risk of humans teaching it harmful chat behaviors? We start by hosting models online, and gather human feedback from real-time,…

In this work, we present a hybrid learning method for training task-oriented dialogue systems through online user interactions. Popular methods for learning task-oriented dialogues include applying reinforcement learning with user feedback…

Computation and Language · Computer Science 2018-04-19 Bing Liu , Gokhan Tur , Dilek Hakkani-Tur , Pararth Shah , Larry Heck

Maintaining a consistent persona is a key quality for any open domain dialogue system. Current state-of-the-art systems do this by training agents with supervised learning or online reinforcement learning (RL). However, systems trained with…

Computation and Language · Computer Science 2023-10-18 Ryan Shea , Zhou Yu

In this paper, we present a neural network based task-oriented dialogue system that can be optimized end-to-end with deep reinforcement learning (RL). The system is able to track dialogue state, interface with knowledge bases, and…

Computation and Language · Computer Science 2017-12-04 Bing Liu , Gokhan Tur , Dilek Hakkani-Tur , Pararth Shah , Larry Heck

Current research in dialogue systems is focused on conversational assistants working on short conversations in either task-oriented or open domain settings. In this paper, we focus on improving task-based conversational assistants online,…

Computation and Language · Computer Science 2021-10-06 Ruijie Zhou , Soham Deshmukh , Jeremiah Greer , Charles Lee

Dialogue Policy Learning is a key component in a task-oriented dialogue system (TDS) that decides the next action of the system given the dialogue state at each turn. Reinforcement Learning (RL) is commonly chosen to learn the dialogue…

Computation and Language · Computer Science 2023-11-09 Wai-Chung Kwan , Hongru Wang , Huimin Wang , Kam-Fai Wong

In this work, we propose an adversarial learning method for reward estimation in reinforcement learning (RL) based task-oriented dialog models. Most of the current RL based task-oriented dialog systems require the access to a reward signal…

Computation and Language · Computer Science 2018-05-31 Bing Liu , Ian Lane

Dialogue policy learning for task-oriented dialogue systems has enjoyed great progress recently mostly through employing reinforcement learning methods. However, these approaches have become very sophisticated. It is time to re-evaluate it.…

Computation and Language · Computer Science 2020-09-22 Ziming Li , Julia Kiseleva , Maarten de Rijke

A common training technique for language models is teacher forcing (TF). TF attempts to match human language exactly, even though identical meanings can be expressed in different ways. This motivates use of sequence-level objectives for…

Computation and Language · Computer Science 2023-07-25 Paloma Sodhi , Felix Wu , Ethan R. Elenberg , Kilian Q. Weinberger , Ryan McDonald

Most prior work in dialogue modeling has been on written conversations mostly because of existing data sets. However, written dialogues are not sufficient to fully capture the nature of spoken conversations as well as the potential speech…

Computation and Language · Computer Science 2021-09-29 Seokhwan Kim , Yang Liu , Di Jin , Alexandros Papangelis , Karthik Gopalakrishnan , Behnam Hedayatnia , Dilek Hakkani-Tur

This review gives an extensive overview of evaluation methods for task-oriented dialogue systems, paying special attention to practical applications of dialogue systems, for example for customer service. The review (1) provides an overview…

Computation and Language · Computer Science 2024-04-09 Anouck Braggaar , Christine Liebrecht , Emiel van Miltenburg , Emiel Krahmer

For task-oriented dialog systems to be maximally useful, it must be able to process conversations in a way that is (1) generalizable with a small number of training examples for new task domains, and (2) robust to user input in various…

Computation and Language · Computer Science 2021-01-01 Baolin Peng , Chunyuan Li , Zhu Zhang , Chenguang Zhu , Jinchao Li , Jianfeng Gao

Dialogue assistants are rapidly becoming an indispensable daily aid. To avoid the significant effort needed to hand-craft the required dialogue flow, the Dialogue Management (DM) module can be cast as a continuous Markov Decision Process…

Learning a goal-oriented dialog policy is generally performed offline with supervised learning algorithms or online with reinforcement learning (RL). Additionally, as companies accumulate massive quantities of dialog transcripts between…

Artificial Intelligence · Computer Science 2017-12-11 Li Zhou , Kevin Small , Oleg Rokhlenko , Charles Elkan

We describe a two-step approach for dialogue management in task-oriented spoken dialogue systems. A unified neural network framework is proposed to enable the system to first learn by supervision from a set of dialogue data and then…

Computation and Language · Computer Science 2016-06-09 Pei-Hao Su , Milica Gasic , Nikola Mrksic , Lina Rojas-Barahona , Stefan Ultes , David Vandyke , Tsung-Hsien Wen , Steve Young

In reinforcement learning (RL) research, it is common to assume access to direct online interactions with the environment. However in many real-world applications, access to the environment is limited to a fixed offline dataset of logged…

Machine Learning · Computer Science 2019-11-27 Yifan Wu , George Tucker , Ofir Nachum

Task-oriented dialogue (TOD) systems aim to achieve specific goals through interactive dialogue. Such tasks usually involve following specific workflows, i.e. executing a sequence of actions in a particular order. While prior work has…

Computation and Language · Computer Science 2023-11-15 Do June Min , Paloma Sodhi , Ramya Ramakrishnan

To train a statistical spoken dialogue system (SDS) it is essential that an accurate method for measuring task success is available. To date training has relied on presenting a task to either simulated or paid users and inferring the…

Machine Learning · Computer Science 2015-08-17 Pei-Hao Su , David Vandyke , Milica Gasic , Dongho Kim , Nikola Mrksic , Tsung-Hsien Wen , Steve Young

Offline-to-online (O2O) reinforcement learning (RL) provides an effective means of leveraging an offline pre-trained policy as initialization to improve performance rapidly with limited online interactions. Recent studies often design…

Machine Learning · Computer Science 2024-12-30 Qin-Wen Luo , Ming-Kun Xie , Ye-Wen Wang , Sheng-Jun Huang
‹ Prev 1 2 3 10 Next ›