English
Related papers

Related papers: Bootstrapping incremental dialogue systems: using …

200 papers

In this paper, we propose to use deep policy networks which are trained with an advantage actor-critic method for statistically optimised dialogue systems. First, we show that, on summary state and action spaces, deep Reinforcement Learning…

Computation and Language · Computer Science 2016-09-13 Mehdi Fatemi , Layla El Asri , Hannes Schulz , Jing He , Kaheer Suleman

Efficient skill acquisition, representation, and on-line adaptation to different scenarios has become of fundamental importance for assistive robotic applications. In the past decade, dynamical systems (DS) have arisen as a flexible and…

Robotics · Computer Science 2020-03-27 Matteo Saveriano , Dongheui Lee

Current state-of-the-art neural dialogue models learn from human conversations following the data-driven paradigm. As such, a reliable training corpus is the crux of building a robust and well-behaved dialogue model. However, due to the…

Computation and Language · Computer Science 2020-06-12 Hengyi Cai , Hongshen Chen , Yonghao Song , Cheng Zhang , Xiaofang Zhao , Dawei Yin

We introduce RLDS (Reinforcement Learning Datasets), an ecosystem for recording, replaying, manipulating, annotating and sharing data in the context of Sequential Decision Making (SDM) including Reinforcement Learning (RL), Learning from…

In this paper, we study the problem of data augmentation for language understanding in task-oriented dialogue system. In contrast to previous work which augments an utterance without considering its relation with other utterances, we…

Computation and Language · Computer Science 2018-07-05 Yutai Hou , Yijia Liu , Wanxiang Che , Ting Liu

In this paper, we propose an incremental learning method for end-to-end Automatic Speech Recognition (ASR) which enables an ASR system to perform well on new tasks while maintaining the performance on its originally learned ones. To…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-17 Li Fu , Xiaoxiao Li , Libo Zi , Zhengchen Zhang , Youzheng Wu , Xiaodong He , Bowen Zhou

The dialogue management component of a task-oriented dialogue system is typically optimised via reinforcement learning (RL). Optimisation via RL is highly susceptible to sample inefficiency and instability. The hierarchical approach called…

To improve user engagement during conversations with dialogue systems, we must improve individual dialogue responses and dialogue impressions such as consistency, personality, and empathy throughout the entire dialogue. While such dialogue…

Computation and Language · Computer Science 2025-01-28 Kai Yoshida , Masahiro Mizukami , Seiya Kawano , Canasai Kruengkrai , Hiroaki Sugiyama , Koichiro Yoshino

Long-tail question answering presents significant challenges for large language models (LLMs) due to their limited ability to acquire and accurately recall less common knowledge. Retrieval-augmented generation (RAG) systems have shown great…

Computation and Language · Computer Science 2026-02-20 Yiming Zhang , Siyue Zhang , Junbo Zhao , Chen Zhao

End-to-end multi-task dialogue systems are usually designed with separate modules for the dialogue pipeline. Among these, the policy module is essential for deciding what to do in response to user input. This policy is trained by…

Computation and Language · Computer Science 2024-03-27 Navin Kamuni , Hardik Shah , Sathishkumar Chintala , Naveen Kunchakuri , Sujatha Alla Old Dominion

Implicit Discourse Relation Recognition (IDRR), which infers discourse relations without the help of explicit connectives, is still a crucial and challenging task for discourse parsing. Recent works tend to exploit the hierarchical…

Computation and Language · Computer Science 2023-11-02 Chenxu Wang , Ping Jian , Mu Huang

Building user trust in dialogue agents requires smooth and consistent dialogue exchanges. However, agents can easily lose conversational context and generate irrelevant utterances. These situations are called dialogue breakdown, where agent…

Computation and Language · Computer Science 2023-01-23 Nathan Ng , Marzyeh Ghassemi , Narendran Thangarajan , Jiacheng Pan , Qi Guo

To train a statistical spoken dialogue system (SDS) it is essential that an accurate method for measuring task success is available. To date training has relied on presenting a task to either simulated or paid users and inferring the…

Machine Learning · Computer Science 2015-08-17 Pei-Hao Su , David Vandyke , Milica Gasic , Dongho Kim , Nikola Mrksic , Tsung-Hsien Wen , Steve Young

Iterative RAG for multi-hop question answering faces challenges with lengthy contexts and the buildup of irrelevant information. This hinders a model's capacity to process and reason over retrieved content and limits performance. While…

We describe a two-step approach for dialogue management in task-oriented spoken dialogue systems. A unified neural network framework is proposed to enable the system to first learn by supervision from a set of dialogue data and then…

Computation and Language · Computer Science 2016-06-09 Pei-Hao Su , Milica Gasic , Nikola Mrksic , Lina Rojas-Barahona , Stefan Ultes , David Vandyke , Tsung-Hsien Wen , Steve Young

Recently several deep learning based models have been proposed for end-to-end learning of dialogs. While these models can be trained from data without the need for any additional annotations, it is hard to interpret them. On the other hand,…

Artificial Intelligence · Computer Science 2018-11-05 Dhiraj Madan , Dinesh Raghu , Gaurav Pandey , Sachindra Joshi

Collection of annotated dialogs for training task-oriented dialog systems have been one of the key bottlenecks in improving current models. While dialog response generation has been widely studied on the agent side, it is not evident if…

Computation and Language · Computer Science 2023-10-17 Dustin Axman , Avik Ray , Shubham Garg , Jing Huang

Natural-language dialog is key for intuitive human-robot interaction. It can be used not only to express humans' intents, but also to communicate instructions for improvement if a robot does not understand a command correctly. Of great…

Robotics · Computer Science 2024-10-14 Leonard Bärmann , Rainer Kartmann , Fabian Peller-Konrad , Jan Niehues , Alex Waibel , Tamim Asfour

The performance of adversarial dialogue generation models relies on the quality of the reward signal produced by the discriminator. The reward signal from a poor discriminator can be very sparse and unstable, which may lead the generator to…

Computation and Language · Computer Science 2018-12-11 Ziming Li , Julia Kiseleva , Maarten de Rijke

Data augmentation methods have been a promising direction to improve the performance of small models for low-resource dialogue state tracking. However, traditional methods rely on pre-defined user goals and neglect the importance of data…

Computation and Language · Computer Science 2024-06-14 Ming Gu , Yan Yang