English
Related papers

Related papers: Meta Dialogue Policy Learning

200 papers

Statistical spoken dialogue systems usually rely on a single- or multi-domain dialogue model that is restricted in its capabilities of modelling complex dialogue structures, e.g., relations. In this work, we propose a novel dialogue model…

Computation and Language · Computer Science 2019-01-09 Stefan Ultes , Paweł\ Budzianowski , Iñigo Casanueva , Lina Rojas-Barahona , Bo-Hsiang Tseng , Yen-Chen Wu , Steve Young , Milica Gašić

Transferring learned skills across diverse situations remains a fundamental challenge for autonomous agents, particularly when agents are not allowed to interact with an exact target setup. While prior approaches have predominantly focused…

Machine Learning · Computer Science 2024-07-25 Hayato Watahiki , Ryo Iwase , Ryosuke Unno , Yoshimasa Tsuruoka

The development of artificial agents able to learn through dialog without domain restrictions has the potential to allow machines to learn how to perform tasks in a similar manner to humans and change how we relate to them. However,…

Computation and Language · Computer Science 2022-02-08 Eugénio Ribeiro , Ricardo Ribeiro , David Martins de Matos

Parameterised actions in reinforcement learning are composed of discrete actions with continuous action-parameters. This provides a framework for solving complex domains that require combining high-level actions with flexible control. The…

Machine Learning · Computer Science 2019-05-14 Craig J. Bester , Steven D. James , George D. Konidaris

How to build a high-quality multi-domain dialogue system is a challenging work due to its complicated and entangled dialogue state space among each domain, which seriously limits the quality of dialogue policy, and further affects the…

Computation and Language · Computer Science 2020-05-22 Shuke Peng , Feng Ji , Zehao Lin , Shaobo Cui , Haiqing Chen , Yin Zhang

Based on the recently proposed transferable dialogue state generator (TRADE) that predicts dialogue states from utterance-concatenated dialogue context, we propose a multi-task learning model with a simple yet effective utterance tagging…

Computation and Language · Computer Science 2020-04-30 Jun Quan , Deyi Xiong

As an essential component in task-oriented dialogue systems, dialogue state tracking (DST) aims to track human-machine interactions and generate state representations for managing the dialogue. Representations of dialogue states are…

Computation and Language · Computer Science 2022-08-05 Ruolin Su , Ting-Wei Wu , Biing-Hwang Juang

Reinforcement learning (RL) can automate a wide variety of robotic skills, but learning each new skill requires considerable real-world data collection and manual representation engineering to design policy classes or features. Using deep…

Machine Learning · Computer Science 2016-09-23 Coline Devin , Abhishek Gupta , Trevor Darrell , Pieter Abbeel , Sergey Levine

Deep Q-Networks (DQNs) estimate future returns by learning from transitions sampled from a replay buffer. However, the target updates in DQN often rely on next states generated by actions from past, potentially suboptimal, policy. As a…

Machine Learning · Computer Science 2025-11-07 Lipeng Zu , Hansong Zhou , Xiaonan Zhang

Dialog state tracking is a key component of many modern dialog systems, most of which are designed with a single, well-defined domain in mind. This paper shows that dialog data drawn from different dialog domains can be used to train a…

Computation and Language · Computer Science 2015-06-25 Nikola Mrkšić , Diarmuid Ó Séaghdha , Blaise Thomson , Milica Gašić , Pei-Hao Su , David Vandyke , Tsung-Hsien Wen , Steve Young

We introduce a dialogue policy based on a transformer architecture, where the self-attention mechanism operates over the sequence of dialogue turns. Recent work has used hierarchical recurrent neural networks to encode multiple utterances…

Computation and Language · Computer Science 2020-05-04 Vladimir Vlasov , Johannes E. M. Mosig , Alan Nichol

Reusing pre-collected data from different domains is an appealing solution for decision-making tasks, especially when data in the target domain are limited. Existing cross-domain policy transfer methods mostly aim at learning domain…

Robotics · Computer Science 2026-03-10 Haoyi Niu , Qimao Chen , Tenglong Liu , Jianxiong Li , Guyue Zhou , Yi Zhang , Jianming Hu , Xianyuan Zhan

Goal oriented dialogue systems were originally designed as a natural language interface to a fixed data-set of entities that users might inquire about, further described by domain, slots, and values. As we move towards adaptable dialogue…

Computation and Language · Computer Science 2022-08-23 Renato Vukovic , Michael Heck , Benjamin Matthias Ruppik , Carel van Niekerk , Marcus Zibrowius , Milica Gašić

Test-Time Learning (TTL) enables language agents to iteratively refine their performance through repeated interactions with the environment at inference time. At the core of TTL is an adaptation policy that updates the actor policy based on…

Machine Learning · Computer Science 2026-04-03 Zhanzhi Lou , Hui Chen , Yibo Li , Qian Wang , Bryan Hooi

Recent works usually address Dialog policy learning DPL by training a reinforcement learning (RL) agent to determine the best dialog action. However, existing works on deep RL require a large volume of agent-user interactions to achieve…

Computation and Language · Computer Science 2023-09-06 Huimin Wang , Wai-Chung Kwan , Kam-Fai Wong

Language understanding (LU) and dialogue policy learning are two essential components in conversational systems. Human-human dialogues are not well-controlled and often random and unpredictable due to their own goals and speaking habits.…

Computation and Language · Computer Science 2017-10-03 Ta-Chung Chi , Po-Chun Chen , Shang-Yu Su , Yun-Nung Chen

This paper presents a framework for deep transfer learning, which aims to leverage information from multi-domain upstream data with a large number of samples $n$ to a single-domain downstream task with a considerably smaller number of…

Machine Learning · Computer Science 2025-01-07 Yuling Jiao , Huazhen Lin , Yuchen Luo , Jerry Zhijian Yang

How to build and use dialogue data efficiently, and how to deploy models in different domains at scale can be two critical issues in building a task-oriented dialogue system. In this paper, we propose a novel manual-guided dialogue scheme…

Computation and Language · Computer Science 2022-08-17 Ryuichi Takanobu , Hao Zhou , Yankai Lin , Peng Li , Jie Zhou , Minlie Huang

As the application of deep learning has expanded to real-world problems with insufficient volume of training data, transfer learning recently has gained much attention as means of improving the performance in such small-data regime.…

Machine Learning · Computer Science 2019-05-16 Yunhun Jang , Hankook Lee , Sung Ju Hwang , Jinwoo Shin

Deep neural networks (DNNs) have revolutionized artificial intelligence but often lack performance when faced with out-of-distribution (OOD) data, a common scenario due to the inevitable domain shifts in real-world applications. This…

Machine Learning · Computer Science 2024-08-23 Arsham Gholamzadeh Khoee , Yinan Yu , Robert Feldt