English
Related papers

Related papers: Towards End-to-End Learning for Dialog State Track…

200 papers

While contemporary reinforcement learning research and applications have embraced policy gradient methods as the panacea of solving learning problems, value-based methods can still be useful in many domains as long as we can wrangle with…

Machine Learning · Computer Science 2024-07-16 Ashwin Ramaswamy , Ransalu Senanayake

Creating an intelligent conversational system that understands vision and language is one of the ultimate goals in Artificial Intelligence (AI)~\cite{winograd1972understanding}. Extensive research has focused on vision-to-language…

Computation and Language · Computer Science 2018-05-10 Jiaping Zhang , Tiancheng Zhao , Zhou Yu

In this letter, we explore the communication-control co-design of discrete-time stochastic linear systems through reinforcement learning. Specifically, we examine a closed-loop system involving two sequential decision-makers: a scheduler…

Optimization and Control · Mathematics 2025-04-15 Shubham Aggarwal , Dipankar Maity , Tamer Başar

We present a novel negotiation model that allows an agent to learn how to negotiate during concurrent bilateral negotiations in unknown and dynamic e-markets. The agent uses an actor-critic architecture with model-free reinforcement…

Multiagent Systems · Computer Science 2020-02-04 Pallavi Bagga , Nicola Paoletti , Bedour Alrayes , Kostas Stathis

Defining action spaces for conversational agents and optimizing their decision-making process with reinforcement learning is an enduring challenge. Common practice has been to use handcrafted dialog acts, or the output vocabulary, e.g. in…

Computation and Language · Computer Science 2019-04-16 Tiancheng Zhao , Kaige Xie , Maxine Eskenazi

Real-world reinforcement learning tasks often involve some form of partial observability where the observations only give a partial or noisy view of the true state of the world. Such tasks typically require some form of memory, where the…

Machine Learning · Computer Science 2022-11-11 Kevin Esslinger , Robert Platt , Christopher Amato

Open domain dialog systems face the challenge of being repetitive and producing generic responses. In this paper, we demonstrate that by conditioning the response generation on interpretable discrete dialog attributes and composed…

Machine Learning · Computer Science 2019-09-17 Chinnadhurai Sankar , Sujith Ravi

The emergence of structured databases for Question Answering (QA) systems has led to developing methods, in which the problem of learning the correct answer efficiently is based on a linking task between the constituents of the question and…

Machine Learning · Computer Science 2020-03-05 Hamid Zafar , Maryam Tavakol , Jens Lehmann

Successful applications of reinforcement learning in real-world problems often require dealing with partially observable states. It is in general very challenging to construct and infer hidden states as they often depend on the agent's…

Machine Learning · Computer Science 2015-11-20 Xiujun Li , Lihong Li , Jianfeng Gao , Xiaodong He , Jianshu Chen , Li Deng , Ji He

Much of human dialogue occurs in semi-cooperative settings, where agents with different goals attempt to agree on common decisions. Negotiations require complex communication and reasoning skills, but success is easy to measure, making this…

Artificial Intelligence · Computer Science 2017-06-19 Mike Lewis , Denis Yarats , Yann N. Dauphin , Devi Parikh , Dhruv Batra

In task-oriented dialogs (TOD), reinforcement learning (RL) algorithms train a model to directly optimize response for task-related metrics. However, RL needs to perform exploration, which can be time-consuming due to the slow…

Computation and Language · Computer Science 2023-10-23 Xiao Yu , Qingyang Wu , Kun Qian , Zhou Yu

In this work, we propose a novel framework that integrates large language models (LLMs) with an RL-based dialogue manager for open-ended dialogue with a specific goal. By leveraging hierarchical reinforcement learning to model the…

Computation and Language · Computer Science 2025-07-09 Lucie Galland , Catherine Pelachaud , Florian Pecune

Reinforcement Learning (RL) methods have emerged as a popular choice for training an efficient and effective dialogue policy. However, these methods suffer from sparse and unstable reward signals returned by a user simulator only when a…

Artificial Intelligence · Computer Science 2020-09-18 Ziming Li , Sungjin Lee , Baolin Peng , Jinchao Li , Julia Kiseleva , Maarten de Rijke , Shahin Shayandeh , Jianfeng Gao

Attention-based encoder-decoder neural network models have recently shown promising results in goal-oriented dialogue systems. However, these models struggle to reason over and incorporate state-full knowledge while preserving their…

Computation and Language · Computer Science 2020-01-29 Firas Kassawat , Debanjan Chaudhuri , Jens Lehmann

Statistical spoken dialogue systems have the attractive property of being able to be optimised from data via interactions with real users. However in the reinforcement learning paradigm the dialogue manager (agent) often requires…

Machine Learning · Computer Science 2015-08-19 Pei-Hao Su , David Vandyke , Milica Gasic , Nikola Mrksic , Tsung-Hsien Wen , Steve Young

Dialog policy decides what and how a task-oriented dialog system will respond, and plays a vital role in delivering effective conversations. Many studies apply Reinforcement Learning to learn a dialog policy with the reward function which…

Computation and Language · Computer Science 2019-08-29 Ryuichi Takanobu , Hanlin Zhu , Minlie Huang

In this work we present a method for using Deep Q-Networks (DQNs) in multi-objective environments. Deep Q-Networks provide remarkable performance in single objective problems learning from high-level visual state representations. However,…

Artificial Intelligence · Computer Science 2018-02-26 Tomasz Tajmajer

In this paper, we explore a multi-agent reinforcement learning approach to address the design problem of communication and control strategies for multi-agent cooperative transport. Typical end-to-end deep neural network policies may be…

Machine Learning · Computer Science 2021-03-30 Kazuki Shibata , Tomohiko Jimbo , Takamitsu Matsubara

We propose a learning architecture that allows symbolic control and guidance in reinforcement learning with deep neural networks. We introduce SymDQN, a novel modular approach that augments the existing Dueling Deep Q-Networks (DuelDQN)…

Artificial Intelligence · Computer Science 2025-04-04 Ivo Amador , Nina Gierasimczuk

Natural language understanding and dialogue policy learning are both essential in conversational systems that predict the next system actions in response to a current user utterance. Conventional approaches aggregate separate models of…

Computation and Language · Computer Science 2017-10-03 Xuesong Yang , Yun-Nung Chen , Dilek Hakkani-Tur , Paul Crook , Xiujun Li , Jianfeng Gao , Li Deng