English
Related papers

Related papers: Deep Reinforcement Learning For Modeling Chit-Chat…

200 papers

Deep reinforcement learning is a promising approach to training a dialog manager, but current methods struggle with the large state and action spaces of multi-domain dialog systems. Building upon Deep Q-learning from Demonstrations (DQfD),…

Computation and Language · Computer Science 2020-08-14 Gabriel Gordon-Hall , Philip John Gorinski , Shay B. Cohen

Reinforcement learning (RL) algorithms have proven transformative in a range of domains. To tackle real-world domains, these systems often use neural networks to learn policies directly from pixels or other high-dimensional sensory input.…

Machine Learning · Computer Science 2025-10-02 Nishil Patel , Sebastian Lee , Stefano Sarao Mannelli , Sebastian Goldt , Andrew Saxe

The performance of adversarial dialogue generation models relies on the quality of the reward signal produced by the discriminator. The reward signal from a poor discriminator can be very sparse and unstable, which may lead the generator to…

Computation and Language · Computer Science 2018-12-11 Ziming Li , Julia Kiseleva , Maarten de Rijke

Human conversation is inherently complex, often spanning many different topics/domains. This makes policy learning for dialogue systems very challenging. Standard flat reinforcement learning methods do not provide an efficient framework for…

Reinforcement learning (RL) is a powerful approach to enhance task-oriented dialogue (TOD) systems. However, existing RL methods tend to mainly focus on generation tasks, such as dialogue policy learning (DPL) or response generation (RG),…

Artificial Intelligence · Computer Science 2024-06-21 Huifang Du , Shuqin Li , Minghao Wu , Xuejing Feng , Yuan-Fang Li , Haofen Wang

End-to-end spoken dialogue models have garnered significant attention because they offer a higher potential ceiling in expressiveness and perceptual ability than cascaded systems. However, the intelligence and expressiveness of current…

Artificial Intelligence · Computer Science 2026-04-17 Yifu Chen , Shengpeng Ji , Qian Chen , Tianle Liang , Yangzhuo Li , Ziqing Wang , Wen Wang , Jingyu Lu , Haoxiao Wang , Xueyi Pu , Fan Zhuo , Zhou Zhao

In this paper, drawing intuition from the Turing test, we propose using adversarial training for open-domain dialogue generation: the system is trained to produce sequences that are indistinguishable from human-generated dialogue…

Computation and Language · Computer Science 2017-09-26 Jiwei Li , Will Monroe , Tianlin Shi , Sébastien Jean , Alan Ritter , Dan Jurafsky

Dialog policies, which determine a system's action based on the current state at each dialog turn, are crucial to the success of the dialog. In recent years, reinforcement learning (RL) has emerged as a promising option for dialog policy…

Despite recent advancements in language models (LMs), their application to dialogue management (DM) problems and ability to carry on rich conversations remain a challenge. We use reinforcement learning (RL) to develop a dialogue agent that…

Computation and Language · Computer Science 2022-06-02 Yinlam Chow , Aza Tulepbergenov , Ofir Nachum , MoonKyung Ryu , Mohammad Ghavamzadeh , Craig Boutilier

Deep reinforcement learning (deep RL) is a combination of deep learning with reinforcement learning principles to create efficient methods that can learn by interacting with its environment. This led to breakthroughs in many complex tasks…

Sound · Computer Science 2019-10-29 Thejan Rajapakshe , Rajib Rana , Siddique Latif , Sara Khalifa , Björn W. Schuller

Achieving seamless, human-like interaction remains a key challenge for full-duplex spoken dialogue models (SDMs). Reinforcement learning (RL) has substantially enhanced text- and vision-language models, while well-designed reward signals…

Artificial Intelligence · Computer Science 2026-04-17 Yifu Chen , Shengpeng Ji , Zhengqing Liu , Qian Chen , Wen Wang , Ziqing Wang , Yangzhuo Li , Tianle Liang , Zhou Zhao

Dialogue state tracking (DST) is a crucial module in dialogue management. It is usually cast as a supervised training problem, which is not convenient for on-line optimization. In this paper, a novel companion teaching based deep…

Computation and Language · Computer Science 2020-09-23 Zhi Chen , Lu Chen , Xiang Zhou , Kai Yu

Deep reinforcement learning (DRL) breaks through the bottlenecks of traditional reinforcement learning (RL) with the help of the perception capability of deep learning and has been widely applied in real-world problems.While model-free RL,…

Machine Learning · Computer Science 2022-11-28 Tingting Zhao , Ying Wang , Wei Sun , Yarui Chen , Gang Niub , Masashi Sugiyama

Reinforcement learning (RL) agents make decisions using nothing but observations from the environment, and consequently, heavily rely on the representations of those observations. Though some recent breakthroughs have used vector-based…

Machine Learning · Computer Science 2024-07-16 Edan Meyer , Adam White , Marlos C. Machado

Much literature has shown that prompt-based learning is an efficient method to make use of the large pre-trained language model. Recent works also exhibit the possibility of steering a chatbot's output by plugging in an appropriate prompt.…

Computation and Language · Computer Science 2022-10-14 Hsuan Su , Pohan Chi , Shih-Cheng Huang , Chung Ho Lam , Saurav Sahay , Shang-Tse Chen , Hung-yi Lee

Reinforcement learning (RL) in discrete action space is ubiquitous in real-world applications, but its complexity grows exponentially with the action-space dimension, making it challenging to apply existing on-policy gradient based deep RL…

Machine Learning · Statistics 2020-02-24 Yuguang Yue , Yunhao Tang , Mingzhang Yin , Mingyuan Zhou

In this paper, we propose to use deep policy networks which are trained with an advantage actor-critic method for statistically optimised dialogue systems. First, we show that, on summary state and action spaces, deep Reinforcement Learning…

Computation and Language · Computer Science 2016-09-13 Mehdi Fatemi , Layla El Asri , Hannes Schulz , Jing He , Kaheer Suleman

Current research in dialogue systems is focused on conversational assistants working on short conversations in either task-oriented or open domain settings. In this paper, we focus on improving task-based conversational assistants online,…

Computation and Language · Computer Science 2021-10-06 Ruijie Zhou , Soham Deshmukh , Jeremiah Greer , Charles Lee

Large pretrained models are showing increasingly better performance in reasoning and planning tasks across different modalities, opening the possibility to leverage them for complex sequential decision making problems. In this paper, we…

Artificial Intelligence · Computer Science 2024-10-10 Martin Klissarov , Devon Hjelm , Alexander Toshev , Bogdan Mazoure

Recent work has shown that augmenting environments with language descriptions improves policy learning. However, for environments with complex language abstractions, learning how to ground language to observations is difficult due to…

Machine Learning · Computer Science 2022-10-04 Victor Zhong , Jesse Mu , Luke Zettlemoyer , Edward Grefenstette , Tim Rocktäschel