English
Related papers

Related papers: Toward Continual Learning for Conversational Agent…

200 papers

Vast improvements in natural language understanding and speech recognition have paved the way for conversational interaction with computers. While conversational agents have often been used for short goal-oriented dialog, we know little…

Human-Computer Interaction · Computer Science 2020-08-20 Jessica Van Brummelen , Kevin Weng , Phoebe Lin , Catherine Yeo

Despite recent improvements in open-domain dialogue models, state of the art models are trained and evaluated on short conversations with little context. In contrast, the long-term conversation setting has hardly been studied. In this work…

Computation and Language · Computer Science 2021-07-19 Jing Xu , Arthur Szlam , Jason Weston

This paper reports on progress towards building an online language learning tool to provide learners with conversational experience by using dialog systems as conversation practice partners. Our system can adapt to users' language…

Computation and Language · Computer Science 2022-08-02 Yu Li , Chun-Yen Chen , Dian Yu , Sam Davidson , Ryan Hou , Xun Yuan , Yinghua Tan , Derek Pham , Zhou Yu

This paper presents an end-to-end framework for task-oriented dialog systems using a variant of Deep Recurrent Q-Networks (DRQN). The model is able to interface with a relational database and jointly learn policies for both language…

Artificial Intelligence · Computer Science 2016-09-19 Tiancheng Zhao , Maxine Eskenazi

This paper considers cooperative Multi-Agent Reinforcement Learning, focusing on emergent communication in settings where multiple pairs of independent learners interact at varying frequencies. In this context, multiple distinct and…

Artificial Intelligence · Computer Science 2021-11-23 J. D. Thomas , R. Santos-Rodríguez , R. Piechocki , M. Anca

In this paper, we present a deep reinforcement learning (RL) framework for iterative dialog policy optimization in end-to-end task-oriented dialog systems. Popular approaches in learning dialog policy with RL include letting a dialog agent…

Computation and Language · Computer Science 2017-09-20 Bing Liu , Ian Lane

In our dynamic world where data arrives in a continuous stream, continual learning enables us to incrementally add new tasks/domains without the need to retrain from scratch. A major challenge in continual learning of language model is…

Computation and Language · Computer Science 2024-03-19 Zihan Wang , Jiayu Xiao , Mengxiang Li , Zhongjiang He , Yongxiang Li , Chao Wang , Shuangyong Song

Language is crucial for human intelligence, but what exactly is its role? We take language to be a part of a system for understanding and communicating about situations. The human ability to understand and communicate about situations…

Computation and Language · Computer Science 2020-07-07 James L. McClelland , Felix Hill , Maja Rudolph , Jason Baldridge , Hinrich Schütze

The objective of this work is to train a chatbot capable of solving evolving problems through conversing with a user about a problem the chatbot cannot directly observe. The system consists of a virtual problem (in this case a simple game),…

Artificial Intelligence · Computer Science 2024-01-12 Michael Free , Andrew Langworthy , Mary Dimitropoulaki , Simon Thompson

There has recently been growing interest in conversational agents with long-term memory which has led to the rapid development of language models that use retrieval-augmented generation (RAG). Until recently, most work on RAG has focused on…

Computation and Language · Computer Science 2024-06-06 Nick Alonso , Tomás Figliolia , Anthony Ndirango , Beren Millidge

Some exciting new approaches to neural architectures for the analysis of conversation have been introduced over the past couple of years. These include neural architectures for detecting emotion, dialogue acts, and sentiment polarity. They…

Computation and Language · Computer Science 2022-04-01 Chloé Clavel , Matthieu Labeau , Justine Cassell

We model coherent conversation continuation via RNN-based dialogue models equipped with a dynamic attention mechanism. Our attention-RNN language model dynamically increases the scope of attention on the history as the conversation…

Computation and Language · Computer Science 2016-11-22 Hongyuan Mei , Mohit Bansal , Matthew R. Walter

Recent work on large language models relies on the intuition that most natural language processing tasks can be described via natural language instructions. Language models trained on these instructions show strong zero-shot performance on…

Computation and Language · Computer Science 2022-11-01 Thomas Scialom , Tuhin Chakrabarty , Smaranda Muresan

We present a novel response generation system that can be trained end to end on large quantities of unstructured Twitter conversations. A neural network architecture is used to address sparsity issues that arise when integrating contextual…

Computation and Language · Computer Science 2015-06-23 Alessandro Sordoni , Michel Galley , Michael Auli , Chris Brockett , Yangfeng Ji , Margaret Mitchell , Jian-Yun Nie , Jianfeng Gao , Bill Dolan

Continual learning aims at incrementally acquiring new knowledge while not forgetting existing knowledge. To overcome catastrophic forgetting, methods are either rehearsal-based, i.e., store data examples from previous tasks for data…

Machine Learning · Computer Science 2024-04-02 Mingyang Wang , Heike Adel , Lukas Lange , Jannik Strötgen , Hinrich Schütze

Continual learning (CL) aims to enable information systems to learn from a continuous data stream across time. However, it is difficult for existing deep learning architectures to learn a new task without largely forgetting previously…

Computation and Language · Computer Science 2021-01-11 Magdalena Biesialska , Katarzyna Biesialska , Marta R. Costa-jussà

We propose a reinforcement learning-based approach to optimize conversational strategies for product recommendation across diverse industries. As organizations increasingly adopt intelligent agents to support sales and service operations,…

Information Retrieval · Computer Science 2025-07-03 Kang Liu

Despite recent advances in natural language understanding and generation, and decades of research on the development of conversational bots, building automated agents that can carry on rich open-ended conversations with humans "in the wild"…

Continual learning is one of the key components of human learning and a necessary requirement of artificial intelligence. As dialogue can potentially span infinitely many topics and tasks, a task-oriented dialogue system must have the…

Computation and Language · Computer Science 2022-10-11 Christian Geishauser , Carel van Niekerk , Nurul Lubis , Michael Heck , Hsien-Chin Lin , Shutong Feng , Milica Gašić

The birth of Foundation Models brought unprecedented results in a wide range of tasks, from language to vision, to robotic control. These models are able to process huge quantities of data, and can extract and develop rich representations,…