English
Related papers

Related papers: Learning New Skills after Deployment: Improving op…

200 papers

The ability of Large Language Models (LLMs) to extract context from natural language problem descriptions naturally raises questions about their suitability in autonomous decision-making settings. This paper studies the behaviour of these…

Artificial Intelligence · Computer Science 2025-07-22 Xiao Yang , Juxi Leitner , Michael Burke

This paper contributes a first study into how different human users deliver simultaneous control and feedback signals during human-robot interaction. As part of this work, we formalize and present a general interactive learning framework…

Artificial Intelligence · Computer Science 2017-03-16 Kory W. Mathewson , Patrick M. Pilarski

Task-oriented dialogue systems aim to fulfill user goals through natural language interactions. They are ideally evaluated with human users, which however is unattainable to do at every iteration of the development phase. Simulated users…

Computation and Language · Computer Science 2022-09-05 Nurul Lubis , Christian Geishauser , Hsien-Chin Lin , Carel van Niekerk , Michael Heck , Shutong Feng , Milica Gašić

Pre-trained language models (PLM) have marked a huge leap in neural dialogue modeling. While PLMs are pre-trained on large-scale text corpora, they are usually fine-tuned on scarce dialogue data with specific domain knowledge and dialogue…

Computation and Language · Computer Science 2021-12-14 Xiaodong Gu , Kang Min Yoo , Sang-Woo Lee

Despite their popularity in the chatbot literature, retrieval-based models have had modest impact on task-oriented dialogue systems, with the main obstacle to their application being the low-data regime of most task-oriented dialogue tasks.…

Models trained on large unlabeled corpora of human interactions will learn patterns and mimic behaviors therein, which include offensive or otherwise toxic behavior and unwanted biases. We investigate a variety of methods to mitigate these…

Computation and Language · Computer Science 2021-08-06 Jing Xu , Da Ju , Margaret Li , Y-Lan Boureau , Jason Weston , Emily Dinan

Robots are extending their presence in domestic environments every day, being more common to see them carrying out tasks in home scenarios. In the future, robots are expected to increasingly perform more complex tasks and, therefore, be…

Artificial Intelligence · Computer Science 2020-09-22 Ithan Moreira , Javier Rivas , Francisco Cruz , Richard Dazeley , Angel Ayala , Bruno Fernandes

Considerable progress has been made towards conversational models that generate coherent and fluent responses by training large language models on large dialogue datasets. These models have little or no control of the generated responses…

Computation and Language · Computer Science 2020-10-22 Andrea Madotto , Zhaojiang Lin , Yejin Bang , Pascale Fung

The performance of adversarial dialogue generation models relies on the quality of the reward signal produced by the discriminator. The reward signal from a poor discriminator can be very sparse and unstable, which may lead the generator to…

Computation and Language · Computer Science 2018-12-11 Ziming Li , Julia Kiseleva , Maarten de Rijke

While end-to-end neural conversation models have led to promising advances in reducing hand-crafted features and errors induced by the traditional complex system architecture, they typically require an enormous amount of data due to the…

Computation and Language · Computer Science 2018-01-10 Sungjin Lee

Enhancing AI systems with efficient communication skills for effective human assistance necessitates proactive initiatives from the system side to discern specific circumstances and interact aptly. This research focuses on a collective…

Computation and Language · Computer Science 2024-02-09 Jack Zhang

Despite showing increasingly human-like conversational abilities, state-of-the-art dialogue models often suffer from factual incorrectness and hallucination of knowledge (Roller et al., 2020). In this work we explore the use of…

Computation and Language · Computer Science 2021-04-16 Kurt Shuster , Spencer Poff , Moya Chen , Douwe Kiela , Jason Weston

This paper addresses user-specific dialogs. In contrast to previous research on personalized dialogue focused on achieving virtual user dialogue as defined by persona descriptions, user-specific dialogue aims to reproduce real-user dialogue…

Computation and Language · Computer Science 2024-09-04 Atsushi Otsuka , Kazuya Matsuo , Ryo Ishii , Narichika Nomoto , Hiroaki Sugiyama

As large language models increasingly mediate firm - customer interactions, firms face a tradeoff: the most capable models perform well but are costly and difficult to control at scale. Existing knowledge distillation methods address this…

Computation and Language · Computer Science 2026-02-23 Tong Wang , K. Sudhir

Building a persona-based conversation agent is challenging owing to the lack of large amounts of speaker-specific conversation data for model training. This paper addresses the problem by proposing a multi-task learning approach to training…

Computation and Language · Computer Science 2017-10-23 Yi Luan , Chris Brockett , Bill Dolan , Jianfeng Gao , Michel Galley

We explore creating automated, personalized feedback in an intelligent tutoring system (ITS). Our goal is to pinpoint correct and incorrect concepts in student answers in order to achieve better student learning gains. Although automatic…

Computation and Language · Computer Science 2021-03-16 Matt Grenander , Robert Belfer , Ekaterina Kochmar , Iulian V. Serban , François St-Hilaire , Jackie C. K. Cheung

Encoder-decoder based neural architectures serve as the basis of state-of-the-art approaches in end-to-end open domain dialog systems. Since most of such systems are trained with a maximum likelihood~(MLE) objective they suffer from issues…

Recent work in open-domain conversational agents has demonstrated that significant improvements in model engagingness and humanness metrics can be achieved via massive scaling in both pre-training data and model size (Adiwardana et al.,…

Computation and Language · Computer Science 2020-10-05 Kurt Shuster , Eric Michael Smith , Da Ju , Jason Weston

Human conversation is inherently complex, often spanning many different topics/domains. This makes policy learning for dialogue systems very challenging. Standard flat reinforcement learning methods do not provide an efficient framework for…

Dialogue systems are a popular natural language processing (NLP) task as it is promising in real-life applications. It is also a complicated task since many NLP tasks deserving study are involved. As a result, a multitude of novel works on…

Computation and Language · Computer Science 2022-03-31 Jinjie Ni , Tom Young , Vlad Pandelea , Fuzhao Xue , Erik Cambria