English
Related papers

Related papers: Rethinking Supervised Learning and Reinforcement L…

200 papers

Task-oriented dialogue (TOD) system is designed to accomplish user-defined tasks through dialogues. The TOD system has progressed towards end-to-end modeling by leveraging pre-trained large language models. Fine-tuning the pre-trained…

Computation and Language · Computer Science 2024-11-11 Dharmendra Prajapat , Durga Toshniwal

Recent progress on large language models (LLMs) has enabled dialogue agents to generate highly naturalistic and plausible text. However, current LLM language generation focuses on responding accurately to questions and requests with a…

Machine Learning · Computer Science 2024-11-11 Joey Hong , Jessica Lin , Anca Dragan , Sergey Levine

Conveying complex objectives to reinforcement learning (RL) agents can often be difficult, involving meticulous design of reward functions that are sufficiently informative yet easy enough to provide. Human-in-the-loop RL methods allow…

Machine Learning · Computer Science 2021-06-10 Kimin Lee , Laura Smith , Pieter Abbeel

Current research in dialogue systems is focused on conversational assistants working on short conversations in either task-oriented or open domain settings. In this paper, we focus on improving task-based conversational assistants online,…

Computation and Language · Computer Science 2021-10-06 Ruijie Zhou , Soham Deshmukh , Jeremiah Greer , Charles Lee

Robot assistants for older adults and people with disabilities need to interact with their users in collaborative tasks. The core component of these systems is an interaction manager whose job is to observe and assess the task, and infer…

Dialog management (DM) is a crucial component in a task-oriented dialog system. Given the dialog history, DM predicts the dialog state and decides the next action that the dialog agent should take. Recently, dialog policy learning has been…

Computation and Language · Computer Science 2021-10-26 Yinpei Dai , Huihua Yu , Yixuan Jiang , Chengguang Tang , Yongbin Li , Jian Sun

Task-oriented dialogue systems aim to fulfill user goals through natural language interactions. They are ideally evaluated with human users, which however is unattainable to do at every iteration of the development phase. Simulated users…

Computation and Language · Computer Science 2022-09-05 Nurul Lubis , Christian Geishauser , Hsien-Chin Lin , Carel van Niekerk , Michael Heck , Shutong Feng , Milica Gašić

This paper introduces an adversarial method to stress-test trained metrics to evaluate conversational dialogue systems. The method leverages Reinforcement Learning to find response strategies that elicit optimal scores from the trained…

Artificial Intelligence · Computer Science 2022-03-01 Jan Deriu , Don Tuggener , Pius von Däniken , Mark Cieliebak

We present an optimised multi-modal dialogue agent for interactive learning of visually grounded word meanings from a human tutor, trained on real human-human tutoring data. Within a life-long interactive learning period, the agent, trained…

Computation and Language · Computer Science 2017-10-02 Yanchao Yu , Arash Eshghi , Oliver Lemon

Reinforcement learning (RL) has shown great promise for developing dialogue management (DM) agents that are non-myopic, conduct rich conversations, and maximize overall user satisfaction. Despite recent developments in RL and language…

Machine Learning · Computer Science 2023-10-31 Dhawal Gupta , Yinlam Chow , Aza Tulepbergenov , Mohammad Ghavamzadeh , Craig Boutilier

Learning goal-oriented dialogues by means of deep reinforcement learning has recently become a popular research topic. However, commonly used policy-based dialogue agents often end up focusing on simple utterances and suboptimal policies.…

Machine Learning · Computer Science 2020-05-26 Rui Zhao , Volker Tresp

Task-oriented dialog systems have been applied in various tasks, such as automated personal assistants, customer service providers and tutors. These systems work well when users have clear and explicit intentions that are well-aligned to…

Computation and Language · Computer Science 2018-01-09 Zhou Yu , Alan W Black , Alexander I. Rudnicky

Statistical spoken dialogue systems have the attractive property of being able to be optimised from data via interactions with real users. However in the reinforcement learning paradigm the dialogue manager (agent) often requires…

Machine Learning · Computer Science 2015-08-19 Pei-Hao Su , David Vandyke , Milica Gasic , Nikola Mrksic , Tsung-Hsien Wen , Steve Young

Training chatbots using the reinforcement learning paradigm is challenging due to high-dimensional states, infinite action spaces and the difficulty in specifying the reward function. We address such problems using clustered actions instead…

Artificial Intelligence · Computer Science 2019-08-28 Heriberto Cuayáhuitl , Donghyeon Lee , Seonghan Ryu , Sungja Choi , Inchul Hwang , Jihie Kim

This paper presents a model for end-to-end learning of task-oriented dialog systems. The main component of the model is a recurrent neural network (an LSTM), which maps from raw dialog history directly to a distribution over system actions.…

Computation and Language · Computer Science 2016-06-07 Jason D. Williams , Geoffrey Zweig

When learning task-oriented dialogue (ToD) agents, reinforcement learning (RL) techniques can naturally be utilized to train dialogue strategies to achieve user-specific goals. Prior works mainly focus on adopting advanced RL techniques to…

Computation and Language · Computer Science 2023-02-22 Yihao Feng , Shentao Yang , Shujian Zhang , Jianguo Zhang , Caiming Xiong , Mingyuan Zhou , Huan Wang

For task-oriented dialog systems, training a Reinforcement Learning (RL) based Dialog Management module suffers from low sample efficiency and slow convergence speed due to the sparse rewards in RL.To solve this problem, many strategies…

Computation and Language · Computer Science 2021-04-13 Zhengxu Hou , Bang Liu , Ruihui Zhao , Zijing Ou , Yafei Liu , Xi Chen , Yefeng Zheng

Large language models (LLMs) augmented with external tools are increasingly deployed as deep research agents that gather, reason over, and synthesize web information to answer complex queries. Although recent open-source systems achieve…

Artificial Intelligence · Computer Science 2026-02-24 Yi Wan , Jiuqi Wang , Liam Li , Jinsong Liu , Ruihao Zhu , Zheqing Zhu

In this paper we take the first steps in studying a new approach to synthesis of efficient communication schemes in multi-agent systems, trained via reinforcement learning. We combine symbolic methods with machine learning, in what is…

Artificial Intelligence · Computer Science 2022-12-29 Erik Jergéus , Leo Karlsson Oinonen , Emil Carlsson , Moa Johansson

There is an increasing demand for task-oriented dialogue systems which can assist users in various activities such as booking tickets and restaurant reservations. In order to complete dialogues effectively, dialogue policy plays a key role…

Computation and Language · Computer Science 2019-09-23 Tian Lan , Xianling Mao , Heyan Huang