English
Related papers

Related papers: Distributed Structured Actor-Critic Reinforcement …

200 papers

In this work, we present a hybrid learning method for training task-oriented dialogue systems through online user interactions. Popular methods for learning task-oriented dialogues include applying reinforcement learning with user feedback…

Computation and Language · Computer Science 2018-04-19 Bing Liu , Gokhan Tur , Dilek Hakkani-Tur , Pararth Shah , Larry Heck

Reinforcement learning (RL) is a powerful approach to enhance task-oriented dialogue (TOD) systems. However, existing RL methods tend to mainly focus on generation tasks, such as dialogue policy learning (DPL) or response generation (RG),…

Artificial Intelligence · Computer Science 2024-06-21 Huifang Du , Shuqin Li , Minghao Wu , Xuejing Feng , Yuan-Fang Li , Haofen Wang

Building robust and general dialogue models for spoken conversations is challenging due to the gap in distributions of spoken and written data. This paper presents our approach to build generalized models for the Knowledge-grounded…

Computation and Language · Computer Science 2022-03-09 Ruijie Yan , Shuang Peng , Haitao Mi , Liang Jiang , Shihui Yang , Yuchi Zhang , Jiajun Li , Liangrui Peng , Yongliang Wang , Zujie Wen

Dialogue policy optimization often obtains feedback until task completion in task-oriented dialogue systems. This is insufficient for training intermediate dialogue turns since supervision signals (or rewards) are only provided at the end…

Computation and Language · Computer Science 2020-05-12 Xinting Huang , Jianzhong Qi , Yu Sun , Rui Zhang

Building scalable and reusable multi-agent decision policies from offline datasets remains a challenge in offline multi-agent reinforcement learning (MARL), as existing methods often rely on fixed observation formats and action spaces that…

Multiagent Systems · Computer Science 2026-04-28 Zhuohui Zhang , Bin Cheng , Bin He

Training a task-completion dialogue agent via reinforcement learning (RL) is costly because it requires many interactions with real users. One common alternative is to use a user simulator. However, a user simulator usually lacks the…

Computation and Language · Computer Science 2018-05-24 Baolin Peng , Xiujun Li , Jianfeng Gao , Jingjing Liu , Kam-Fai Wong , Shang-Yu Su

Dialogue policy plays an important role in task-oriented spoken dialogue systems. It determines how to respond to users. The recently proposed deep reinforcement learning (DRL) approaches have been used for policy optimization. However,…

Computation and Language · Computer Science 2019-05-28 Lu Chen , Zhi Chen , Bowen Tan , Sishan Long , Milica Gasic , Kai Yu

Recent progress on large language models (LLMs) has enabled dialogue agents to generate highly naturalistic and plausible text. However, current LLM language generation focuses on responding accurately to questions and requests with a…

Machine Learning · Computer Science 2024-11-11 Joey Hong , Jessica Lin , Anca Dragan , Sergey Levine

Decision-making for engineering systems can be efficiently formulated as a Markov Decision Process (MDP) or a Partially Observable MDP (POMDP). Typical MDP and POMDP solution procedures utilize offline knowledge about the environment and…

Systems and Control · Computer Science 2018-11-07 C. P. Andriotis , K. G. Papakonstantinou

We describe a class of tasks called decision-oriented dialogues, in which AI assistants such as large language models (LMs) must collaborate with one or more humans via natural language to help them make complex decisions. We formalize…

Computation and Language · Computer Science 2024-05-07 Jessy Lin , Nicholas Tomlin , Jacob Andreas , Jason Eisner

Dialog response ranking is used to rank response candidates by considering their relation to the dialog history. Although researchers have addressed this concept for open-domain dialogs, little attention has been focused on task-oriented…

Computation and Language · Computer Science 2018-11-29 Junki Ohmura , Maxine Eskenazi

We introduce end-to-end neural network based models for simulating users of task-oriented dialogue systems. User simulation in dialogue systems is crucial from two different perspectives: (i) automatic evaluation of different dialogue…

Computation and Language · Computer Science 2018-11-13 Izzeddin Gur , Dilek Hakkani-Tur , Gokhan Tur , Pararth Shah

Due to strong capabilities in conducting fluent, multi-turn conversations with users, Large Language Models (LLMs) have the potential to further improve the performance of Conversational Recommender System (CRS). Unlike the aimless…

Information Retrieval · Computer Science 2024-02-05 Jiabao Fang , Shen Gao , Pengjie Ren , Xiuying Chen , Suzan Verberne , Zhaochun Ren

Task-oriented dialogue systems (TODS) have become crucial for users to interact with machines and computers using natural language. One of its key components is the dialogue manager, which guides the conversation towards a good goal for the…

Computation and Language · Computer Science 2023-10-24 Miguel Ángel Medina-Ramírez , Cayetano Guerra-Artal , Mario Hernández-Tejera

In proactive dialogue, the challenge lies not just in generating responses but in steering conversations toward predetermined goals, a task where Large Language Models (LLMs) typically struggle due to their reactive nature. Traditional…

Computation and Language · Computer Science 2024-06-11 Tao He , Lizi Liao , Yixin Cao , Yuanxing Liu , Ming Liu , Zerui Chen , Bing Qin

Building user trust in dialogue agents requires smooth and consistent dialogue exchanges. However, agents can easily lose conversational context and generate irrelevant utterances. These situations are called dialogue breakdown, where agent…

Computation and Language · Computer Science 2023-01-23 Nathan Ng , Marzyeh Ghassemi , Narendran Thangarajan , Jiacheng Pan , Qi Guo

Dialogue state tracking (DST) is a key component of task-oriented dialogue systems. DST estimates the user's goal at each user turn given the interaction until then. State of the art approaches for state tracking rely on deep learning…

Computation and Language · Computer Science 2018-01-03 Abhinav Rastogi , Dilek Hakkani-Tur , Larry Heck

End-to-end design of dialogue systems has recently become a popular research topic thanks to powerful tools such as encoder-decoder architectures for sequence-to-sequence learning. Yet, most current approaches cast human-machine dialogue…

Computation and Language · Computer Science 2017-03-17 Florian Strub , Harm de Vries , Jeremie Mary , Bilal Piot , Aaron Courville , Olivier Pietquin

Task-oriented dialogue (TOD) system is designed to accomplish user-defined tasks through dialogues. The TOD system has progressed towards end-to-end modeling by leveraging pre-trained large language models. Fine-tuning the pre-trained…

Computation and Language · Computer Science 2024-11-11 Dharmendra Prajapat , Durga Toshniwal

In recent years, the emerging topics of recommender systems that take advantage of natural language processing techniques have attracted much attention, and one of their applications is the Conversational Recommender System (CRS). Unlike…