English
Related papers

Related papers: End-to-End Optimization of Task-Oriented Dialogue …

200 papers

This paper presents a recurrent hybrid model and training procedure for task-oriented dialogue systems based on Deep Recurrent Q-Networks (DRQN). The model copes with both tasks required for Dialogue Management: State Tracking and Decision…

Computation and Language · Computer Science 2020-11-05 Carlos Miranda , Yacine Kessaci

Dialogue data in real scenarios tend to be sparsely available, rendering data-starved end-to-end dialogue systems trained inadequately. We discover that data utilization efficiency in low-resource scenarios can be enhanced by mining…

Computation and Language · Computer Science 2023-05-26 Shimin Li , Xiaotian Zhang , Yanjun Zheng , Linyang Li , Xipeng Qiu

Dialog management (DM) is a crucial component in a task-oriented dialog system. Given the dialog history, DM predicts the dialog state and decides the next action that the dialog agent should take. Recently, dialog policy learning has been…

Computation and Language · Computer Science 2021-10-26 Yinpei Dai , Huihua Yu , Yixuan Jiang , Chengguang Tang , Yongbin Li , Jian Sun

The recent success of reinforcement learning's (RL) in solving complex tasks is most often attributed to its capacity to explore and exploit an environment where it has been trained. Sample efficiency is usually not an issue since cheap…

Computation and Language · Computer Science 2023-03-16 Govardana Sachithanandam Ramachandran , Kazuma Hashimoto , Caiming Xiong

Reinforcement learning (RL) can enable task-oriented dialogue systems to steer the conversation towards successful task completion. In an end-to-end setting, a response can be constructed in a word-level sequential decision making process…

Computation and Language · Computer Science 2020-11-19 Nurul Lubis , Christian Geishauser , Michael Heck , Hsien-chin Lin , Marco Moresi , Carel van Niekerk , Milica Gašić

End-to-end multi-task dialogue systems are usually designed with separate modules for the dialogue pipeline. Among these, the policy module is essential for deciding what to do in response to user input. This policy is trained by…

Computation and Language · Computer Science 2024-03-27 Navin Kamuni , Hardik Shah , Sathishkumar Chintala , Naveen Kunchakuri , Sujatha Alla Old Dominion

In this work, we propose a novel framework that integrates large language models (LLMs) with an RL-based dialogue manager for open-ended dialogue with a specific goal. By leveraging hierarchical reinforcement learning to model the…

Computation and Language · Computer Science 2025-07-09 Lucie Galland , Catherine Pelachaud , Florian Pecune

End-to-end generation-based approaches have been investigated and applied in task-oriented dialogue systems. However, in industrial scenarios, existing methods face the bottlenecks of controllability (e.g., domain-inconsistent responses,…

Computation and Language · Computer Science 2023-04-04 Yuncheng Hua , Xiangyu Xi , Zheng Jiang , Guanwei Zhang , Chaobo Sun , Guanglu Wan , Wei Ye

For each goal-oriented dialog task of interest, large amounts of data need to be collected for end-to-end learning of a neural dialog system. Collecting that data is a costly and time-consuming process. Instead, we show that we can use only…

Computation and Language · Computer Science 2021-11-01 Janarthanan Rajendran , Jonathan K. Kummerfeld , Satinder Singh

Despite their popularity in the chatbot literature, retrieval-based models have had modest impact on task-oriented dialogue systems, with the main obstacle to their application being the low-data regime of most task-oriented dialogue tasks.…

Nowadays, the current neural network models of dialogue generation(chatbots) show great promise for generating answers for chatty agents. But they are short-sighted in that they predict utterances one at a time while disregarding their…

Computation and Language · Computer Science 2023-01-19 Jabri Ismail , Aboulbichr Ahmed , El ouaazizi Aziza

Reinforcement learning (RL) has shown great promise for developing dialogue management (DM) agents that are non-myopic, conduct rich conversations, and maximize overall user satisfaction. Despite recent developments in RL and language…

Machine Learning · Computer Science 2023-10-31 Dhawal Gupta , Yinlam Chow , Aza Tulepbergenov , Mohammad Ghavamzadeh , Craig Boutilier

Task oriented dialogue (TOD) requires the complex interleaving of a number of individually controllable components with strong guarantees for explainability and verifiability. This has made it difficult to adopt the multi-turn multi-domain…

Computation and Language · Computer Science 2020-10-07 Oluwatobi O. Olabiyi , Prarthana Bhattarai , C. Bayan Bruss , Zachary Kulis

Task-oriented dialogue systems aim to fulfill user goals through natural language interactions. They are ideally evaluated with human users, which however is unattainable to do at every iteration of the development phase. Simulated users…

Computation and Language · Computer Science 2022-09-05 Nurul Lubis , Christian Geishauser , Hsien-Chin Lin , Carel van Niekerk , Michael Heck , Shutong Feng , Milica Gašić

We propose a new low-cost machine-learning-based methodology which assists designers in reducing the gap between the problem and the solution in the design process. Our work applies reinforcement learning (RL) to find the optimal…

Machine Learning · Computer Science 2019-03-14 Junyoung Choi , Minsung Hyun , Nojun Kwak

We investigate the task of learning to follow natural language instructions by jointly reasoning with visual observations and language inputs. In contrast to existing methods which start with learning from demonstrations (LfD) and then use…

Computation and Language · Computer Science 2018-07-10 Wenhan Xiong , Xiaoxiao Guo , Mo Yu , Shiyu Chang , Bowen Zhou , William Yang Wang

Task-oriented dialogue systems have been a promising area in the NLP field. Previous work showed the effectiveness of using a single GPT-2 based model to predict belief states and responses via causal language modeling. In this paper, we…

Computation and Language · Computer Science 2021-10-12 Po-Nien Kung , Chung-Cheng Chang , Tse-Hsuan Yang , Hsin-Kai Hsu , Yu-Jia Liou , Yun-Nung Chen

Language systems have been of great interest to the research community and have recently reached the mass market through various assistant platforms on the web. Reinforcement Learning methods that optimize dialogue policies have seen…

Machine Learning · Computer Science 2024-02-09 Floris den Hengst , Mark Hoogendoorn , Frank van Harmelen , Joost Bosman

Continual learning in task-oriented dialogue systems can allow us to add new domains and functionalities through time without incurring the high cost of a whole system retraining. In this paper, we propose a continual learning benchmark for…

Computation and Language · Computer Science 2021-01-01 Andrea Madotto , Zhaojiang Lin , Zhenpeng Zhou , Seungwhan Moon , Paul Crook , Bing Liu , Zhou Yu , Eunjoon Cho , Zhiguang Wang

Current research in dialogue systems is focused on conversational assistants working on short conversations in either task-oriented or open domain settings. In this paper, we focus on improving task-based conversational assistants online,…

Computation and Language · Computer Science 2021-10-06 Ruijie Zhou , Soham Deshmukh , Jeremiah Greer , Charles Lee