English
Related papers

Related papers: Rescue Conversations from Dead-ends: Efficient Exp…

200 papers

Building a dialogue agent to fulfill complex tasks, such as travel planning, is challenging because the agent has to learn to collectively complete multiple subtasks. For example, the agent needs to reserve a hotel and book a flight so that…

Computation and Language · Computer Science 2017-07-25 Baolin Peng , Xiujun Li , Lihong Li , Jianfeng Gao , Asli Celikyilmaz , Sungjin Lee , Kam-Fai Wong

Collaborative multi-agent exploration of unknown environments is crucial for search and rescue operations. Effective real-world deployment must address challenges such as limited inter-agent communication and static and dynamic obstacles.…

Robotics · Computer Science 2024-12-31 Gabriele Calzolari , Vidya Sumathy , Christoforos Kanellakis , George Nikolakopoulos

While Reinforcement Learning with Verifiable Rewards (RLVR) has proven effective for closed-ended tasks, extending it to open-ended social language games via self-play reveals a critical issue: evolution impasse. Due to the vast strategy…

Computation and Language · Computer Science 2026-05-12 Minzheng Wang , Run Luo , Yanbo Wang , Zichen Liu , Yuqiao Tan , Tao Tan , Xu Nan , Yinhe Zheng , Wenji Mao

On-policy reinforcement learning (RL) algorithms have demonstrated great potential in robotic control, where effective exploration is crucial for efficient and high-quality policy learning. However, how to encourage the agent to explore the…

Robotics · Computer Science 2026-04-02 Leixin Chang , Xinchen Yao , Ben Liu , Liangjing Yang , Hua Chen

Dialogue management (DM) decides the next action of a dialogue system according to the current dialogue state, and thus plays a central role in task-oriented dialogue systems. Since dialogue management requires to have access to not only…

Computation and Language · Computer Science 2018-05-14 Zheng Zhang , Minlie Huang , Zhongzhou Zhao , Feng Ji , Haiqing Chen , Xiaoyan Zhu

To train a statistical spoken dialogue system (SDS) it is essential that an accurate method for measuring task success is available. To date training has relied on presenting a task to either simulated or paid users and inferring the…

Machine Learning · Computer Science 2015-08-17 Pei-Hao Su , David Vandyke , Milica Gasic , Dongho Kim , Nikola Mrksic , Tsung-Hsien Wen , Steve Young

Deep reinforcement learning (DRL) has been proven its efficiency in capturing users' dynamic interests in recent literature. However, training a DRL agent is challenging, because of the sparse environment in recommender systems (RS), DRL…

Information Retrieval · Computer Science 2022-09-20 Xiaocong Chen , Siyu Wang , Lina Yao , Lianyong Qi , Yong Li

Despite recent advances in natural language understanding and generation, and decades of research on the development of conversational bots, building automated agents that can carry on rich open-ended conversations with humans "in the wild"…

Many task-oriented dialogue systems use deep reinforcement learning (DRL) to learn policies that respond to the user appropriately and complete the tasks successfully. Training DRL agents with diverse dialogue trajectories prepare them well…

Computation and Language · Computer Science 2021-06-10 Zhiwen Tang , Hrishikesh Kulkarni , Grace Hui Yang

Recently, reinforcement learning (RL) has been applied to task-oriented dialogue systems by using latent actions to solve shortcomings of supervised learning (SL). In this paper, we propose a multi-domain task-oriented dialogue system,…

Computation and Language · Computer Science 2021-07-08 Hyunmin Jeon , Gary Geunbae Lee

Reinforcement learning (RL) is a promising approach to solve dialogue policy optimisation. Traditional RL algorithms, however, fail to scale to large domains due to the curse of dimensionality. We propose a novel Dialogue Management…

Computation and Language · Computer Science 2018-03-09 Iñigo Casanueva , Paweł Budzianowski , Pei-Hao Su , Stefan Ultes , Lina Rojas-Barahona , Bo-Hsiang Tseng , Milica Gašić

In safety-critical decision-making scenarios being able to identify worst-case outcomes, or dead-ends is crucial in order to develop safe and reliable policies in practice. These situations are typically rife with uncertainty due to unknown…

Machine Learning · Computer Science 2023-01-31 Taylor W. Killian , Sonali Parbhoo , Marzyeh Ghassemi

A learning dialogue agent can infer its behaviour from interactions with the users. These interactions can be taken from either human-to-human or human-machine conversations. However, human interactions are scarce and costly, making…

Computation and Language · Computer Science 2020-12-10 Thibault Cordier , Tanguy Urvoy , Lina M. Rojas-Barahona , Fabrice Lefèvre

Effective exploration is a key challenge in reinforcement learning for large language models: discovering high-quality trajectories within a limited sampling budget from the vast natural language sequence space. Existing methods face…

Machine Learning · Computer Science 2026-02-17 Yiran Guo , Zhongjian Qiao , Yingqi Xie , Jie Liu , Dan Ye , Ruiqing Zhang , Shuang Qiu , Lijie Xu

Traditional task-oriented dialog systems are unable to evolve from ongoing interactions or adapt to new domains after deployment, that is a critical limitation in real-world dynamic environments. Continual learning approaches depend on…

Multiagent Systems · Computer Science 2026-04-15 Shuyu Zhang , Yujie Liu , Xinru Wang , Cheng Zhang , Yanmin Zhu , Bin Li

Task-oriented proactive dialogue agents play a pivotal role in recruitment, particularly for steering conversations towards specific business outcomes, such as acquiring social-media contacts for private-channel conversion. Although…

Artificial Intelligence · Computer Science 2026-01-09 Zhiyong Cao , Dunqiang Liu , Qi Dai , Haojun Xu , Huaiyan Xu , Huan He , Yafei Liu , Siyuan Liu , XiaoLin Lin , Ke Ma , Ruqian Shi , Sijia Yao , Hao Wang , Sicheng Zhou

Training chatbots using the reinforcement learning paradigm is challenging due to high-dimensional states, infinite action spaces and the difficulty in specifying the reward function. We address such problems using clustered actions instead…

Artificial Intelligence · Computer Science 2019-08-28 Heriberto Cuayáhuitl , Donghyeon Lee , Seonghan Ryu , Sungja Choi , Inchul Hwang , Jihie Kim

With adversarial or otherwise normal prompts, existing large language models (LLM) can be pushed to generate toxic discourses. One way to reduce the risk of LLMs generating undesired discourses is to alter the training of the LLM. This can…

Computation and Language · Computer Science 2023-02-28 Meng Cao , Mehdi Fatemi , Jackie Chi Kit Cheung , Samira Shabanian

Large Language Models (LLMs) have become a popular interface for human-AI interaction, supporting information seeking and task assistance through natural, multi-turn dialogue. To respond to users within multi-turn dialogues, the…

Computation and Language · Computer Science 2026-04-16 Fengran Mo , Yifan Gao , Sha Li , Hansi Zeng , Xin Liu , Zhaoxuan Tan , Xian Li , Jianshu Chen , Dakuo Wang , Meng Jiang

While a powerful and promising approach, deep reinforcement learning (DRL) still suffers from sample inefficiency, which can be notably improved by resorting to more sophisticated techniques to address the exploration-exploitation dilemma.…

Machine Learning · Computer Science 2024-09-10 Jianshu Hu , Paul Weng , Yutong Ban