English
Related papers

Related papers: A Corpus-free State2Seq User Simulator for Task-or…

200 papers

In this experiment, a model was devised, trained, and evaluated to automate psychotherapist/client text conversations through the use of state-of-the-art, Seq2Seq Transformer-based Natural Language Generation (NLG) systems. Through training…

Computation and Language · Computer Science 2021-04-22 Houjun Liu

Current state-of-the-art neural dialogue models learn from human conversations following the data-driven paradigm. As such, a reliable training corpus is the crux of building a robust and well-behaved dialogue model. However, due to the…

Computation and Language · Computer Science 2020-06-12 Hengyi Cai , Hongshen Chen , Yonghao Song , Cheng Zhang , Xiaofang Zhao , Dawei Yin

Reinforcement learning based dialogue policies are typically trained in interaction with a user simulator. To obtain an effective and robust policy, this simulator should generate user behaviour that is both realistic and varied. Current…

Computation and Language · Computer Science 2023-06-02 Simon Keizer , Caroline Dockes , Norbert Braunschweiler , Svetlana Stoyanchev , Rama Doddipatla

How to build and use dialogue data efficiently, and how to deploy models in different domains at scale can be two critical issues in building a task-oriented dialogue system. In this paper, we propose a novel manual-guided dialogue scheme…

Computation and Language · Computer Science 2022-08-17 Ryuichi Takanobu , Hao Zhou , Yankai Lin , Peng Li , Jie Zhou , Minlie Huang

Dialogue policy optimisation via reinforcement learning requires a large number of training interactions, which makes learning with real users time consuming and expensive. Many set-ups therefore rely on a user simulator instead of humans.…

Computation and Language · Computer Science 2021-06-17 Hsien-chin Lin , Nurul Lubis , Songbo Hu , Carel van Niekerk , Christian Geishauser , Michael Heck , Shutong Feng , Milica Gašić

Proactive task-oriented dialogue (TOD), such as outbound sales, demands a persuasive agent that actively probes the user's concerns and steers the conversation toward acceptance within a bounded number of turns. Yet post-trained LLMs are…

Artificial Intelligence · Computer Science 2026-05-22 Hongbin Zhang , Ning Gao , Yuqin Dai , Ruiyuan Wu , Jinpeng Wang , Rena Wei Gao , Bingdong Tan , Shuzheng Gao , Zongjie Li , Chaozheng Wang

Many studies have applied reinforcement learning to train a dialog policy and show great promise these years. One common approach is to employ a user simulator to obtain a large number of simulated user experiences for reinforcement…

Computation and Language · Computer Science 2020-04-24 Ryuichi Takanobu , Runze Liang , Minlie Huang

The recent paradigm shift toward large reasoning models (LRMs) as autonomous agents has intensified the demand for sophisticated, multi-turn tool-use capabilities. Yet, existing datasets and data-generation approaches are limited by static,…

Computation and Language · Computer Science 2026-01-14 Jungho Cho , Minbyul Jeong , Sungrae Park

Dialogue systems dealing with multi-domain tasks are highly required. How to record the state remains a key problem in a task-oriented dialogue system. Normally we use human-defined features as dialogue states and apply a state tracker to…

Computation and Language · Computer Science 2020-05-27 Shuke Peng , Xinjing Huang , Zehao Lin , Feng Ji , Haiqing Chen , Yin Zhang

Building dialogue systems requires a large corpus of annotated dialogues. Such datasets are usually created via crowdsourcing, which is expensive and time-consuming. In this paper, we propose \textsc{Dialogic}, a novel dialogue simulation…

Computation and Language · Computer Science 2023-06-07 Zekun Li , Wenhu Chen , Shiyang Li , Hong Wang , Jing Qian , Xifeng Yan

Next generation task-oriented dialog systems need to understand conversational contexts with their perceived surroundings, to effectively help users in the real-world multimodal environment. Existing task-oriented dialog datasets aimed…

Computation and Language · Computer Science 2021-10-22 Satwik Kottur , Seungwhan Moon , Alborz Geramifard , Babak Damavandi

Robust task-oriented spoken dialogue agents require exposure to the full diversity of how people interact through speech. Building spoken user simulators that address this requires large-scale spoken task-oriented dialogue (TOD) data…

Computation and Language · Computer Science 2026-03-18 Jonggeun Lee , Junseong Pyo , Jeongmin Park , Yohan Jo

We introduce end-to-end neural network based models for simulating users of task-oriented dialogue systems. User simulation in dialogue systems is crucial from two different perspectives: (i) automatic evaluation of different dialogue…

Computation and Language · Computer Science 2018-11-13 Izzeddin Gur , Dilek Hakkani-Tur , Gokhan Tur , Pararth Shah

Task-oriented proactive dialogue agents play a pivotal role in recruitment, particularly for steering conversations towards specific business outcomes, such as acquiring social-media contacts for private-channel conversion. Although…

Artificial Intelligence · Computer Science 2026-01-09 Zhiyong Cao , Dunqiang Liu , Qi Dai , Haojun Xu , Huaiyan Xu , Huan He , Yafei Liu , Siyuan Liu , XiaoLin Lin , Ke Ma , Ruqian Shi , Sijia Yao , Hao Wang , Sicheng Zhou

Algorithms for text-generation in dialogue can be misguided. For example, in task-oriented settings, reinforcement learning that optimizes only task-success can lead to abysmal lexical diversity. We hypothesize this is due to poor…

Computation and Language · Computer Science 2022-10-17 Anthony Sicilia , Malihe Alikhani

A major bottleneck for building statistical spoken dialogue systems for new domains and applications is the need for large amounts of training data. To address this problem, we adopt the multi-dimensional approach to dialogue management and…

Computation and Language · Computer Science 2022-04-15 Simon Keizer , Norbert Braunschweiler , Svetlana Stoyanchev , Rama Doddipatla

To train a statistical spoken dialogue system (SDS) it is essential that an accurate method for measuring task success is available. To date training has relied on presenting a task to either simulated or paid users and inferring the…

Machine Learning · Computer Science 2015-08-17 Pei-Hao Su , David Vandyke , Milica Gasic , Dongho Kim , Nikola Mrksic , Tsung-Hsien Wen , Steve Young

Dialogue State Tracking (DST) is designed to monitor the evolving dialogue state in the conversations and plays a pivotal role in developing task-oriented dialogue systems. However, obtaining the annotated data for the DST task is usually a…

Computation and Language · Computer Science 2024-05-24 Cheng Niu , Xingguang Wang , Xuxin Cheng , Juntong Song , Tong Zhang

There is an increasing demand for task-oriented dialogue systems which can assist users in various activities such as booking tickets and restaurant reservations. In order to complete dialogues effectively, dialogue policy plays a key role…

Computation and Language · Computer Science 2019-09-23 Tian Lan , Xianling Mao , Heyan Huang

The rise of agentic systems that combine orchestration, tool use, and conversational capabilities, has been more visible by the recent advent of large language models (LLMs). While open-domain frameworks exist, applying them in private…

Multiagent Systems · Computer Science 2025-11-14 Won Ik Cho , Woonghee Han , Kyung Seo Ki , Young Min Kim