English
Related papers

Related papers: Reliable LLM-based User Simulator for Task-Oriente…

200 papers

Large Language Models have demonstrated remarkable capabilities in open-domain dialogues. However, current methods exhibit suboptimal performance in service dialogues, as they rely on noisy, low-quality human conversation data. This…

Computation and Language · Computer Science 2026-05-06 Yuqin Dai , Ning Gao , Wei Zhang , Jie Wang , Zichen Luo , Jinpeng Wang , Yujie Wang , Ruiyuan Wu , Chaozheng Wang

The emergence of Large Language Models (LLMs), has opened exciting possibilities for constructing computational simulations designed to replicate human behavior accurately. Current research suggests that LLM-based agents become increasingly…

Computation and Language · Computer Science 2024-12-18 Amir Taubenfeld , Yaniv Dover , Roi Reichart , Ariel Goldstein

In task-oriented dialogue (ToD), a user holds a conversation with an artificial agent to complete a concrete task. Although this technology represents one of the central objectives of AI and has been the focus of ever more intense research…

Computation and Language · Computer Science 2022-05-27 Evgeniia Razumovskaia , Goran Glavaš , Olga Majewska , Edoardo M. Ponti , Anna Korhonen , Ivan Vulić

The manual translation of unstructured team dialogue into the structured artifacts required for Information Technology (IT) project governance is a critical bottleneck in modern information systems management. We introduce DevNous, a Large…

Computation and Language · Computer Science 2025-08-13 Stavros Doropoulos , Stavros Vologiannidis , Ioannis Magnisalis

Task-Oriented Dialogue (TOD) systems are designed to fulfill user requests through natural language interactions, yet existing systems often produce generic, monotonic responses that lack individuality and fail to adapt to users' personal…

Computation and Language · Computer Science 2025-04-25 Jihyun Lee , Yejin Jeon , Seungyeon Seo , Gary Geunbae Lee

Goal-driven persuasive dialogue, exemplified by applications like telemarketing, requires sophisticated multi-turn planning and strict factual faithfulness, which remains a significant challenge for even state-of-the-art Large Language…

Computation and Language · Computer Science 2025-11-18 Qingyu Zhang , Chunlei Xin , Xuanang Chen , Yaojie Lu , Hongyu Lin , Xianpei Han , Le Sun , Qing Ye , Qianlong Xie , Xingxing Wang

An effective multi-turn instruction-following assistant can be developed by creating a simulator that can generate useful interaction data. Apart from relying on its intrinsic weights, an ideal user simulator should also be able to…

Human-Computer Interaction · Computer Science 2024-01-31 Kaustubh D. Dhole

Dialogue management (DM) decides the next action of a dialogue system according to the current dialogue state, and thus plays a central role in task-oriented dialogue systems. Since dialogue management requires to have access to not only…

Computation and Language · Computer Science 2018-05-14 Zheng Zhang , Minlie Huang , Zhongzhou Zhao , Feng Ji , Haiqing Chen , Xiaoyan Zhu

Current medical AI systems often fail to replicate real-world clinical reasoning, as they are predominantly trained and evaluated on static text and question-answer tasks. These tuning methods and benchmarks overlook critical aspects like…

Computation and Language · Computer Science 2026-02-24 Zijie Liu , Xinyu Zhao , Jie Peng , Zhuangdi Zhu , Qingyu Chen , Kaidi Xu , Xia Hu , Tianlong Chen

We present NLU++, a novel dataset for natural language understanding (NLU) in task-oriented dialogue (ToD) systems, with the aim to provide a much more challenging evaluation environment for dialogue NLU models, up to date with the current…

Computation and Language · Computer Science 2022-05-06 Iñigo Casanueva , Ivan Vulić , Georgios P. Spithourakis , Paweł Budzianowski

Task oriented dialog agents provide a natural language interface for users to complete their goal. Dialog State Tracking (DST), which is often a core component of these systems, tracks the system's understanding of the user's goal…

Computation and Language · Computer Science 2020-02-21 Adarsh Kumar , Peter Ku , Anuj Kumar Goyal , Angeliki Metallinou , Dilek Hakkani-Tur

Recent advances in large language models (LLMs) have increased the demand for comprehensive benchmarks to evaluate their capabilities as human-like agents. Existing benchmarks, while useful, often focus on specific application scenarios,…

Large Language Models (LLMs) have been widely adopted to enhance Task-Oriented Dialogue Systems (TODS) by modeling complex language patterns and delivering contextually appropriate responses. However, this integration introduces significant…

Computation and Language · Computer Science 2026-03-05 Shuo Zhang , Junzhou Zhao , Junji Hou , Pinghui Wang , Chenxu Wang , Jing Tao

Dialogue state tracking (DST) is a key component of task-oriented dialogue systems. DST estimates the user's goal at each user turn given the interaction until then. State of the art approaches for state tracking rely on deep learning…

Computation and Language · Computer Science 2018-01-03 Abhinav Rastogi , Dilek Hakkani-Tur , Larry Heck

This study proposes augmenting dialog data with think-aloud utterances (TAUs) for modeling individual personalities in text chat by LLM. TAU is a verbalization of a speaker's thought before articulating the utterance. We expect "persona…

Computation and Language · Computer Science 2025-10-30 Seiya Ishikura , Hiroaki Yamada , Tatsuya Hiraoka , Hiroaki Yamada , Takenobu Tokunaga

Dialogue act annotations are important to improve response generation quality in task-oriented dialogue systems. However, it can be challenging to use dialogue acts to control response generation in a generalizable way because different…

Computation and Language · Computer Science 2023-08-03 Qingyang Wu , James Gung , Raphael Shu , Yi Zhang

This survey provides a comprehensive review of research on multi-turn dialogue systems, with a particular focus on multi-turn dialogue systems based on large language models (LLMs). This paper aims to (a) give a summary of existing LLMs and…

Computation and Language · Computer Science 2025-08-18 Zihao Yi , Jiarui Ouyang , Zhe Xu , Yuwen Liu , Tianhao Liao , Haohao Luo , Ying Shen

Neural task-oriented dialogue systems often struggle to smoothly interface with a knowledge base. In this work, we seek to address this problem by proposing a new neural dialogue agent that is able to effectively sustain grounded,…

Computation and Language · Computer Science 2017-07-17 Mihail Eric , Christopher D. Manning

This paper presents Dialogos, a real-time system for human-machine spoken dialogue on the telephone in task-oriented domains. The system has been tested in a large trial with inexperienced users and it has proved robust enough to allow…

Estimation of a model's confidence on its outputs is critical for Conversational AI systems based on large language models (LLMs), especially for reducing hallucination and preventing over-reliance. In this work, we provide an exhaustive…

Computation and Language · Computer Science 2024-09-24 Yi-Jyun Sun , Suvodip Dey , Dilek Hakkani-Tur , Gokhan Tur