English
Related papers

Related papers: Large Language Models as Zero-shot Dialogue State …

200 papers

Zero-shot dialogue understanding aims to enable dialogue to track the user's needs without any training data, which has gained increasing attention. In this work, we investigate the understanding ability of ChatGPT for zero-shot dialogue…

Computation and Language · Computer Science 2023-04-11 Wenbo Pan , Qiguang Chen , Xiao Xu , Wanxiang Che , Libo Qin

Task-oriented dialog (TOD) systems facilitate users in accomplishing complex, multi-turn tasks through natural language. While instruction-tuned large language models (LLMs) have demonstrated strong performance on a range of single-turn NLP…

Computation and Language · Computer Science 2025-12-29 Moghis Fereidouni , Md Sajid Ahmed , Adib Mosharrof , A. B. Siddique

We present a generative dialogue system capable of operating in a full-duplex manner, allowing for seamless interaction. It is based on a large language model (LLM) carefully aligned to be aware of a perception module, a motor function…

Computation and Language · Computer Science 2024-10-30 Peng Wang , Songshuo Lu , Yaohua Tang , Sijie Yan , Wei Xia , Yuanjun Xiong

Task-oriented dialogue systems often employ a Dialogue State Tracker (DST) to successfully complete conversations. Recent state-of-the-art DST implementations rely on schemata of diverse services to improve model robustness and handle…

Computation and Language · Computer Science 2022-07-05 Eleftherios Kapelonis , Efthymios Georgiou , Alexandros Potamianos

Building end-to-end task bots and maintaining their integration with new functionalities using minimal human efforts is a long-standing challenge in dialog research. Recently large language models (LLMs) have demonstrated exceptional…

Computation and Language · Computer Science 2023-05-17 Xiaoying Zhang , Baolin Peng , Kun Li , Jingyan Zhou , Helen Meng

Recently, Large Language Models (LLMs) have emerged as an alternative to training task-specific dialog agents, due to their broad reasoning capabilities and performance in zero-shot learning scenarios. However, many LLM-based dialog systems…

Computation and Language · Computer Science 2025-03-05 Dirk Väth , Ngoc Thang Vu

Large language models (LLMs) have demonstrated self-improvement capabilities via feedback and refinement, but current small language models (SLMs) have had limited success in this area. Existing correction approaches often rely on…

Computation and Language · Computer Science 2024-10-25 Chia-Hsuan Lee , Hao Cheng , Mari Ostendorf

Dialogue systems and large language models (LLMs) have gained considerable attention. However, the direct utilization of LLMs as task-oriented dialogue (TOD) models has been found to underperform compared to smaller task-specific models.…

Computation and Language · Computer Science 2023-10-20 Zhiyuan Hu , Yue Feng , Anh Tuan Luu , Bryan Hooi , Aldo Lipani

Dialog State Tracking (DST), an integral part of modern dialog systems, aims to track user preferences and constraints (slots) in task-oriented dialogs. In real-world settings with constantly changing services, DST systems must generalize…

Computation and Language · Computer Science 2021-01-22 Shuyang Li , Jin Cao , Mukund Sridhar , Henghui Zhu , Shang-Wen Li , Wael Hamza , Julian McAuley

Recently, various methods have been proposed to create open-domain conversational agents with Large Language Models (LLMs). These models are able to answer user queries, but in a one-way Q&A format rather than a true conversation.…

Computation and Language · Computer Science 2024-07-02 Ahmed Njifenjou , Virgile Sucal , Bassam Jabaian , Fabrice Lefèvre

Dialogue state tracking (DST) is evaluated by exact matching methods, which rely on large amounts of labeled data and ignore semantic consistency, leading to over-evaluation. Currently, leveraging large language models (LLM) in evaluating…

Computation and Language · Computer Science 2024-06-18 Ming Gu , Yan Yang

Dialogue state tracking (DST) is an important step in dialogue management to keep track of users' beliefs. Existing works fine-tune all language model (LM) parameters to tackle the DST task, which requires significant data and computing…

Computation and Language · Computer Science 2023-05-31 Mingyu Derek Ma , Jiun-Yu Kao , Shuyang Gao , Arpit Gupta , Di Jin , Tagyoung Chung , Nanyun Peng

End-to-end Task-Oriented Dialog (TOD) systems typically require extensive training datasets to perform well. In contrast, large language model (LLM) based TOD systems can excel even with limited data due to their ability to learn tasks…

Computation and Language · Computer Science 2024-10-21 Vishal Vivek Saley , Rocktim Jyoti Das , Dinesh Raghu , Mausam

The recent development of language models has shown promising results by achieving state-of-the-art performance on various natural language tasks by fine-tuning pretrained models. In task-oriented dialogue (ToD) systems, language models can…

Computation and Language · Computer Science 2022-01-24 Vinsen Marselino Andreas , Genta Indra Winata , Ayu Purwarianti

Zero-shot domain adaptation for dialogue state tracking (DST) remains a challenging problem in task-oriented dialogue (TOD) systems, where models must generalize to target domains unseen at training time. Current large language model…

Computation and Language · Computer Science 2025-02-24 Christopher Richardson , Roshan Sharma , Neeraj Gaur , Parisa Haghani , Anirudh Sundar , Bhuvana Ramabhadran

One of the major impediments to the development of new task-oriented dialogue (TOD) systems is the need for human evaluation at multiple stages and iterations of the development process. In an effort to move toward automated evaluation of…

Computation and Language · Computer Science 2023-09-26 Sam Davidson , Salvatore Romeo , Raphael Shu , James Gung , Arshit Gupta , Saab Mansour , Yi Zhang

Developing high-performing dialogue systems benefits from the automatic identification of undesirable behaviors in system responses. However, detecting such behaviors remains challenging, as it draws on a breadth of general knowledge and…

Computation and Language · Computer Science 2023-09-14 Sarah E. Finch , Ellie S. Paek , Jinho D. Choi

Given the great success of large language models (LLMs) across various tasks, in this paper, we introduce LLM-ST, a novel and effective speech translation model constructed upon a pre-trained LLM. By integrating the large language model…

Computation and Language · Computer Science 2023-12-22 Zhichao Huang , Rong Ye , Tom Ko , Qianqian Dong , Shanbo Cheng , Mingxuan Wang , Hang Li

Traditionally, offline datasets have been used to evaluate task-oriented dialogue (TOD) models. These datasets lack context awareness, making them suboptimal benchmarks for conversational systems. In contrast, user-agents, which are…

Computation and Language · Computer Science 2024-11-18 Taaha Kazi , Ruiliang Lyu , Sizhe Zhou , Dilek Hakkani-Tur , Gokhan Tur

Dialogue State Tracking (DST), a crucial component of task-oriented dialogue (ToD) systems, keeps track of all important information pertaining to dialogue history: filling slots with the most probable values throughout the conversation.…

Computation and Language · Computer Science 2023-02-28 Han Zhou , Ignacio Iacobacci , Pasquale Minervini