English
Related papers

Related papers: PromptAttack: Probing Dialogue State Trackers with…

200 papers

The prompt-based learning paradigm, which bridges the gap between pre-training and fine-tuning, achieves state-of-the-art performance on several NLP tasks, particularly in few-shot settings. Despite being widely applied, prompt-based…

Computation and Language · Computer Science 2024-02-05 Shuai Zhao , Jinming Wen , Luu Anh Tuan , Junbo Zhao , Jie Fu

Goal-oriented chatbots are essential for automating user tasks, such as booking flights or making restaurant reservations. A key component of these systems is Dialogue State Tracking (DST), which interprets user intent and maintains the…

Computation and Language · Computer Science 2025-03-28 Sejin Lee , Dongha Kim , Min Song

End-to-end spoken dialogue state tracking (DST) is made difficult by the tandem of having to handle speech input and data scarcity. Combining speech foundation encoders and large language models has been proposed in recent work as to…

Computation and Language · Computer Science 2025-12-01 Katia Vendrame , Bolaji Yusuf , Santosh Kesiraju , Šimon Sedláček , Oldřich Plchot , Jan Černocký

Dialog state tracking (DST) suffers from severe data sparsity. While many natural language processing (NLP) tasks benefit from transfer learning and multi-task learning, in dialog these methods are limited by the amount of available data…

Computation and Language · Computer Science 2020-11-19 Michael Heck , Carel van Niekerk , Nurul Lubis , Christian Geishauser , Hsien-Chin Lin , Marco Moresi , Milica Gašić

Recent works that revealed the vulnerability of dialogue state tracking (DST) models to distributional shifts have made holistic comparisons on robustness and qualitative analyses increasingly important for understanding their relative…

Pre-trained language models (PLM) have marked a huge leap in neural dialogue modeling. While PLMs are pre-trained on large-scale text corpora, they are usually fine-tuned on scarce dialogue data with specific domain knowledge and dialogue…

Computation and Language · Computer Science 2021-12-14 Xiaodong Gu , Kang Min Yoo , Sang-Woo Lee

We consider a new perspective on dialog state tracking (DST), the task of estimating a user's goal through the course of a dialog. By formulating DST as a semantic parsing task over hierarchical representations, we can incorporate semantic…

Text entry is an essential task in our day-to-day digital interactions. Numerous intelligent features have been developed to streamline this process, making text entry more effective, efficient, and fluid. These improvements include…

Computation and Language · Computer Science 2023-10-17 Junxiao Shen , John J. Dudley , Jingyao Zheng , Bill Byrne , Per Ola Kristensson

Prompt learning is an effective way to exploit the potential of large-scale pre-trained foundational models. Continuous prompts parameterize context tokens in prompts by turning them into differentiable vectors. Deep continuous prompts…

Machine Learning · Computer Science 2025-01-03 Zhenhan Huang , Tejaswini Pedapati , Pin-Yu Chen , Jianxi Gao

Large-scale pre-trained language models have contributed significantly to natural language processing by demonstrating remarkable abilities as few-shot learners. However, their effectiveness depends mainly on scaling the model parameters…

Computation and Language · Computer Science 2023-01-26 Ningyu Zhang , Luoqiu Li , Xiang Chen , Shumin Deng , Zhen Bi , Chuanqi Tan , Fei Huang , Huajun Chen

Although there have been remarkable advances in dialogue systems through the dialogue systems technology competition (DSTC), it remains one of the key challenges to building a robust task-oriented dialogue system with a speech interface.…

Computation and Language · Computer Science 2024-01-10 Jaeseok Yoon , Seunghyun Hwang , Ran Han , Jeonguk Bang , Kee-Eung Kim

A Dialogue State Tracker (DST) is a key component in a dialogue system aiming at estimating the beliefs of possible user goals at each dialogue turn. Most of the current DST trackers make use of recurrent neural networks and are based on…

Computation and Language · Computer Science 2019-10-23 Vevake Balaraman , Bernardo Magnini

Dialogue State Tracking (DST) is crucial for understanding user needs and executing appropriate system actions in task-oriented dialogues. Majority of existing DST methods are designed to work within predefined ontologies and assume the…

Computation and Language · Computer Science 2025-03-11 Abdulfattah Safa , Gözde Gül Şahin

Dialogue State Tracking (DST) forms a core component of automated chatbot based systems designed for specific goals like hotel, taxi reservation, tourist information, etc. With the increasing need to deploy such systems in new domains,…

Computation and Language · Computer Science 2021-04-06 Saket Dingliwal , Bill Gao , Sanchit Agarwal , Chien-Wei Lin , Tagyoung Chung , Dilek Hakkani-Tur

Task-oriented dialogue (TOD) systems are required to identify key information from conversations for the completion of given tasks. Such information is conventionally specified in terms of intents and slots contained in task-specific…

Computation and Language · Computer Science 2022-01-25 Jeffrey Zhao , Raghav Gupta , Yuan Cao , Dian Yu , Mingqiu Wang , Harrison Lee , Abhinav Rastogi , Izhak Shafran , Yonghui Wu

This paper surveys and organizes research works in a new paradigm in natural language processing, which we dub "prompt-based learning". Unlike traditional supervised learning, which trains a model to take in an input x and predict an output…

Computation and Language · Computer Science 2021-07-30 Pengfei Liu , Weizhe Yuan , Jinlan Fu , Zhengbao Jiang , Hiroaki Hayashi , Graham Neubig

Sequence-to-sequence state-of-the-art systems for dialogue state tracking (DST) use the full dialogue history as input, represent the current state as a list with all the slots, and generate the entire state from scratch at each dialogue…

Computation and Language · Computer Science 2024-10-17 Pietro Lesci , Yoshinari Fujinuma , Momchil Hardalov , Chao Shang , Yassine Benajiba , Lluis Marquez

In-context learning with Large Language Models (LLMs) has emerged as a promising avenue of research in Dialog State Tracking (DST). However, the best-performing in-context learning methods involve retrieving and adding similar examples to…

Computation and Language · Computer Science 2024-02-06 Atharva Kulkarni , Bo-Hsiang Tseng , Joel Ruben Antony Moniz , Dhivya Piraviperumal , Hong Yu , Shruti Bhargava

Task oriented language understanding in dialog systems is often modeled using intents (task of a query) and slots (parameters for that task). Intent detection and slot tagging are, in turn, modeled using sentence classification and word…

Computation and Language · Computer Science 2019-11-14 Arash Einolghozati , Sonal Gupta , Mrinal Mohit , Rushin Shah

Multi-domain dialogue state tracking (DST) is a critical component for conversational AI systems. The domain ontology (i.e., specification of domains, slots, and values) of a conversational AI system is generally incomplete, making the…

Computation and Language · Computer Science 2020-06-23 Li Zhou , Kevin Small