English
Related papers

Related papers: ChatGPT for Zero-shot Dialogue State Tracking: A S…

200 papers

A Dialogue State Tracker (DST) is a key component in a dialogue system aiming at estimating the beliefs of possible user goals at each dialogue turn. Most of the current DST trackers make use of recurrent neural networks and are based on…

Computation and Language · Computer Science 2019-10-23 Vevake Balaraman , Bernardo Magnini

We tackle the Dialogue Belief State Tracking(DST) problem of task-oriented conversational systems. Recent approaches to this problem leveraging Transformer-based models have yielded great results. However, training these models is…

Computation and Language · Computer Science 2022-04-19 Debjoy Saha , Bishal Santra , Pawan Goyal

This paper aims to quantitatively evaluate the performance of ChatGPT, an interactive large language model, on inter-sentential relations such as temporal relations, causal relations, and discourse relations. Given ChatGPT's promising…

Computation and Language · Computer Science 2024-01-29 Chunkit Chan , Jiayang Cheng , Weiqi Wang , Yuxin Jiang , Tianqing Fang , Xin Liu , Yangqiu Song

End-to-end spoken dialogue state tracking (DST) is made difficult by the tandem of having to handle speech input and data scarcity. Combining speech foundation encoders and large language models has been proposed in recent work as to…

Computation and Language · Computer Science 2025-12-01 Katia Vendrame , Bolaji Yusuf , Santosh Kesiraju , Šimon Sedláček , Oldřich Plchot , Jan Černocký

Educational chatbots come with a promise of interactive and personalized learning experiences, yet their development has been limited by the restricted free interaction capabilities of available platforms and the difficulty of encoding…

This paper describes our approach in DSTC 8 Track 4: Schema-Guided Dialogue State Tracking. The goal of this task is to predict the intents and slots in each user turn to complete the dialogue state tracking (DST) based on the information…

Computation and Language · Computer Science 2020-02-04 Yue Ma , Zengfeng Zeng , Dawei Zhu , Xuan Li , Yiying Yang , Xiaoyuan Yao , Kaijie Zhou , Jianping Shen

Traditional dialogue state tracking approaches heavily rely on extensive training data and handcrafted features, limiting their scalability and adaptability to new domains. In this paper, we propose a novel method that leverages inference…

Computation and Language · Computer Science 2024-09-11 Jihyun Lee , Gary Geunbae Lee

Although large language models(LLMs) show amazing capabilities, among various exciting applications discovered for LLMs fall short in other low-resource languages. Besides, most existing methods depend on large-scale dialogue corpora and…

Computation and Language · Computer Science 2024-08-19 Yongkang Liu , Feng Shi , Daling Wang , Yifei Zhang , Hinrich Schütze

Dialog state tracking (DST) suffers from severe data sparsity. While many natural language processing (NLP) tasks benefit from transfer learning and multi-task learning, in dialog these methods are limited by the amount of available data…

Computation and Language · Computer Science 2020-11-19 Michael Heck , Carel van Niekerk , Nurul Lubis , Christian Geishauser , Hsien-Chin Lin , Marco Moresi , Milica Gašić

Dialogue state tracking (DST) is at the heart of task-oriented dialogue systems. However, the scarcity of labeled data is an obstacle to building accurate and robust state tracking systems that work across a variety of domains. Existing…

Computation and Language · Computer Science 2020-04-14 Shuyang Gao , Sanchit Agarwal , Tagyoung Chung , Di Jin , Dilek Hakkani-Tur

A Dialogue State Tracker is a key component in dialogue systems which estimates the beliefs of possible user goals at each dialogue turn. Deep learning approaches using recurrent neural networks have shown state-of-the-art performance for…

Computation and Language · Computer Science 2019-11-04 Vevake Balaraman , Bernardo Magnini

Zero/few-shot transfer to unseen services is a critical challenge in task-oriented dialogue research. The Schema-Guided Dialogue (SGD) dataset introduced a paradigm for enabling models to support any service in zero-shot through schemas,…

Computation and Language · Computer Science 2022-08-24 Harrison Lee , Raghav Gupta , Abhinav Rastogi , Yuan Cao , Bin Zhang , Yonghui Wu

Zero-shot transfer learning for Dialogue State Tracking (DST) helps to handle a variety of task-oriented dialogue domains without the cost of collecting in-domain data. Existing works mainly study common data- or model-level augmentation…

Computation and Language · Computer Science 2023-06-02 Qingyue Wang , Liang Ding , Yanan Cao , Yibing Zhan , Zheng Lin , Shi Wang , Dacheng Tao , Li Guo

With the demanding need for deploying dialogue systems in new domains with less cost, zero-shot dialogue state tracking (DST), which tracks user's requirements in task-oriented dialogues without training on desired domains, draws attention…

Computation and Language · Computer Science 2023-02-28 Ruolin Su , Jingfeng Yang , Ting-Wei Wu , Biing-Hwang Juang

Recent works that revealed the vulnerability of dialogue state tracking (DST) models to distributional shifts have made holistic comparisons on robustness and qualitative analyses increasingly important for understanding their relative…

Zero-shot dialogue state tracking (DST) transfers knowledge to unseen domains, reducing the cost of annotating new datasets. Previous zero-shot DST models mainly suffer from domain transferring and partial prediction problems. To address…

Computation and Language · Computer Science 2024-04-15 Tianwen Tang , Tong Zhu , Haodong Liu , Yin Bai , Jia Cheng , Wenliang Chen

ChatGPT is a large language model developed by OpenAI. Despite its impressive performance across various tasks, no prior work has investigated its capability in the biomedical domain yet. To this end, this paper aims to evaluate the…

Computation and Language · Computer Science 2023-08-25 Israt Jahan , Md Tahmid Rahman Laskar , Chun Peng , Jimmy Huang

The traditional Dialogue State Tracking (DST) problem aims to track user preferences and intents in user-agent conversations. While sufficient for task-oriented dialogue systems supporting narrow domain applications, the advent of Large…

Computation and Language · Computer Science 2023-09-19 Sarkar Snigdha Sarathi Das , Chirag Shah , Mengting Wan , Jennifer Neville , Longqi Yang , Reid Andersen , Georg Buscher , Tara Safavi

We investigate the potential of ChatGPT as a multidimensional evaluator for the task of \emph{Text Style Transfer}, alongside, and in comparison to, existing automatic metrics as well as human judgements. We focus on a zero-shot setting,…

Computation and Language · Computer Science 2023-04-27 Huiyuan Lai , Antonio Toral , Malvina Nissim

This paper introduces one of our group's work on the Dialog System Technology Challenges 8 (DSTC8), the SPPD system for Schema Guided dialogue state tracking challenge. This challenge, named as Track 4 in DSTC8, provides a brand new and…

Computation and Language · Computer Science 2020-06-17 Miao Li , Haoqi Xiong , Yunbo Cao