English
Related papers

Related papers: Injecting linguistic knowledge into BERT for Dialo…

200 papers

Dialog state tracking (DST) is a core component in task-oriented dialog systems. Existing approaches for DST mainly fall into one of two categories, namely, ontology-based and ontology-free methods. An ontology-based method selects a value…

Computation and Language · Computer Science 2020-10-29 Jian-Guo Zhang , Kazuma Hashimoto , Chien-Sheng Wu , Yao Wan , Philip S. Yu , Richard Socher , Caiming Xiong

In task-oriented multi-turn dialogue systems, dialogue state refers to a compact representation of the user goal in the context of dialogue history. Dialogue state tracking (DST) is to estimate the dialogue state at each turn. Due to the…

Computation and Language · Computer Science 2020-09-23 Zhi Chen , Lu Chen , Yanbin Zhao , Su Zhu , Kai Yu

Learning an effective speaker representation is crucial for achieving reliable performance in speaker verification tasks. Speech signals are high-dimensional, long, and variable-length sequences containing diverse information at each…

Audio and Speech Processing · Electrical Eng. & Systems 2023-08-25 Wei Xia , John H. L. Hansen

Recent advances in pre-trained language models have significantly improved neural response generation. However, existing methods usually view the dialogue context as a linear sequence of tokens and learn to generate the next word through…

Computation and Language · Computer Science 2021-12-14 Xiaodong Gu , Kang Min Yoo , Jung-Woo Ha

Dialogue State Tracking (DST), a key component of task-oriented conversation systems, represents user intentions by determining the values of pre-defined slots in an ongoing dialogue. Existing approaches use hand-crafted templates and…

Computation and Language · Computer Science 2023-10-24 Praveen Venkateswaran , Evelyn Duesterwald , Vatche Isahagian

Recently BERT has been adopted for document encoding in state-of-the-art text summarization models. However, sentence-based extractive models often result in redundant or uninformative phrases in the extracted summaries. Also, long-range…

Computation and Language · Computer Science 2020-04-28 Jiacheng Xu , Zhe Gan , Yu Cheng , Jingjing Liu

Goal-oriented chatbots are essential for automating user tasks, such as booking flights or making restaurant reservations. A key component of these systems is Dialogue State Tracking (DST), which interprets user intent and maintains the…

Computation and Language · Computer Science 2025-03-28 Sejin Lee , Dongha Kim , Min Song

A Dialogue State Tracker is a key component in dialogue systems which estimates the beliefs of possible user goals at each dialogue turn. Deep learning approaches using recurrent neural networks have shown state-of-the-art performance for…

Computation and Language · Computer Science 2019-11-04 Vevake Balaraman , Bernardo Magnini

The performance of task-oriented dialogue models is strongly tied to how well they track dialogue states, which records and updates user information across multi-turn interactions. However, current multi-domain DST encounters two key…

Computation and Language · Computer Science 2026-03-12 Haoxiang Su , Ruiyu Fang , Liting Jiang , Xiaomeng Huang , Shuangyong Song

Dialogue state tracking (DST) aims at estimating the current dialogue state given all the preceding conversation. For multi-domain DST, the data sparsity problem is a major obstacle due to increased numbers of state candidates and dialogue…

Computation and Language · Computer Science 2020-10-08 Su Zhu , Jieyu Li , Lu Chen , Kai Yu

Recent works in dialogue state tracking (DST) focus on an open vocabulary-based setting to resolve scalability and generalization issues of the predefined ontology-based approaches. However, they are inefficient in that they predict the…

Computation and Language · Computer Science 2020-05-05 Sungdong Kim , Sohee Yang , Gyuwan Kim , Sang-Woo Lee

Large language models (LLMs) have demonstrated remarkable performance in zero-shot dialogue state tracking (DST), reducing the need for task-specific training. However, conventional DST benchmarks primarily focus on structured user-agent…

Computation and Language · Computer Science 2025-06-13 Sangmin Song , Juhwan Choi , JungMin Yun , YoungBin Kim

Recently, pre-trained contextual models, such as BERT, have shown to perform well in language related tasks. We revisit the design decisions that govern the applicability of these models for the passage re-ranking task in open-domain…

Information Retrieval · Computer Science 2021-08-31 Jurek Leonhardt , Fabian Beringer , Avishek Anand

Collecting and annotating task-oriented dialogues is time-consuming and costly; thus, zero and few shot learning could greatly benefit dialogue state tracking (DST). In this work, we propose an in-context learning (ICL) framework for…

Computation and Language · Computer Science 2022-10-27 Yushi Hu , Chia-Hsuan Lee , Tianbao Xie , Tao Yu , Noah A. Smith , Mari Ostendorf

Previous works on emotion recognition in conversation (ERC) follow a two-step paradigm, which can be summarized as first producing context-independent features via fine-tuning pretrained language models (PLMs) and then analyzing contextual…

Computation and Language · Computer Science 2023-01-18 Xiangyu Qin , Zhiyu Wu , Jinshi Cui , Tingting Zhang , Yanran Li , Jian Luan , Bin Wang , Li Wang

Popular approaches for Natural Language Understanding (NLU) usually rely on a huge amount of annotated data or handcrafted rules, which is laborious and not adaptive to domain extension. We recently proposed a Convex-Polytopic-Model-based…

Computation and Language · Computer Science 2022-01-27 Jingyan Zhou , Xiaohan Feng , King Keung Wu , Helen Meng

Task-oriented conversational systems often use dialogue state tracking to represent the user's intentions, which involves filling in values of pre-defined slots. Many approaches have been proposed, often using task-specific architectures…

Computation and Language · Computer Science 2021-09-17 Chia-Hsuan Lee , Hao Cheng , Mari Ostendorf

Tracking dialogue states is an essential topic in task-oriented dialogue systems, which involve filling in the necessary information in pre-defined slots corresponding to a schema. While general pre-trained language models have been shown…

Computation and Language · Computer Science 2023-11-14 Ruolin Su , Ting-Wei Wu , Biing-Hwang Juang

Dialog state tracking (DST) suffers from severe data sparsity. While many natural language processing (NLP) tasks benefit from transfer learning and multi-task learning, in dialog these methods are limited by the amount of available data…

Computation and Language · Computer Science 2020-11-19 Michael Heck , Carel van Niekerk , Nurul Lubis , Christian Geishauser , Hsien-Chin Lin , Marco Moresi , Milica Gašić

This paper is concerned with dialogue state tracking (DST) in a task-oriented dialogue system. Building a DST module that is highly effective is still a challenging issue, although significant progresses have been made recently. This paper…

Computation and Language · Computer Science 2021-06-01 Yue Feng , Yang Wang , Hang Li