English
Related papers

Related papers: Multimodal Dialogue State Tracking

200 papers

Building an end-to-end conversational agent for multi-domain task-oriented dialogues has been an open challenge for two main reasons. First, tracking dialogue states of multiple domains is non-trivial as the dialogue agent must obtain…

Computation and Language · Computer Science 2020-11-17 Hung Le , Doyen Sahoo , Chenghao Liu , Nancy F. Chen , Steven C. H. Hoi

The consistency between the semantic information provided by the multi-modal reference and the tracked object is crucial for visual-language (VL) tracking. However, existing VL tracking frameworks rely on static multi-modal references to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Xiaohai Li , Bineng Zhong , Qihua Liang , Zhiyi Mo , Jian Nong , Shuxiang Song

Dialogue state tracking (DST) plays an important role in task-oriented dialogue systems. However, collecting a large amount of turn-by-turn annotated dialogue data is costly and inefficient. In this paper, we propose a novel turn-level…

Computation and Language · Computer Science 2023-10-24 Zihan Zhang , Meng Fang , Fanghua Ye , Ling Chen , Mohammad-Reza Namazi-Rad

Task-oriented conversational systems often use dialogue state tracking to represent the user's intentions, which involves filling in values of pre-defined slots. Many approaches have been proposed, often using task-specific architectures…

Computation and Language · Computer Science 2021-09-17 Chia-Hsuan Lee , Hao Cheng , Mari Ostendorf

A typical conversation comprises of multiple turns between participants where they go back-and-forth between different topics. At each user turn, dialogue state tracking (DST) aims to estimate user's goal by processing the current…

Computation and Language · Computer Science 2019-04-08 Sanuj Sharma , Prafulla Kumar Choubey , Ruihong Huang

While multimodal conversation agents are gaining importance in several domains such as retail, travel etc., deep learning research in this area has been limited primarily due to the lack of availability of large-scale, open chatlogs. To…

Computation and Language · Computer Science 2018-02-01 Amrita Saha , Mitesh Khapra , Karthik Sankaranarayanan

Dialog State Tracking (DST), an integral part of modern dialog systems, aims to track user preferences and constraints (slots) in task-oriented dialogs. In real-world settings with constantly changing services, DST systems must generalize…

Computation and Language · Computer Science 2021-01-22 Shuyang Li , Jin Cao , Mukund Sridhar , Henghui Zhu , Shang-Wen Li , Wael Hamza , Julian McAuley

Dialogue state modules are a useful component in a task-oriented dialogue system. Traditional methods find dialogue states by manually labeling training corpora, upon which neural models are trained. However, the labeling process can be…

Computation and Language · Computer Science 2020-08-14 Qingkai Min , Libo Qin , Zhiyang Teng , Xiao Liu , Yue Zhang

Most recently proposed approaches in dialogue state tracking (DST) leverage the context and the last dialogue states to track current dialogue states, which are often slot-value pairs. Although the context contains the complete dialogue…

Computation and Language · Computer Science 2021-07-13 Jingyao Zhou , Haipang Wu , Zehao Lin , Guodun Li , Yin Zhang

Recent efforts in Dialogue State Tracking (DST) for task-oriented dialogues have progressed toward open-vocabulary or generation-based approaches where the models can generate slot value candidates from the dialogue history itself. These…

Computation and Language · Computer Science 2020-02-25 Hung Le , Richard Socher , Steven C. H. Hoi

This paper gives an overview of the Schema-Guided Dialogue State Tracking task of the 8th Dialogue System Technology Challenge. The goal of this task is to develop dialogue state tracking models suitable for large-scale virtual assistants,…

Computation and Language · Computer Science 2020-02-05 Abhinav Rastogi , Xiaoxue Zang , Srinivas Sunkara , Raghav Gupta , Pranav Khaitan

Dialogue systems dealing with multi-domain tasks are highly required. How to record the state remains a key problem in a task-oriented dialogue system. Normally we use human-defined features as dialogue states and apply a state tracker to…

Computation and Language · Computer Science 2020-05-27 Shuke Peng , Xinjing Huang , Zehao Lin , Feng Ji , Haiqing Chen , Yin Zhang

Existing approaches to Dialogue State Tracking (DST) rely on turn level dialogue state annotations, which are expensive to acquire in large scale. In call centers, for tasks like managing bookings or subscriptions, the user goal can be…

Computation and Language · Computer Science 2021-01-29 Shuailong Liang , Lahari Poddar , Gyuri Szarvas

Tracking the state of the conversation is a central component in task-oriented spoken dialogue systems. One such approach for tracking the dialogue state is slot carryover, where a model makes a binary decision if a slot from the context is…

Computation and Language · Computer Science 2019-06-05 Tongfei Chen , Chetan Naik , Hua He , Pushpendre Rastogi , Lambert Mathias

In Task-Oriented Dialogue (TOD) systems, correctly updating the system's understanding of the user's requests (\textit{a.k.a} dialogue state tracking) is key to a smooth interaction. Traditionally, TOD systems perform this update in three…

Computation and Language · Computer Science 2024-07-02 Lucas Druart , Valentin Vielzeuf , Yannick Estève

A Dialogue State Tracker (DST) is a key component in a dialogue system aiming at estimating the beliefs of possible user goals at each dialogue turn. Most of the current DST trackers make use of recurrent neural networks and are based on…

Computation and Language · Computer Science 2019-10-23 Vevake Balaraman , Bernardo Magnini

This paper presents a hybrid dialog state tracker enhanced by trainable Spoken Language Understanding (SLU) for slot-filling dialog systems. Our architecture is inspired by previously proposed neural-network-based belief-tracking systems.…

Computation and Language · Computer Science 2017-02-22 Miroslav Vodolán , Rudolf Kadlec , Jan Kleindienst

The Dialog State Tracking Challenge 4 (DSTC 4) differentiates itself from the previous three editions as follows: the number of slot-value pairs present in the ontology is much larger, no spoken language understanding output is given, and…

Computation and Language · Computer Science 2016-05-10 Franck Dernoncourt , Ji Young Lee , Trung H. Bui , Hung H. Bui

We present a novel approach to dialogue state tracking and referring expression resolution tasks. Successful contextual understanding of multi-turn spoken dialogues requires resolving referring expressions across turns and tracking the…

Computation and Language · Computer Science 2019-04-02 Pushpendre Rastogi , Arpit Gupta , Tongfei Chen , Lambert Mathias

Goal-oriented chatbots are essential for automating user tasks, such as booking flights or making restaurant reservations. A key component of these systems is Dialogue State Tracking (DST), which interprets user intent and maintains the…

Computation and Language · Computer Science 2025-03-28 Sejin Lee , Dongha Kim , Min Song