English
Related papers

Related papers: Common Ground Tracking in Multimodal Dialogue

200 papers

Dialogue State Tracking (DST) is primarily evaluated using Joint Goal Accuracy (JGA) defined as the fraction of turns where the ground-truth dialogue state exactly matches the prediction. Generally in DST, the dialogue state or belief state…

Computation and Language · Computer Science 2022-04-08 Suvodip Dey , Ramamohan Kummara , Maunendra Sankar Desarkar

Recent research on dialogue state tracking (DST) focuses on methods that allow few- and zero-shot transfer to new domains or schemas. However, performance gains heavily depend on aggressive data augmentation and fine-tuning of ever larger…

This paper presents a novel approach for multi-task learning of language understanding (LU) and dialogue state tracking (DST) in task-oriented dialogue systems. Multi-task training enables the sharing of the neural network layers…

Computation and Language · Computer Science 2018-11-14 Abhinav Rastogi , Raghav Gupta , Dilek Hakkani-Tur

Goal-oriented chatbots are essential for automating user tasks, such as booking flights or making restaurant reservations. A key component of these systems is Dialogue State Tracking (DST), which interprets user intent and maintains the…

Computation and Language · Computer Science 2025-03-28 Sejin Lee , Dongha Kim , Min Song

This study applies Computational Grounded Theory (CGT) to analyze student misconceptions using interaction data from an AI-powered chatbot deployed in a university-level Modern Physics course. The chatbot - the UTA Study Buddy Bot - engaged…

Physics Education · Physics 2026-03-06 Atharva Dange , Ramon E. Lopez

Our goal is to develop an AI Partner that can provide support for group problem solving and social dynamics. In multi-party working group environments, multimodal analytics is crucial for identifying non-verbal interactions of group…

Dialogue State Tracking (DST) is an essential element of conversational AI with the objective of deeply understanding the conversation context and leading it toward answering user requests. Due to high demands for open-domain and multi-turn…

Computation and Language · Computer Science 2025-10-02 Samin Mahdipour Aghabagher , Saeedeh Momtazi

We consider a new perspective on dialog state tracking (DST), the task of estimating a user's goal through the course of a dialog. By formulating DST as a semantic parsing task over hierarchical representations, we can incorporate semantic…

Common ground plays a critical role in situated spoken dialogs, where interlocutors must establish and maintain shared references to entities, events, and relations to sustain coherent interaction in a shared space and over time. With the…

Computation and Language · Computer Science 2026-04-08 Biswesh Mohapatra , Théo Charlot , Giovanni Duca , Mayank Palan , Laurent Romary , Justine Cassell

Dialog State Tracking (DST), an integral part of modern dialog systems, aims to track user preferences and constraints (slots) in task-oriented dialogs. In real-world settings with constantly changing services, DST systems must generalize…

Computation and Language · Computer Science 2021-01-22 Shuyang Li , Jin Cao , Mukund Sridhar , Henghui Zhu , Shang-Wen Li , Wael Hamza , Julian McAuley

Dialogue systems are frequently updated to accommodate new services, but naively updating them by continually training with data for new services in diminishing performance on previously learnt services. Motivated by the insight that…

Computation and Language · Computer Science 2025-09-30 Hyundong Cho , Andrea Madotto , Zhaojiang Lin , Khyathi Raghavi Chandu , Satwik Kottur , Jing Xu , Jonathan May , Chinnadhurai Sankar

Dialogue state tracking (DST) is a key component of task-oriented dialogue systems. DST estimates the user's goal at each user turn given the interaction until then. State of the art approaches for state tracking rely on deep learning…

Computation and Language · Computer Science 2018-01-03 Abhinav Rastogi , Dilek Hakkani-Tur , Larry Heck

This paper introduces a novel approach to Dialogue State Tracking (DST) that leverages Large Language Models (LLMs) to generate natural language descriptions of dialogue states, moving beyond traditional slot-value representations.…

Computation and Language · Computer Science 2025-03-13 Rafael Carranza , Mateo Alejandro Rojas

Dialogue state tracking is a key part of a task-oriented dialogue system, which estimates the user's goal at each turn of the dialogue. In this paper, we propose the Point-Or-Generate Dialogue State Tracker (POGD). POGD solves the dialogue…

Computation and Language · Computer Science 2020-08-11 Song Xiaohui , Hu Songlin

Effective conversation requires common ground: a shared understanding between the participants. Common ground, however, does not emerge spontaneously in conversation. Speakers and listeners work together to both identify and construct a…

Computation and Language · Computer Science 2024-04-04 Omar Shaikh , Kristina Gligorić , Ashna Khetan , Matthias Gerstgrasser , Diyi Yang , Dan Jurafsky

Dialogue state tracking (DST) is a pivotal component in task-oriented dialogue systems. While it is relatively easy for a DST model to capture belief states in short conversations, the task of DST becomes more challenging as the length of a…

Computation and Language · Computer Science 2021-05-07 Ye Zhang , Yuan Cao , Mahdis Mahdieh , Jeffrey Zhao , Yonghui Wu

Task oriented dialog agents provide a natural language interface for users to complete their goal. Dialog State Tracking (DST), which is often a core component of these systems, tracks the system's understanding of the user's goal…

Computation and Language · Computer Science 2020-02-21 Adarsh Kumar , Peter Ku , Anuj Kumar Goyal , Angeliki Metallinou , Dilek Hakkani-Tur

Dialogue State Tracking (DST) is designed to monitor the evolving dialogue state in the conversations and plays a pivotal role in developing task-oriented dialogue systems. However, obtaining the annotated data for the DST task is usually a…

Computation and Language · Computer Science 2024-05-24 Cheng Niu , Xingguang Wang , Xuxin Cheng , Juntong Song , Tong Zhang

Dialogue state tracking (DST) is an essential component in task-oriented dialogue systems, which estimates user goals at every dialogue turn. However, most previous approaches usually suffer from the following problems. Many discriminative…

Computation and Language · Computer Science 2019-08-22 Qingbin Liu , Shizhu He , Kang Liu , Shengping Liu , Jun Zhao

Conversational grounding is a collaborative mechanism for establishing mutual knowledge among participants engaged in a dialogue. This experimental study analyzes information-seeking conversations to investigate the capabilities of large…

Computation and Language · Computer Science 2024-06-05 Kristiina Jokinen , Phillip Schneider , Taiga Mori