English
Related papers

Related papers: Common Ground Tracking in Multimodal Dialogue

200 papers

End-to-end spoken dialogue state tracking (DST) is made difficult by the tandem of having to handle speech input and data scarcity. Combining speech foundation encoders and large language models has been proposed in recent work as to…

Computation and Language · Computer Science 2025-12-01 Katia Vendrame , Bolaji Yusuf , Santosh Kesiraju , Šimon Sedláček , Oldřich Plchot , Jan Černocký

For generative AIs to be trustworthy, establishing transparent common grounding with humans is essential. As a preparation toward human-model common grounding, this study examines the process of model-model common grounding. In this…

Artificial Intelligence · Computer Science 2024-12-09 Junya Morita , Tatsuya Yui , Takeru Amaya , Ryuichiro Higashinaka , Yugo Takeuchi

The performance of task-oriented dialogue models is strongly tied to how well they track dialogue states, which records and updates user information across multi-turn interactions. However, current multi-domain DST encounters two key…

Computation and Language · Computer Science 2026-03-12 Haoxiang Su , Ruiyu Fang , Liting Jiang , Xiaomeng Huang , Shuangyong Song

A Dialogue State Tracker is a key component in dialogue systems which estimates the beliefs of possible user goals at each dialogue turn. Deep learning approaches using recurrent neural networks have shown state-of-the-art performance for…

Computation and Language · Computer Science 2019-11-04 Vevake Balaraman , Bernardo Magnini

Dialogue state tracking, which estimates user goals and requests given the dialogue context, is an essential part of task-oriented dialogue systems. In this paper, we propose the Global-Locally Self-Attentive Dialogue State Tracker (GLAD),…

Computation and Language · Computer Science 2018-09-10 Victor Zhong , Caiming Xiong , Richard Socher

Modeling dialog as a collaborative activity consists notably in specifying the content of the Conversational Common Ground and the kind of social mental state involved. In previous work (Saget, 2006), we claim that Collective Acceptance is…

Artificial Intelligence · Computer Science 2008-12-18 Sylvie Saget , Marc Guyomard

Multi-domain dialogue state tracking (DST) is a critical component for conversational AI systems. The domain ontology (i.e., specification of domains, slots, and values) of a conversational AI system is generally incomplete, making the…

Computation and Language · Computer Science 2020-06-23 Li Zhou , Kevin Small

Dialogue state tracking is the core part of a spoken dialogue system. It estimates the beliefs of possible user's goals at every dialogue turn. However, for most current approaches, it's difficult to scale to large dialogue domains. They…

Computation and Language · Computer Science 2018-10-24 Liliang Ren , Kaige Xie , Lu Chen , Kai Yu

We present our work on Track 4 in the Dialogue System Technology Challenges 8 (DSTC8). The DSTC8-Track 4 aims to perform dialogue state tracking (DST) under the zero-shot settings, in which the model needs to generalize on unseen service…

Computation and Language · Computer Science 2020-02-04 Yu-Ping Ruan , Zhen-Hua Ling , Jia-Chen Gu , Quan Liu

As an essential component in task-oriented dialogue systems, dialogue state tracking (DST) aims to track human-machine interactions and generate state representations for managing the dialogue. Representations of dialogue states are…

Computation and Language · Computer Science 2022-08-05 Ruolin Su , Ting-Wei Wu , Biing-Hwang Juang

Human communication relies on common ground (CG), the mutual knowledge and beliefs shared by participants, to produce coherent and interesting conversations. In this paper, we demonstrate that current response generation (RG) models produce…

Computation and Language · Computer Science 2022-11-18 Pei Zhou , Hyundong Cho , Pegah Jandaghi , Dong-Ho Lee , Bill Yuchen Lin , Jay Pujara , Xiang Ren

Automated negotiation support systems aim to help human negotiators reach more favorable outcomes in multi-issue negotiations (e.g., an employer and a candidate negotiating over issues such as salary, hours, and promotions before a job…

Computation and Language · Computer Science 2023-07-14 Amogh Mannekote , Bonnie J. Dorr , Kristy Elizabeth Boyer

Existing approaches to dialogue state tracking rely on pre-defined ontologies consisting of a set of all possible slot types and values. Though such approaches exhibit promising performance on single-domain benchmarks, they suffer from…

Artificial Intelligence · Computer Science 2019-10-21 Liliang Ren , Jianmo Ni , Julian McAuley

Visual Dialog (VD) is a task where an agent answers a series of image-related questions based on a multi-round dialog history. However, previous VD methods often treat the entire dialog history as a simple text input, disregarding the…

Artificial Intelligence · Computer Science 2024-08-14 Wei Pang , Ruixue Duan , Jinfu Yang , Ning Li

In conversational QA, models have to leverage information in previous turns to answer upcoming questions. Current approaches, such as Question Rewriting, struggle to extract relevant information as the conversation unwinds. We introduce the…

Computation and Language · Computer Science 2022-04-11 Marco Del Tredici , Xiaoyu Shen , Gianni Barlacchi , Bill Byrne , Adrià de Gispert

User simulators are essential to conversational AI, enabling scalable agent development and evaluation through simulated interactions. While current Large Language Models (LLMs) have advanced user simulation capabilities, we reveal that…

Computation and Language · Computer Science 2026-03-10 Shuhaib Mehri , Xiaocheng Yang , Takyoung Kim , Gokhan Tur , Shikib Mehri , Dilek Hakkani-Tür

The primary purpose of dialogue state tracking (DST), a critical component of an end-to-end conversational system, is to build a model that responds well to real-world situations. Although we often change our minds from time to time during…

Computation and Language · Computer Science 2022-10-13 Takyoung Kim , Yukyung Lee , Hoonsang Yoon , Pilsung Kang , Junseong Bang , Misuk Kim

In task-oriented dialogue systems the dialogue state tracker (DST) component is responsible for predicting the state of the dialogue based on the dialogue history. Current DST approaches rely on a predefined domain ontology, a fact that…

Computation and Language · Computer Science 2020-01-22 Vevake Balaraman , Bernardo Magnini

Dialogue state trackers have made significant progress on benchmark datasets, but their generalization capability to novel and realistic scenarios beyond the held-out conversations is less understood. We propose controllable counterfactuals…

Computation and Language · Computer Science 2021-03-29 Shiyang Li , Semih Yavuz , Kazuma Hashimoto , Jia Li , Tong Niu , Nazneen Rajani , Xifeng Yan , Yingbo Zhou , Caiming Xiong

We tackle the Dialogue Belief State Tracking(DST) problem of task-oriented conversational systems. Recent approaches to this problem leveraging Transformer-based models have yielded great results. However, training these models is…

Computation and Language · Computer Science 2022-04-19 Debjoy Saha , Bishal Santra , Pawan Goyal