English
Related papers

Related papers: Common Ground Tracking in Multimodal Dialogue

200 papers

We present TRACE, a novel system for live *common ground* tracking in situated collaborative tasks. With a focus on fast, real-time performance, TRACE tracks the speech, actions, gestures, and visual attention of participants, uses these…

Dialogue State Tracking (DST), which is the process of inferring user goals by estimating belief states given the dialogue history, plays a critical role in task-oriented dialogue systems. A coreference phenomenon observed in multi-turn…

Computation and Language · Computer Science 2021-06-17 Ting Han , Chongxuan Huang , Wei Peng

Common grounding is the process of creating and maintaining mutual understandings, which is a critical aspect of sophisticated human communication. While various task settings have been proposed in existing literature, they mostly focus on…

Computation and Language · Computer Science 2021-06-01 Takuma Udagawa , Akiko Aizawa

Dialogue State Tracking (DST) is core research in dialogue systems and has received much attention. In addition, it is necessary to define a new problem that can deal with dialogue between users as a step toward the conversational AI that…

Computation and Language · Computer Science 2023-01-19 Hyungtak Choi , Hyeonmok Ko , Gurpreet Kaur , Lohith Ravuru , Kiranmayi Gandikota , Manisha Jhawar , Simma Dharani , Pranamya Patil

One of the core components of modern spoken dialogue systems is the belief tracker, which estimates the user's goal at every step of the dialogue. However, most current approaches have difficulty scaling to larger, more complex dialogue…

Computation and Language · Computer Science 2017-04-24 Nikola Mrkšić , Diarmuid Ó Séaghdha , Tsung-Hsien Wen , Blaise Thomson , Steve Young

This paper proposes an improvement to the existing data-driven Neural Belief Tracking (NBT) framework for Dialogue State Tracking (DST). The existing NBT model uses a hand-crafted belief state update mechanism which involves an expensive…

Computation and Language · Computer Science 2018-05-30 Nikola Mrkšić , Ivan Vulić

Dialog State Tracking (DST) is one of the most crucial modules for goal-oriented dialogue systems. In this paper, we introduce FastSGT (Fast Schema Guided Tracker), a fast and robust BERT-based model for state tracking in goal-oriented…

Machine Learning · Computer Science 2020-08-31 Vahid Noroozi , Yang Zhang , Evelina Bakhturina , Tomasz Kornuta

Common grounding is the process of creating, repairing and updating mutual understandings, which is a critical aspect of sophisticated human communication. However, traditional dialogue systems have limited capability of establishing common…

Computation and Language · Computer Science 2019-07-09 Takuma Udagawa , Akiko Aizawa

While communicating with a user, a task-oriented dialogue system has to track the user's needs at each turn according to the conversation history. This process called dialogue state tracking (DST) is crucial because it directly informs the…

Computation and Language · Computer Science 2022-08-01 Léo Jacqmin , Lina M. Rojas-Barahona , Benoit Favre

Establishing common ground, a shared set of beliefs and mutually recognized facts, is fundamental to collaboration, yet remains a challenge for current AI systems, especially in multimodal, multiparty settings, where the collaborators bring…

Artificial Intelligence · Computer Science 2026-05-26 Yifan Zhu , Mariah Bradford , Kenneth Lai , Timothy Obiso , Videep Venkatesha , James Pustejovsky , Nikhil Krishnaswamy

Dialogue state tracking (DST) aims to extract essential information from multi-turn dialogue situations and take appropriate actions. A belief state, one of the core pieces of information, refers to the subject and its specific content, and…

Computation and Language · Computer Science 2022-04-01 Takyoung Kim , Hoonsang Yoon , Yukyung Lee , Pilsung Kang , Misuk Kim

The traditional Dialogue State Tracking (DST) problem aims to track user preferences and intents in user-agent conversations. While sufficient for task-oriented dialogue systems supporting narrow domain applications, the advent of Large…

Computation and Language · Computer Science 2023-09-19 Sarkar Snigdha Sarathi Das , Chirag Shah , Mengting Wan , Jennifer Neville , Longqi Yang , Reid Andersen , Georg Buscher , Tara Safavi

A typical conversation comprises of multiple turns between participants where they go back-and-forth between different topics. At each user turn, dialogue state tracking (DST) aims to estimate user's goal by processing the current…

Computation and Language · Computer Science 2019-04-08 Sanuj Sharma , Prafulla Kumar Choubey , Ruihong Huang

Dialog state tracking is used to estimate the current belief state of a dialog given all the preceding conversation. Machine reading comprehension, on the other hand, focuses on building systems that read passages of text and answer…

Computation and Language · Computer Science 2019-08-16 Shuyang Gao , Abhishek Sethi , Sanchit Agarwal , Tagyoung Chung , Dilek Hakkani-Tur

When we communicate with other humans, we do not simply generate a sequence of words. Rather, we use our cognitive state (beliefs, desires, intentions) and our model of the audience's cognitive state to create utterances that affect the…

Computation and Language · Computer Science 2023-11-03 Magdalena Markowska , Mohammad Taghizadeh , Adil Soubki , Seyed Abolghasem Mirroshandel , Owen Rambow

Humans talk in daily conversations while aligning and negotiating the expressed meanings or common ground. Despite the impressive conversational abilities of the large generative language models, they do not consider the individual…

Computation and Language · Computer Science 2024-05-27 Shuwen Qiu , Mingdian Liu , Hengli Li , Song-Chun Zhu , Zilong Zheng

Successful conversations often rest on common understanding, where all parties are on the same page about the information being shared. This process, known as conversational grounding, is crucial for building trustworthy dialog systems that…

Computation and Language · Computer Science 2024-03-26 Biswesh Mohapatra , Seemab Hassan , Laurent Romary , Justine Cassell

Dialogue State Tracking (DST) is a core component of virtual assistants such as Alexa or Siri. To accomplish various tasks, these assistants need to support an increasing number of services and APIs. The Schema-Guided State Tracking track…

Computation and Language · Computer Science 2020-02-10 Pavel Gulyaev , Eugenia Elistratova , Vasily Konovalov , Yuri Kuratov , Leonid Pugachev , Mikhail Burtsev

Dialogue State Tracking (DST) is of paramount importance in ensuring accurate tracking of user goals and system actions within task-oriented dialogue systems. The emergence of large language models (LLMs) such as GPT3 and ChatGPT has…

Computation and Language · Computer Science 2023-10-24 Yujie Feng , Zexin Lu , Bo Liu , Liming Zhan , Xiao-Ming Wu

Task-oriented dialogue systems often employ a Dialogue State Tracker (DST) to successfully complete conversations. Recent state-of-the-art DST implementations rely on schemata of diverse services to improve model robustness and handle…

Computation and Language · Computer Science 2022-07-05 Eleftherios Kapelonis , Efthymios Georgiou , Alexandros Potamianos
‹ Prev 1 2 3 10 Next ›