English
Related papers

Related papers: Interactive Evaluation of Dialog Track at DSTC9

200 papers

In an end-to-end dialog system, the aim of dialog state tracking is to accurately estimate a compact representation of the current dialog status from a sequence of noisy observations produced by the speech recognition and the natural…

Computation and Language · Computer Science 2017-03-06 Julien Perez , Fei Liu

The response selection has been an emerging research topic due to the growing interest in dialogue modeling, where the goal of the task is to select an appropriate response for continuing dialogues. To further push the end-to-end dialogue…

Computation and Language · Computer Science 2019-03-22 Chao-Wei Huang , Ting-Rui Chiang , Shang-Yu Su , Yun-Nung Chen

Recent progress on neural approaches for language processing has triggered a resurgence of interest on building intelligent open-domain chatbots. However, even the state-of-the-art neural chatbots cannot produce satisfying responses for…

Computation and Language · Computer Science 2022-08-10 Behnam Hedayatnia , Di Jin , Yang Liu , Dilek Hakkani-Tur

As conversational AI-based dialogue management has increasingly become a trending topic, the need for a standardized and reliable evaluation procedure grows even more pressing. The current state of affairs suggests various evaluation…

Computation and Language · Computer Science 2020-06-12 Sarah E. Finch , Jinho D. Choi

This paper introduces one of our group's work on the Dialog System Technology Challenges 8 (DSTC8), the SPPD system for Schema Guided dialogue state tracking challenge. This challenge, named as Track 4 in DSTC8, provides a brand new and…

Computation and Language · Computer Science 2020-06-17 Miao Li , Haoqi Xiong , Yunbo Cao

We propose an online, end-to-end, neural generative conversational model for open-domain dialogue. It is trained using a unique combination of offline two-phase supervised learning and online human-in-the-loop active learning. While most…

Computation and Language · Computer Science 2017-06-19 Nabiha Asghar , Pascal Poupart , Xin Jiang , Hang Li

Common grounding is the process of creating and maintaining mutual understandings, which is a critical aspect of sophisticated human communication. While various task settings have been proposed in existing literature, they mostly focus on…

Computation and Language · Computer Science 2021-06-01 Takuma Udagawa , Akiko Aizawa

While participants in a multi-party multi-turn conversation simultaneously engage in multiple conversation topics, existing response selection methods are developed mainly focusing on a two-party single-conversation scenario. Hence, the…

Computation and Language · Computer Science 2020-10-16 Weishi Wang , Shafiq Joty , Steven C. H. Hoi

Dialogue state tracking (DST) is a key component of task-oriented dialogue systems. DST estimates the user's goal at each user turn given the interaction until then. State of the art approaches for state tracking rely on deep learning…

Computation and Language · Computer Science 2018-01-03 Abhinav Rastogi , Dilek Hakkani-Tur , Larry Heck

Interaction models describe the exchange of messages between the different components of distributed systems. We have previously defined a small-step operational semantics for interaction models. The paper extends this work by presenting an…

Logic in Computer Science · Computer Science 2020-09-29 Erwan Mahe , Boutheina Bannour , Christophe Gaston , Arnault Lapitre , Pascale Le Gall

One challenge for dialogue agents is recognizing feelings in the conversation partner and replying accordingly, a key communicative skill. While it is straightforward for humans to recognize and acknowledge others' feelings in a…

Computation and Language · Computer Science 2019-08-30 Hannah Rashkin , Eric Michael Smith , Margaret Li , Y-Lan Boureau

The aim of the workshop was to bring together experts working on open-domain dialogue research. In this speedily advancing research area many challenges still exist, such as learning information from conversations, and engaging in a…

Computation and Language · Computer Science 2024-11-20 Yvette Graham , Mohammed Rameez Qureshi , Haider Khalid , Gerasimos Lampouras , Ignacio Iacobacci , Qun Liu

Evaluating Retrieval-Augmented Generation (RAG) systems using static multi-turn datasets fails to capture the dynamic nature of real-world dialogues. Existing evaluation methods rely on predefined datasets, which restrict them to static,…

Information Retrieval · Computer Science 2026-04-21 Lorenz Brehme , Benedikt Dornauer , Jan-Henrik Böttcher , Klaus Schmid , Mircea-Cristian Racasan , Ruth Breu

Dialog systems research has primarily been focused around two main types of applications - task-oriented dialog systems that learn to use clarification to aid in understanding a goal, and open-ended dialog systems that are expected to carry…

Computation and Language · Computer Science 2020-06-29 Aishwarya Padmakumar , Raymond J. Mooney

This study aims to generate responses based on real-world facts by conditioning context and external facts extracted from information websites. Our system is an ensemble system that combines three modules: generated-based module,…

Computation and Language · Computer Science 2019-02-06 Ryota Tanaka , Akihide Ozeki , Shugo Kato , Akinobu Lee

Mental models play an important role in whether user interaction with intelligent systems, such as dialog systems is successful or not. Adaptive dialog systems present the opportunity to align a dialog agent's behavior with heterogeneous…

Computation and Language · Computer Science 2024-08-27 Lindsey Vanderlyn , Dirk Väth , Ngoc Thang Vu

Computing students increasingly rely on generative AI tools for programming assistance, often without formal instruction or guidance. This highlights a need to teach students how to effectively interact with AI models, particularly through…

Computers and Society · Computer Science 2025-09-15 Victor-Alexandru Pădurean , Paul Denny , Alkis Gotovos , Adish Singla

Dialog response ranking is used to rank response candidates by considering their relation to the dialog history. Although researchers have addressed this concept for open-domain dialogs, little attention has been focused on task-oriented…

Computation and Language · Computer Science 2018-11-29 Junki Ohmura , Maxine Eskenazi

Spoken Dialogue Models (SDMs) have advanced rapidly, yet their ability to sustain genuinely interactive multi-turn conversations remains underexplored, as most benchmarks focus on single-turn exchanges. We introduce Multi-Bench, the first…

Audio and Speech Processing · Electrical Eng. & Systems 2025-11-04 Yayue Deng , Guoqiang Hu , Haiyang Sun , Xiangyu Zhang , Haoyang Zhang , Fei Tian , Xuerui Yang , Gang Yu , Eng Siong Chng

The explosive growth of textual data over time presents a significant challenge in uncovering evolving themes and trends. Existing dynamic topic modeling techniques, while powerful, often exist in fragmented pipelines that lack robust…

Computation and Language · Computer Science 2025-07-15 Suman Adhya , Debarshi Kumar Sanyal