中文
相关论文

相关论文: Interactive Evaluation of Dialog Track at DSTC9

200 篇论文

The recent advent of neural approaches for developing each dialog component in task-oriented dialog systems has remarkably improved, yet optimizing the overall system performance remains a challenge. Besides, previous research on modeling…

计算与语言 · 计算机科学 2021-08-27 Hwaran Lee , Seokhwan Jo , HyungJun Kim , Sangkeun Jung , Tae-Yoon Kim

Existing visual trackers mainly operate in a non-interactive, fire-and-forget manner, making them impractical for real-world scenarios that require human-in-the-loop adaptation. To overcome this limitation, we introduce Interactive…

计算机视觉与模式识别 · 计算机科学 2026-04-03 Yuqing Huang , Guotian Zeng , Zhenqiao Yuan , Zhenyu He , Xin Li , Yaowei Wang , Ming-Hsuan Yang

We present TRACE, a novel system for live *common ground* tracking in situated collaborative tasks. With a focus on fast, real-time performance, TRACE tracks the speech, actions, gestures, and visual attention of participants, uses these…

Programming is a fundamentally interactive process, yet coding assistants are often evaluated using static benchmarks that fail to measure how well models collaborate with users. We introduce an interactive evaluation pipeline to examine…

人机交互 · 计算机科学 2025-02-26 Jane Pan , Ryan Shar , Jacob Pfau , Ameet Talwalkar , He He , Valerie Chen

Appropriate evaluation and experimental design are fundamental for empirical sciences, particularly in data-driven fields. Due to the successes in computational modeling of languages, for instance, research outcomes are having an…

The emergence of instruction-tuned large language models (LLMs) has advanced the field of dialogue systems, enabling both realistic user simulations and robust multi-turn conversational agents. However, existing research often evaluates…

计算与语言 · 计算机科学 2025-07-22 Chalamalasetti Kranti , Sherzod Hakimov , David Schlangen

Proactive dialogue systems, related to a wide range of real-world conversational applications, equip the conversational agent with the capability of leading the conversation direction towards achieving pre-defined targets or fulfilling…

计算与语言 · 计算机科学 2023-05-10 Yang Deng , Wenqiang Lei , Wai Lam , Tat-Seng Chua

Conversational interfaces that allow for intuitive and comprehensive access to digitally stored information remain an ambitious goal. In this thesis, we lay foundations for designing conversational search systems by analyzing the…

信息检索 · 计算机科学 2019-12-17 Svitlana Vakulenko

Autoregressive models used to generate responses in open-domain dialogue systems often struggle to take long-term context into account and to maintain consistency over a dialogue. Previous research in open-domain dialogue generation has…

计算与语言 · 计算机科学 2023-04-18 Mehrdad Farahani , Richard Johansson

While multimodal conversation agents are gaining importance in several domains such as retail, travel etc., deep learning research in this area has been limited primarily due to the lack of availability of large-scale, open chatlogs. To…

计算与语言 · 计算机科学 2018-02-01 Amrita Saha , Mitesh Khapra , Karthik Sankaranarayanan

In this work, we explore the application of PLATO-2 on various dialogue systems, including open-domain conversation, knowledge grounded dialogue, and task-oriented conversation. PLATO-2 is initially designed as an open-domain chatbot,…

计算与语言 · 计算机科学 2021-05-28 Siqi Bao , Bingjin Chen , Huang He , Xin Tian , Han Zhou , Fan Wang , Hua Wu , Haifeng Wang , Wenquan Wu , Yingzhan Lin

Dialogue State Tracking (DST) is core research in dialogue systems and has received much attention. In addition, it is necessary to define a new problem that can deal with dialogue between users as a step toward the conversational AI that…

Efforts towards endowing robots with the ability to speak have benefited from recent advancements in natural language processing, in particular large language models. However, current language models are not fully incremental, as their…

计算与语言 · 计算机科学 2025-04-03 Casey Kennington , Pierre Lison , David Schlangen

Many interactive data systems combine visual representations of data with embedded algorithmic support for automation and data exploration. To effectively support transparent and explainable data systems, it is important for researchers and…

人机交互 · 计算机科学 2022-11-10 Jeremy E. Block , Eric D. Ragan

Dialogue systems are frequently updated to accommodate new services, but naively updating them by continually training with data for new services in diminishing performance on previously learnt services. Motivated by the insight that…

Automatic evaluation metrics are a crucial component of dialog systems research. Standard language evaluation metrics are known to be ineffective for evaluating dialog. As such, recent research has proposed a number of novel,…

计算与语言 · 计算机科学 2021-07-09 Yi-Ting Yeh , Maxine Eskenazi , Shikib Mehri

We present a multi-task learning framework to enable the training of one universal incremental dialogue processing model with four tasks of disfluency detection, language modelling, part-of-speech tagging, and utterance segmentation in a…

计算与语言 · 计算机科学 2020-11-16 Morteza Rohanian , Julian Hough

This work investigates the task-oriented dialogue problem in mixed-domain settings. We study the effect of alternating between different domains in sequences of dialogue turns using two related state-of-the-art dialogue systems. We first…

计算与语言 · 计算机科学 2019-09-06 Tho Luong Chi , Phuong Le-Hong

We present a system for interpretable, symbolic, interactive task learning from dialog using a GPT model as a conversational front-end. The learned tasks are represented as hierarchical decompositions of predicate-argument structures with…

人机交互 · 计算机科学 2023-05-18 Lane Lawley , Christopher J. MacLellan

Recently, resources and tasks were proposed to go beyond state tracking in dialogue systems. An example is the frame tracking task, which requires recording multiple frames, one for each user goal set during the dialogue. This allows a…

计算与语言 · 计算机科学 2017-06-07 Hannes Schulz , Jeremie Zumer , Layla El Asri , Shikhar Sharma