English
Related papers

Related papers: Multi-Faceted Evaluation of Tool-Augmented Dialogu…

200 papers

Estimating uncertainty for AI agents in real-world multi-turn tool-using interaction with humans is difficult because failures are often triggered by sparse critical episodes (e.g., looping, incoherent tool use, or user-agent…

Artificial Intelligence · Computer Science 2026-02-13 Sina Tayebati , Divake Kumar , Nastaran Darabi , Davide Ettori , Ranganath Krishnan , Amit Ranjan Trivedi

Dialogue systems have received increasing attention while automatically evaluating their performance remains challenging. User satisfaction estimation (USE) has been proposed as an alternative. It assumes that the performance of a dialogue…

Computation and Language · Computer Science 2023-05-23 Fanghua Ye , Zhiyuan Hu , Emine Yilmaz

In Task-Oriented Dialogue (TOD) systems, correctly updating the system's understanding of the user's needs is key to a smooth interaction. Traditionally TOD systems are composed of several modules that interact with one another. While each…

Computation and Language · Computer Science 2023-11-21 Lucas Druart , Léo Jacqmin , Benoît Favre , Lina Maria Rojas-Barahona , Valentin Vielzeuf

Recent advancements in tool-augmented large language models have enabled them to interact with external tools, enhancing their ability to perform complex user tasks. However, existing approaches overlook the role of personalisation in…

Computation and Language · Computer Science 2025-09-17 Ekaterina Taktasheva , Jeff Dalton

Collaborative group projects are integral to computer science education, fostering teamwork, problem-solving, and industry-relevant skills. However, assessing individual contributions within group settings remains challenging. Traditional…

Human-Computer Interaction · Computer Science 2026-03-13 Songmei Yu , Andrew Zagula

Recent technological advances have made it possible to build real-time, interactive spoken dialogue systems for a wide variety of applications. However, when users do not respect the limitations of such systems, performance typically…

Computation and Language · Computer Science 2007-05-23 Diane J. Litman , Shimei Pan

While dialogue remains an important end-goal of natural language research, the difficulty of evaluation is an oft-quoted reason why it remains troublesome to make real progress towards its solution. Evaluation difficulties are actually…

Computation and Language · Computer Science 2019-09-10 Margaret Li , Jason Weston , Stephen Roller

Evaluating the quality of a dialogue system is an understudied problem. The recent evolution of evaluation method motivated this survey, in which an explicit and comprehensive analysis of the existing methods is sought. We are first to…

Computation and Language · Computer Science 2021-08-04 Xinmeng Li , Wansen Wu , Long Qin , Quanjun Yin

Task-oriented dialogue systems have been plagued by the difficulties of obtaining large-scale and high-quality annotated conversations. Furthermore, most of the publicly available datasets only include written conversations, which are…

Computation and Language · Computer Science 2021-12-24 Xin Tian , Xinxian Huang , Dongfeng He , Yingzhan Lin , Siqi Bao , Huang He , Liankai Huang , Qiang Ju , Xiyuan Zhang , Jian Xie , Shuqi Sun , Fan Wang , Hua Wu , Haifeng Wang

We present TRACE, a novel system for live *common ground* tracking in situated collaborative tasks. With a focus on fast, real-time performance, TRACE tracks the speech, actions, gestures, and visual attention of participants, uses these…

As conversational AI-based dialogue management has increasingly become a trending topic, the need for a standardized and reliable evaluation procedure grows even more pressing. The current state of affairs suggests various evaluation…

Computation and Language · Computer Science 2020-06-12 Sarah E. Finch , Jinho D. Choi

Although there have been remarkable advances in dialogue systems through the dialogue systems technology competition (DSTC), it remains one of the key challenges to building a robust task-oriented dialogue system with a speech interface.…

Computation and Language · Computer Science 2024-01-10 Jaeseok Yoon , Seunghyun Hwang , Ran Han , Jeonguk Bang , Kee-Eung Kim

Empathy is a vital factor that contributes to mutual understanding, and joint problem-solving. In recent years, a growing number of studies have recognized the benefits of empathy and started to incorporate empathy in conversational…

Computation and Language · Computer Science 2023-10-13 Aravind Sesagiri Raamkumar , Yinping Yang

For task-oriented dialog systems to be maximally useful, it must be able to process conversations in a way that is (1) generalizable with a small number of training examples for new task domains, and (2) robust to user input in various…

Computation and Language · Computer Science 2021-01-01 Baolin Peng , Chunyuan Li , Zhu Zhang , Chenguang Zhu , Jinchao Li , Jianfeng Gao

Conversational agents are systems with a conversational interface that afford interaction in spoken language. These systems are becoming prevalent and are preferred in various contexts and for many users. Despite their increasing success,…

Human-Computer Interaction · Computer Science 2019-02-19 Soodeh Atefi , Mohammad Amin Alipour

This review gives an extensive overview of evaluation methods for task-oriented dialogue systems, paying special attention to practical applications of dialogue systems, for example for customer service. The review (1) provides an overview…

Computation and Language · Computer Science 2024-04-09 Anouck Braggaar , Christine Liebrecht , Emiel van Miltenburg , Emiel Krahmer

The summarization of conversation, that is, discourse over discourse, elevates pragmatic considerations as a pervasive limitation of both summarization and other applications of contemporary conversational AI. Building on impressive…

Computation and Language · Computer Science 2023-05-01 S. M. Seals , Valerie L. Shalin

Evaluation of open-domain dialogue systems is highly challenging and development of better techniques is highlighted time and again as desperately needed. Despite substantial efforts to carry out reliable live evaluation of systems in…

Computation and Language · Computer Science 2022-03-14 Tianbo Ji , Yvette Graham , Gareth J. F. Jones , Chenyang Lyu , Qun Liu

Speech emotions play a crucial role in human-computer interaction, shaping engagement and context-aware communication. Despite recent advances in spoken dialogue systems, a holistic system for evaluating emotional reasoning is still…

One of the problems with automated audio captioning (AAC) is the indeterminacy in word selection corresponding to the audio event/scene. Since one acoustic event/scene can be described with several words, it results in a combinatorial…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-11 Yuma Koizumi , Ryo Masumura , Kyosuke Nishida , Masahiro Yasuda , Shoichiro Saito