English
Related papers

Related papers: Metaphorical User Simulators for Evaluating Task-o…

200 papers

Current works in the generation of personalized dialogue primarily contribute to the agent presenting a consistent personality and driving a more informative response. However, we found that the generated responses from most previous models…

Computation and Language · Computer Science 2022-08-23 Itsugun Cho , Dongyang Wang , Ryota Takahashi , Hiroaki Saito

Previous dialogue summarization datasets mainly focus on open-domain chitchat dialogues, while summarization datasets for the broadly used task-oriented dialogue haven't been explored yet. Automatically summarizing such task-oriented…

Computation and Language · Computer Science 2021-10-26 Lulu Zhao , Fujia Zheng , Keqing He , Weihao Zeng , Yuejie Lei , Huixing Jiang , Wei Wu , Weiran Xu , Jun Guo , Fanyu Meng

This paper presents Dialogos, a real-time system for human-machine spoken dialogue on the telephone in task-oriented domains. The system has been tested in a large trial with inexperienced users and it has proved robust enough to allow…

Task-oriented dialogue systems are broadly used in virtual assistants and other automated services, providing interfaces between users and machines to facilitate specific tasks. Nowadays, task-oriented dialogue systems have greatly…

Computation and Language · Computer Science 2024-05-17 Ruolin Su , Biing-Hwang Juang

Next generation task-oriented dialog systems need to understand conversational contexts with their perceived surroundings, to effectively help users in the real-world multimodal environment. Existing task-oriented dialog datasets aimed…

Computation and Language · Computer Science 2021-10-22 Satwik Kottur , Seungwhan Moon , Alborz Geramifard , Babak Damavandi

User simulation is an emerging interdisciplinary topic with multiple critical applications in the era of Generative AI. It involves creating an intelligent agent that mimics the actions of a human user interacting with an AI system,…

Artificial Intelligence · Computer Science 2026-04-22 Krisztian Balog , ChengXiang Zhai

Conversational recommender systems offer the promise of interactive, engaging ways for users to find items they enjoy. We seek to improve conversational recommendation via three dimensions: 1) We aim to mimic a common mode of human…

Computation and Language · Computer Science 2021-12-13 Shuyang Li , Bodhisattwa Prasad Majumder , Julian McAuley

Conversational recommender systems (CRS) enhance user experience through multi-turn interactions, yet evaluating CRS remains challenging. User simulators can provide comprehensive evaluations through interactions with CRS, but building…

Human-Computer Interaction · Computer Science 2025-08-01 Luyu Chen , Quanyu Dai , Zeyu Zhang , Xueyang Feng , Mingyu Zhang , Pengcheng Tang , Xu Chen , Yue Zhu , Zhenhua Dong

Dialogue systems have received increasing attention while automatically evaluating their performance remains challenging. User satisfaction estimation (USE) has been proposed as an alternative. It assumes that the performance of a dialogue…

Computation and Language · Computer Science 2023-05-23 Fanghua Ye , Zhiyuan Hu , Emine Yilmaz

In this study, we explore the application of Large Language Models (LLMs) for generating synthetic users and simulating user conversations with a task-oriented dialogue system and present detailed results and their analysis. We propose a…

Computation and Language · Computer Science 2025-02-19 Adnan Ahmad , Stefan Hillmann , Sebastian Möller

Recent reinforcement learning algorithms for task-oriented dialogue system absorbs a lot of interest. However, an unavoidable obstacle for training such algorithms is that annotated dialogue corpora are often unavailable. One of the popular…

Computation and Language · Computer Science 2019-09-11 Yutai Hou , Meng Fang , Wanxiang Che , Ting Liu

This paper tackles the challenging task of evaluating socially situated conversational robots and presents a novel objective evaluation approach that relies on multimodal user behaviors. In this study, our main focus is on assessing the…

Computation and Language · Computer Science 2023-09-26 Koji Inoue , Divesh Lala , Keiko Ochi , Tatsuya Kawahara , Gabriel Skantze

Human-robot interactive decision-making is increasingly becoming ubiquitous, and trust is an influential factor in determining the reliance on autonomy. However, it is not reasonable to trust systems that are beyond our comprehension, and…

Machine Learning · Computer Science 2021-08-16 Daoming Lyu , Fangkai Yang , Hugh Kwon , Wen Dong , Levent Yilmaz , Bo Liu

Persuasion dialogue systems reflect the machine's ability to make strategic moves beyond verbal communication, and therefore differentiate themselves from task-oriented or open-domain dialogue systems and have their own unique values.…

Computation and Language · Computer Science 2022-10-25 Weiyan Shi , Yu Li , Saurav Sahay , Zhou Yu

The task-oriented spoken dialogue system (SDS) aims to assist a human user in accomplishing a specific task (e.g., hotel booking). The dialogue management is a core part of SDS. There are two main missions in dialogue management: dialogue…

Computation and Language · Computer Science 2020-09-23 Zhi Chen , Lu Chen , Xiaoyuan Liu , Kai Yu

Dialogue Systems are tools designed for various practical purposes concerning human-machine interaction. These systems should be built on ethical foundations because their behavior may heavily influence a user (think especially about…

Artificial Intelligence · Computer Science 2021-09-20 Abeer Dyoub , Stefania Costantini , Ivan Letteri , Francesca A. Lisi

Metaphors play a critical role in shaping user experiences with Voice User Interfaces (VUIs), yet existing designs often rely on static, human-centric metaphors that fail to adapt to diverse contexts and user needs. This paper introduces…

Human-Computer Interaction · Computer Science 2025-10-24 Smit Desai , Jessie Chin , Dakuo Wang , Benjamin Cowan , Michael Twidale

As conversational AI-based dialogue management has increasingly become a trending topic, the need for a standardized and reliable evaluation procedure grows even more pressing. The current state of affairs suggests various evaluation…

Computation and Language · Computer Science 2020-06-12 Sarah E. Finch , Jinho D. Choi

Recent technological advances have made it possible to build real-time, interactive spoken dialogue systems for a wide variety of applications. However, when users do not respect the limitations of such systems, performance typically…

Computation and Language · Computer Science 2007-05-23 Diane J. Litman , Shimei Pan

Metaphors enable designers to communicate their ideal user experience for platforms. Yet, we often do not know if these design metaphors match users' actual experiences. In this work, we compare design and user metaphors across three…

Human-Computer Interaction · Computer Science 2026-03-31 Beleicia Bullock , James A. Landay , Michael S. Bernstein
‹ Prev 1 3 4 5 6 7 10 Next ›