English
Related papers

Related papers: Turn-level Dialog Evaluation with Dialog-level Wea…

200 papers

A chatbot that converses like a human should be goal-oriented (i.e., be purposeful in conversation), which is beyond language generation. However, existing dialogue systems often heavily rely on cumbersome hand-crafted rules or costly…

Computation and Language · Computer Science 2020-05-27 Jianfeng Liu , Feiyang Pan , Ling Luo

This research presents a hybrid emotion recognition system integrating advanced Deep Learning, Natural Language Processing (NLP), and Large Language Models (LLMs) to analyze audio and textual data for enhancing customer interactions in…

Computation and Language · Computer Science 2025-03-31 Sahan Hewage Wewelwala , T. G. D. K. Sumanathilaka

In this work, we propose an adversarial learning method for reward estimation in reinforcement learning (RL) based task-oriented dialog models. Most of the current RL based task-oriented dialog systems require the access to a reward signal…

Computation and Language · Computer Science 2018-05-31 Bing Liu , Ian Lane

This paper introduces a simple yet effective data-centric approach for the task of improving persona-conditioned dialogue agents. Prior model-centric approaches unquestioningly depend on the raw crowdsourced benchmark datasets such as…

Computation and Language · Computer Science 2022-02-17 Minju Kim , Beong-woo Kwak , Youngwook Kim , Hong-in Lee , Seung-won Hwang , Jinyoung Yeo

Motivation: Disease diagnosis oriented dialogue system models the interactive consultation procedure as Markov Decision Process and reinforcement learning algorithms are used to solve the problem. Existing approaches usually employ a flat…

Artificial Intelligence · Computer Science 2023-11-08 Cheng Zhong , Kangenbei Liao , Wei Chen , Qianlong Liu , Baolin Peng , Xuanjing Huang , Jiajie Peng , Zhongyu Wei

This paper examines the effect of real-time, personalized alignment of a robot's reward function to the human's values on trust and team performance. We present and compare three distinct robot interaction strategies: a non-learner strategy…

Robotics · Computer Science 2023-11-28 Shreyas Bhat , Joseph B. Lyons , Cong Shi , X. Jessie Yang

To predict what someone will say is to model how they think. We study this through next-turn dialogue prediction: given a conversation, predict the next utterance produced by a person. We compare learning approaches along two dimensions:…

Computation and Language · Computer Science 2026-01-09 Kanishk Gandhi , Agam Bhatia , Noah D. Goodman

Following the rapid progress in natural language processing (NLP) models, language models are applied to increasingly more complex interactive tasks such as negotiations and conversation moderations. Having human evaluators directly…

Computation and Language · Computer Science 2024-07-26 Hyundong Cho , Thamme Gowda , Yuyang Huang , Zixun Lu , Tianli Tong , Jonathan May

This paper contributes a first study into how different human users deliver simultaneous control and feedback signals during human-robot interaction. As part of this work, we formalize and present a general interactive learning framework…

Artificial Intelligence · Computer Science 2017-03-16 Kory W. Mathewson , Patrick M. Pilarski

End-to-end generation-based approaches have been investigated and applied in task-oriented dialogue systems. However, in industrial scenarios, existing methods face the bottlenecks of controllability (e.g., domain-inconsistent responses,…

Computation and Language · Computer Science 2023-04-04 Yuncheng Hua , Xiangyu Xi , Zheng Jiang , Guanwei Zhang , Chaobo Sun , Guanglu Wan , Wei Ye

Learning suitable and well-performing dialogue behaviour in statistical spoken dialogue systems has been in the focus of research for many years. While most work which is based on reinforcement learning employs an objective measure like…

Computation and Language · Computer Science 2020-01-22 Stefan Ultes

This paper presents Dialogos, a real-time system for human-machine spoken dialogue on the telephone in task-oriented domains. The system has been tested in a large trial with inexperienced users and it has proved robust enough to allow…

Evaluating the quality of multi-turn chatbot interactions remains challenging, as most existing methods assess interactions at the turn level without addressing whether a user's overarching goal was fulfilled. A ``goal'' here refers to an…

Artificial Intelligence · Computer Science 2025-10-07 Deepak Babu Piskala , Sharlene Chen , Udita Patel , Parul Kalra , Rafael Castrillo

Existing open-domain dialog models are generally trained to minimize the perplexity of target human responses. However, some human replies are more engaging than others, spawning more followup interactions. Current conversational models are…

Computation and Language · Computer Science 2020-09-16 Xiang Gao , Yizhe Zhang , Michel Galley , Chris Brockett , Bill Dolan

In this paper, we propose an end-to-end sentiment-aware conversational agent based on two models: a reply sentiment prediction model, which leverages the context of the dialogue to predict an appropriate sentiment for the agent to express…

Computation and Language · Computer Science 2022-07-26 Isabel Dias , Ricardo Rei , Patrícia Pereira , Luisa Coheur

This paper investigates the application of machine learning (ML) techniques to enable intelligent systems to learn multi-party turn-taking models from dialogue logs. The specific ML task consists of determining who speaks next, after each…

Computation and Language · Computer Science 2019-07-05 Maira Gatti de Bayser , Paulo Cavalin , Claudio Pinhanez , Bianca Zadrozny

Effective evaluation methods remain a significant challenge for research on open-domain conversational dialogue systems. Explicit satisfaction ratings can be elicited from users, but users often do not provide ratings when asked, and those…

Computation and Language · Computer Science 2023-02-01 Cat P. Le , Luke Dai , Michael Johnston , Yang Liu , Marilyn Walker , Reza Ghanadan

In this paper, we introduce a robotic agent specifically designed to analyze external environments and address participants' questions. The primary focus of this agent is to assist individuals using language-based interactions within…

Artificial Intelligence · Computer Science 2024-06-12 Haozheng Luo , Ruiyang Qin , Chenwei Xu , Guo Ye , Zening Luo

The emergence of instruction-tuned large language models (LLMs) has advanced the field of dialogue systems, enabling both realistic user simulations and robust multi-turn conversational agents. However, existing research often evaluates…

Computation and Language · Computer Science 2025-07-22 Chalamalasetti Kranti , Sherzod Hakimov , David Schlangen

One challenge for dialogue agents is recognizing feelings in the conversation partner and replying accordingly, a key communicative skill. While it is straightforward for humans to recognize and acknowledge others' feelings in a…

Computation and Language · Computer Science 2019-08-30 Hannah Rashkin , Eric Michael Smith , Margaret Li , Y-Lan Boureau