English
Related papers

Related papers: EnDex: Evaluation of Dialogue Engagingness at Scal…

200 papers

A robot needs contextual awareness, effective speech production and complementing non-verbal gestures for successful communication in society. In this paper, we present our end-to-end system that tries to enhance the effectiveness of…

Robotics · Computer Science 2024-10-01 Bishal Ghosh , Abhinav Dhall , Ekta Singla

A well-designed interactive human-like dialogue system is expected to take actions (e.g. smiling) and respond in a pattern similar to humans. However, due to the limitation of single-modality (only speech) or small volume of currently…

Human-Computer Interaction · Computer Science 2022-12-13 Zhiling Luo , Qiankun Shi , Sha Zhao , Wei Zhou , Haiqing Chen , Yuankai Ma , Haitao Leng

Embodied conversational agents (ECAs) are increasingly more realistic and capable of dynamic conversations. In online surveys, anthropomorphic agents could help address issues like careless responding and satisficing, which originate from…

Human-Computer Interaction · Computer Science 2025-08-05 Matus Krajcovic , Peter Demcak , Eduard Kuric

Emotional support dialogue systems aim to reduce help-seekers' distress and help them overcome challenges. While human values$\unicode{x2013}$core beliefs that shape an individual's priorities$\unicode{x2013}$are increasingly emphasized in…

Computation and Language · Computer Science 2025-06-03 Juhee Kim , Chunghu Mok , Jisun Lee , Hyang Sook Kim , Yohan Jo

The emotion recognition in conversation (ERC) task aims to predict the emotion label of an utterance in a conversation. Since the dependencies between speakers are complex and dynamic, which consist of intra- and inter-speaker dependencies,…

Computation and Language · Computer Science 2022-06-08 Yinan Bao , Qianwen Ma , Lingwei Wei , Wei Zhou , Songlin Hu

Conversational agents are exploding in popularity. However, much work remains in the area of non goal-oriented conversations, despite significant growth in research interest over recent years. To advance the state of the art in…

The task of empathetic response generation aims to understand what feelings a speaker expresses on his/her experiences and then reply to the speaker appropriately. To solve the task, it is essential to model the content-emotion duality of a…

Computation and Language · Computer Science 2022-09-27 Peiqin Lin , Jiashuo Wang , Hinrich Schütze , Wenjie Li

Response diversity has become an important criterion for evaluating the quality of open-domain dialogue generation models. However, current evaluation metrics for response diversity often fail to capture the semantic diversity of generated…

Computation and Language · Computer Science 2022-10-25 Seungju Han , Beomsu Kim , Buru Chang

Commonsense reasoning is omnipresent in human communications and thus is an important feature for open-domain dialogue systems. However, evaluating commonsense in dialogue systems is still an open challenge. We take the first step by…

Computation and Language · Computer Science 2023-11-06 Sarik Ghazarian , Yijia Shao , Rujun Han , Aram Galstyan , Nanyun Peng

Open-domain human-computer conversation has been attracting increasing attention over the past few years. However, there does not exist a standard automatic evaluation metric for open-domain dialog systems; researchers usually resort to…

Computation and Language · Computer Science 2017-07-18 Chongyang Tao , Lili Mou , Dongyan Zhao , Rui Yan

We propose a new benchmark, ComperDial, which facilitates the training and evaluation of evaluation metrics for open-domain dialogue systems. ComperDial consists of human-scored responses for 10,395 dialogue turns in 1,485 conversations…

Computation and Language · Computer Science 2024-06-18 Hiromi Wakaki , Yuki Mitsufuji , Yoshinori Maeda , Yukiko Nishimura , Silin Gao , Mengjie Zhao , Keiichi Yamada , Antoine Bosselut

Dialogue disentanglement aims to group utterances in a long and multi-participant dialogue into threads. This is useful for discourse analysis and downstream applications such as dialogue response selection, where it can be the first step…

Computation and Language · Computer Science 2023-06-28 Ta-Chung Chi , Alexander I. Rudnicky

State-of-the-art conversational agents have advanced significantly in conjunction with the use of large transformer-based language models. However, even with these advancements, conversational agents still lack the ability to produce…

Computation and Language · Computer Science 2020-10-21 Sashank Santhanam , Wei Ping , Raul Puri , Mohammad Shoeybi , Mostofa Patwary , Bryan Catanzaro

A key trait of daily conversations between individuals is the ability to express empathy towards others, and exploring ways to implement empathy is a crucial step towards human-like dialogue systems. Previous approaches on this topic mainly…

Computation and Language · Computer Science 2023-02-02 Sahand Sabour , Chujie Zheng , Minlie Huang

This study explores the relationship between textual features and Information Engagement (IE) on digital platforms. It highlights the impact of computational linguistics and analytics on user interaction. The READ model is introduced to…

Computation and Language · Computer Science 2024-09-04 Nimrod Dvir

Automatic evaluation metrics are essential for the rapid development of open-domain dialogue systems as they facilitate hyper-parameter tuning and comparison between models. Although recently proposed trainable conversation-level metrics…

Computation and Language · Computer Science 2022-03-21 Sarik Ghazarian , Nuan Wen , Aram Galstyan , Nanyun Peng

Empathy is a vital factor that contributes to mutual understanding, and joint problem-solving. In recent years, a growing number of studies have recognized the benefits of empathy and started to incorporate empathy in conversational…

Computation and Language · Computer Science 2023-10-13 Aravind Sesagiri Raamkumar , Yinping Yang

Recommendation systems have traditionally relied on short-term engagement signals, such as clicks and likes, to personalize content. However, these signals are often noisy, sparse, and insufficient for capturing long-term user satisfaction…

Information Retrieval · Computer Science 2025-10-10 Saeideh Bakhshi , Phuong Mai Nguyen , Robert Schiller , Tiantian Xu , Pawan Kodandapani , Andrew Levine , Cayman Simpson , Qifan Wang

Automatic evaluation metrics are a crucial component of dialog systems research. Standard language evaluation metrics are known to be ineffective for evaluating dialog. As such, recent research has proposed a number of novel,…

Computation and Language · Computer Science 2021-07-09 Yi-Ting Yeh , Maxine Eskenazi , Shikib Mehri

Full-duplex interaction, where speakers and listeners converse simultaneously, is a key element of human communication often missing from traditional spoken dialogue systems. These systems, based on rigid turn-taking paradigms, struggle to…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-27 Chengyou Wang , Hongfei Xue , Guojian Li , Zhixian Zhao , Shuiyuan Wang , Shuai Wang , Xin Xu , Hui Bu , Lei Xie