English
Related papers

Related papers: What is wrong with you?: Leveraging User Sentiment…

200 papers

When engaging in conversations, dialogue agents in a virtual simulation environment may exhibit their own emotional states that are unrelated to the immediate conversational context, a phenomenon known as self-emotion. This study explores…

Multiagent Systems · Computer Science 2024-08-06 Qiang Zhang , Jason Naradowsky , Yusuke Miyao

We study open domain dialogue generation with dialogue acts designed to explain how people engage in social chat. To imitate human behavior, we propose managing the flow of human-machine interactions with the dialogue acts as policies. The…

Computation and Language · Computer Science 2018-07-23 Can Xu , Wei Wu , Yu Wu

Reliable automatic evaluation of dialogue systems under an interactive environment has long been overdue. An ideal environment for evaluating dialog systems, also known as the Turing test, needs to involve human interaction, which is…

Computation and Language · Computer Science 2021-09-23 Haoming Jiang , Bo Dai , Mengjiao Yang , Tuo Zhao , Wei Wei

Automatically evaluating the quality of dialogue responses for unstructured domains is a challenging problem. ADEM(Lowe et al. 2017) formulated the automatic evaluation of dialogue systems as a learning problem and showed that such a model…

Computation and Language · Computer Science 2019-02-26 Ananya B. Sai , Mithun Das Gupta , Mitesh M. Khapra , Mukundhan Srinivasan

We present an empirical investigation of various ways to automatically identify phrases in a tagged corpus that are useful for dialogue act tagging. We found that a new method (which measures a phrase's deviation from an…

Artificial Intelligence · Computer Science 2007-05-23 Ken Samuel , Sandra Carberry , K. Vijay-Shanker

The construction of open-domain dialogue systems requires high-quality dialogue datasets. The dialogue data admits a wide variety of responses for a given dialogue history, especially responses with different semantics. However, collecting…

Computation and Language · Computer Science 2022-11-01 Jiao Ou , Jinchao Zhang , Yang Feng , Jie Zhou

Dialog response ranking is used to rank response candidates by considering their relation to the dialog history. Although researchers have addressed this concept for open-domain dialogs, little attention has been focused on task-oriented…

Computation and Language · Computer Science 2018-11-29 Junki Ohmura , Maxine Eskenazi

Despite significant research effort in the development of automatic dialogue evaluation metrics, little thought is given to evaluating dialogues other than in English. At the same time, ensuring metrics are invariant to semantically similar…

Computation and Language · Computer Science 2023-09-11 John Mendonça , Patrícia Pereira , Helena Moniz , João Paulo Carvalho , Alon Lavie , Isabel Trancoso

Personalizing dialogue agents is important for dialogue systems to generate more specific, consistent, and engaging responses. However, most current dialogue personalization approaches rely on explicit persona descriptions during inference,…

Computation and Language · Computer Science 2021-12-01 Wangchunshu Zhou , Qifei Li , Chenle Li

Measuring empathy in conversation can be challenging, as empathy is a complex and multifaceted psychological construct that involves both cognitive and emotional components. Human evaluations can be subjective, leading to inconsistent…

Artificial Intelligence · Computer Science 2023-01-31 Bushra Amjad , Muhammad Zeeshan , Mirza Omer Beg

Existing open-domain dialog models are generally trained to minimize the perplexity of target human responses. However, some human replies are more engaging than others, spawning more followup interactions. Current conversational models are…

Computation and Language · Computer Science 2020-09-16 Xiang Gao , Yizhe Zhang , Michel Galley , Chris Brockett , Bill Dolan

Pretrained language models often do not perform tasks in ways that are in line with our preferences, e.g., generating offensive text or factually incorrect summaries. Recent work approaches the above issue by learning from a simple form of…

Computation and Language · Computer Science 2022-11-18 Jérémy Scheurer , Jon Ander Campos , Jun Shern Chan , Angelica Chen , Kyunghyun Cho , Ethan Perez

In this study, we develop a dialogue system for a dialogue robot competition. In the system, the characteristics of sightseeing spots are expressed as "attribute vectors" in advance, and the user is questioned on the different attributes of…

Human-Computer Interaction · Computer Science 2022-10-18 Motoyuki Suzuki , Shintaro Sodeya , Taichi Nakamura

Despite significant progress in neural spoken dialog systems, personality-aware conversation agents -- capable of adapting behavior based on personalities -- remain underexplored due to the absence of personality annotations in speech…

Sound · Computer Science 2025-05-21 Sho Inoue , Shai Wang , Haizhou Li

Automatic evaluation of language generation systems is a well-studied problem in Natural Language Processing. While novel metrics are proposed every year, a few popular metrics remain as the de facto metrics to evaluate tasks such as image…

Computation and Language · Computer Science 2020-10-27 Ozan Caglayan , Pranava Madhyastha , Lucia Specia

The ability to model and automatically detect dialogue act is an important step toward understanding spontaneous speech and Instant Messages. However, it has been difficult to infer a dialogue act from a surface utterance because it highly…

Computation and Language · Computer Science 2018-06-05 AbdelRahim Elmadany , Sherif Abdou , Mervat Gheith

$ $Dialogue systems are evaluated depending on their type and purpose. Two categories are often distinguished: (1) task-oriented dialogue systems (TDS), which are typically evaluated on utility, i.e., their ability to complete a specified…

Information Retrieval · Computer Science 2022-04-27 Clemencia Siro , Mohammad Aliannejadi , Maarten de Rijke

Reward-driven proactive dialogue agents require precise estimation of user satisfaction as an intrinsic reward signal to determine optimal interaction strategies. Specifically, this framework triggers clarification questions when detecting…

Machine Learning · Computer Science 2025-05-27 Wei Shen , Xiaonan He , Chuheng Zhang , Xuyun Zhang , Xiaolong Xu , Wanchun Dou

Chit-chat models are known to have several problems: they lack specificity, do not display a consistent personality and are often not very captivating. In this work we present the task of making chit-chat more engaging by conditioning on…

Artificial Intelligence · Computer Science 2018-09-27 Saizheng Zhang , Emily Dinan , Jack Urbanek , Arthur Szlam , Douwe Kiela , Jason Weston

Large pre-trained language models have exhibited unprecedented capabilities in producing high-quality text via prompting techniques. This fact introduces new possibilities for data collection and annotation, particularly in situations where…

Computation and Language · Computer Science 2023-05-25 Tiziano Labruna , Sofia Brenna , Andrea Zaninello , Bernardo Magnini