English
Related papers

Related papers: Rethinking Response Evaluation from Interlocutor's…

200 papers

We aim to overcome the lack of diversity in responses of current dialogue systems and to develop a dialogue system that is engaging as a conversational partner. We propose a generator-evaluator model that evaluates multiple responses…

Computation and Language · Computer Science 2022-06-13 Ryoma Sakaeda , Daisuke Kawahara

Dialogue systems have attracted more and more attention. Recent advances on dialogue systems are overwhelmingly contributed by deep learning techniques, which have been employed to enhance a wide range of big data applications such as…

Computation and Language · Computer Science 2020-07-03 Hongshen Chen , Xiaorui Liu , Dawei Yin , Jiliang Tang

Consistency is a long standing issue faced by dialogue models. In this paper, we frame the consistency of dialogue agents as natural language inference (NLI) and create a new natural language inference dataset called Dialogue NLI. We…

Computation and Language · Computer Science 2019-01-21 Sean Welleck , Jason Weston , Arthur Szlam , Kyunghyun Cho

Current conversational systems can follow simple commands and answer basic questions, but they have difficulty maintaining coherent and open-ended conversations about specific topics. Competitions like the Conversational Intelligence…

Computation and Language · Computer Science 2018-11-09 Nicolas Gontier , Koustuv Sinha , Peter Henderson , Iulian Serban , Michael Noseworthy , Prasanna Parthasarathi , Joelle Pineau

Our research is focused on making a human-like question answering system which can answer rationally. The distinguishing characteristic of our approach is that it will use automated common sense reasoning to truly "understand" dialogues,…

Artificial Intelligence · Computer Science 2019-09-19 Kinjal Basu

Existing open-domain dialog models are generally trained to minimize the perplexity of target human responses. However, some human replies are more engaging than others, spawning more followup interactions. Current conversational models are…

Computation and Language · Computer Science 2020-09-16 Xiang Gao , Yizhe Zhang , Michel Galley , Chris Brockett , Bill Dolan

A long-term goal of machine learning is to build intelligent conversational agents. One recent popular approach is to train end-to-end models on a large amount of real dialog transcripts between humans (Sordoni et al., 2015; Vinyals & Le,…

Computation and Language · Computer Science 2016-04-20 Jesse Dodge , Andreea Gane , Xiang Zhang , Antoine Bordes , Sumit Chopra , Alexander Miller , Arthur Szlam , Jason Weston

The field of eXplainable Artificial Intelligence (XAI) is increasingly recognizing the need to personalize and/or interactively adapt the explanation to better reflect users' explanation needs. While dialogue-based approaches to XAI have…

Machine Learning · Computer Science 2024-08-15 Dimitry Mindlin , Amelie Sophie Robrecht , Michael Morasch , Philipp Cimiano

In second language learning, scenario-based conversation practice is important for language learners to achieve fluency in speaking, but students often lack sufficient opportunities to practice their conversational skills with qualified…

Computation and Language · Computer Science 2024-04-01 Shuyao Xu , Long Qin , Tianyang Chen , Zhenzhou Zha , Bingxue Qiu , Weizhi Wang

Endowing dialogue agents with persona information has proven to significantly improve the consistency and diversity of their generations. While much focus has been placed on aligning dialogues with provided personas, the adaptation to the…

Computation and Language · Computer Science 2025-06-02 Daniela Occhipinti , Marco Guerini , Malvina Nissim

We investigate the task of modeling open-domain, multi-turn, unstructured, multi-participant, conversational dialogue. We specifically study the effect of incorporating different elements of the conversation. Unlike previous efforts, which…

Computation and Language · Computer Science 2016-06-02 Rami Al-Rfou , Marc Pickett , Javier Snaider , Yun-hsuan Sung , Brian Strope , Ray Kurzweil

Automated dialogue systems are important applications of artificial intelligence, and traditional systems struggle to understand user emotions and provide empathetic feedback. This study integrates emotional intelligence technology into…

Artificial Intelligence · Computer Science 2024-04-30 Jin Wang , JinFei Wang , Shuying Dai , Jiqiang Yu , Keqin Li

Evaluating large language models (LLMs) in long-form, knowledge-grounded role-play dialogues remains challenging. This study compares LLM-generated and human-authored responses in multi-turn professional training simulations through human…

Computation and Language · Computer Science 2025-10-10 Dongxu Lu , Johan Jeuring , Albert Gatt

A good empathetic dialogue system should first track and understand a user's emotion and then reply with an appropriate emotion. However, current approaches to this task either focus on improving the understanding of users' emotion or on…

Computation and Language · Computer Science 2022-08-04 Yuhan Liu , Jun Gao , Jiachen Du , Lanjun Zhou , Ruifeng Xu

Learning from free-text human feedback is essential for dialog systems, but annotated data is scarce and usually covers only a small fraction of error types known in conversational AI. Instead of collecting and annotating new datasets from…

Computation and Language · Computer Science 2023-10-25 Dominic Petrak , Nafise Sadat Moosavi , Ye Tian , Nikolai Rozanov , Iryna Gurevych

We propose novel AI-empowered chat bots for learning as conversation where a user does not read a passage but gains information and knowledge through conversation with a teacher bot. Our information-acquisition-oriented dialogue system…

Computation and Language · Computer Science 2022-05-31 Pengshan Cai , Hui Wan , Fei Liu , Mo Yu , Hong Yu , Sachindra Joshi

An automated metric to evaluate dialogue quality is vital for optimizing data driven dialogue management. The common approach of relying on explicit user feedback during a conversation is intrusive and sparse. Current models to estimate…

Machine Learning · Computer Science 2019-11-21 Praveen Kumar Bodigutla , Lazaros Polymenakos , Spyros Matsoukas

Although human evaluation remains the gold standard for open-domain dialogue evaluation, the growing popularity of automated evaluation using Large Language Models (LLMs) has also extended to dialogue. However, most frameworks leverage…

Computation and Language · Computer Science 2024-10-07 John Mendonça , Isabel Trancoso , Alon Lavie

Commonsense reasoning is omnipresent in human communications and thus is an important feature for open-domain dialogue systems. However, evaluating commonsense in dialogue systems is still an open challenge. We take the first step by…

Computation and Language · Computer Science 2023-11-06 Sarik Ghazarian , Yijia Shao , Rujun Han , Aram Galstyan , Nanyun Peng

Open-domain neural dialogue models have achieved high performance in response ranking and evaluation tasks. These tasks are formulated as a binary classification of responses given in a dialogue context, and models generally learn to make…

Computation and Language · Computer Science 2021-06-11 Prakhar Gupta , Yulia Tsvetkov , Jeffrey P. Bigham