English
Related papers

Related papers: A Transformer-based Response Evaluator for Open-Do…

200 papers

Open-ended dialogue agents aim to deliver engaging, personalized interactions by adapting to users' traits, but existing methods face critical limitations: over-reliance on pre-collected user data, and short-horizon biases in reinforcement…

Artificial Intelligence · Computer Science 2026-02-11 Kun Peng , Conghui Tan , Yu Liu , Guohua Tang , Zhongqian Sun , Wei Yang , Zining Zhu , Lei Jiang , Yanbing Liu , Hao Peng

Evaluating open-domain dialogue systems is difficult due to the diversity of possible correct answers. Automatic metrics such as BLEU correlate weakly with human annotations, resulting in a significant bias across different models and…

Computation and Language · Computer Science 2020-04-02 Nouha Dziri , Ehsan Kamalloo , Kory W. Mathewson , Osmar Zaiane

Despite the surging demands for multilingual task-oriented dialog systems (e.g., Alexa, Google Home), there has been less research done in multilingual or cross-lingual scenarios. Hence, we propose a zero-shot adaptation of task-oriented…

Computation and Language · Computer Science 2019-11-12 Zihan Liu , Jamin Shin , Yan Xu , Genta Indra Winata , Peng Xu , Andrea Madotto , Pascale Fung

In multi-turn dialog, utterances do not always take the full form of sentences \cite{Carbonell1983DiscoursePA}, which naturally makes understanding the dialog context more difficult. However, it is essential to fully grasp the dialog…

Computation and Language · Computer Science 2020-12-15 Xiuying Chen , Zhi Cui , Jiayi Zhang , Chen Wei , Jianwei Cui , Bin Wang , Dongyan Zhao , Rui Yan

Existing research studies on cross-sentence relation extraction in long-form multi-party conversations aim to improve relation extraction without considering the explainability of such methods. This work addresses that gap by focusing on…

Computation and Language · Computer Science 2022-10-20 Alon Albalak , Varun Embar , Yi-Lin Tuan , Lise Getoor , William Yang Wang

Introducing curiosities in a conversation is a way to teach something new to the person in a pleasant and enjoyable way. Enriching dialogues with contextualized curiosities can improve the users' perception of a dialog system and their…

Computation and Language · Computer Science 2023-09-21 Frederico Vicente , Rafael Ferreira , David Semedo , João Magalhães

Goal-oriented dialog systems enable users to complete specific goals like requesting information about a movie or booking a ticket. Typically the dialog system pipeline contains multiple ML models, including natural language understanding,…

While the English virtual assistants have achieved exciting performance with an enormous amount of training resources, the needs of non-English-speakers have not been satisfied well. Up to Dec 2021, Alexa, one of the most popular smart…

Computation and Language · Computer Science 2021-12-24 Michael Sun , Kaili Huang , Mehrad Moradshahi

The aim of this paper is to mitigate the shortcomings of automatic evaluation of open-domain dialog systems through multi-reference evaluation. Existing metrics have been shown to correlate poorly with human judgement, particularly in…

Computation and Language · Computer Science 2019-09-10 Prakhar Gupta , Shikib Mehri , Tiancheng Zhao , Amy Pavel , Maxine Eskenazi , Jeffrey P. Bigham

We present a novel framework designed to extend model reconciliation approaches, commonly used in human-aware planning, for enhanced human-AI interaction. By adopting a structured argumentation-based dialogue paradigm, our framework enables…

Artificial Intelligence · Computer Science 2024-08-09 Stylianos Loukas Vasileiou , Ashwin Kumar , William Yeoh , Tran Cao Son , Francesca Toni

We present the first human-annotated dialogue-based relation extraction (RE) dataset DialogRE, aiming to support the prediction of relation(s) between two arguments that appear in a dialogue. We further offer DialogRE as a platform for…

Computation and Language · Computer Science 2020-04-20 Dian Yu , Kai Sun , Claire Cardie , Dong Yu

Multiple different responses are often plausible for a given open domain dialog context. Prior work has shown the importance of having multiple valid reference responses for meaningful and robust automated evaluations. In such cases, common…

Computation and Language · Computer Science 2021-06-08 Varun Gangal , Harsh Jhamtani , Eduard Hovy , Taylor Berg-Kirkpatrick

In this paper, we explore the application of language and speech technology to open-ended questions in a Dutch panel survey. In an experimental wave respondents could choose to answer open questions via speech or keyboard. Automatic speech…

Computation and Language · Computer Science 2023-02-22 Henk van den Heuvel , Martijn Bentum , Simone Wills , Judith C. Koops

We introduce our system developed for Dialogue Robot Competition 2023 (DRC2023). First, rule-based utterance selection and utterance generation using a large language model (LLM) are combined. We ensure the quality of system utterances…

Human-Computer Interaction · Computer Science 2023-12-22 Ryo Yanagimoto , Yunosuke Kubo , Miki Oshio , Mikio Nakano , Kenta Yamamoto , Kazunori Komatani

In this paper, we present our Alexa Prize Grand Challenge 4 socialbot: Proto. Leveraging diverse sources of world knowledge, and powered by a suite of neural and rule-based natural language understanding modules, state-of-the-art neural…

Computation and Language · Computer Science 2021-09-07 Sougata Saha , Souvik Das , Elizabeth Soper , Erin Pacquetet , Rohini K. Srihari

Conversational Intelligence requires that a person engage on informational, personal and relational levels. Advances in Natural Language Understanding have helped recent chatbots succeed at dialog on the informational level. However,…

Task-oriented conversational modeling with unstructured knowledge access, as track 1 of the 9th Dialogue System Technology Challenges (DSTC 9), requests to build a system to generate response given dialogue history and knowledge access.…

Computation and Language · Computer Science 2020-12-23 Chao-Hong Tan , Xiaoyu Yang , Zi'ou Zheng , Tianda Li , Yufei Feng , Jia-Chen Gu , Quan Liu , Dan Liu , Zhen-Hua Ling , Xiaodan Zhu

We develop a unified system to answer directly from text open-domain questions that may require a varying number of retrieval steps. We employ a single multi-task transformer model to perform all the necessary subtasks -- retrieving…

Computation and Language · Computer Science 2021-11-01 Peng Qi , Haejun Lee , Oghenetegiri "TG" Sido , Christopher D. Manning

Transformer-based open-domain dialog models have become increasingly popular in recent years. These models typically represent context as a concatenation of a dialog history. However, there is no criterion to decide how many utterances…

Computation and Language · Computer Science 2024-09-04 Xinyi Shen , Zuoquan Lin

We survey SoTA open-domain conversational AI models with the purpose of presenting the prevailing challenges that still exist to spur future research. In addition, we provide statistics on the gender of conversational AI in order to guide…

Computation and Language · Computer Science 2022-05-03 Tosin Adewumi , Foteini Liwicki , Marcus Liwicki