English
Related papers

Related papers: Evaluator for Emotionally Consistent Chatbots

200 papers

Building open-domain chatbots is a challenging area for machine learning research. While prior work has shown that scaling neural models in the number of parameters and the size of the data they are trained on gives improved results, we…

Computation and Language · Computer Science 2020-05-01 Stephen Roller , Emily Dinan , Naman Goyal , Da Ju , Mary Williamson , Yinhan Liu , Jing Xu , Myle Ott , Kurt Shuster , Eric M. Smith , Y-Lan Boureau , Jason Weston

Most chatbot literature that focuses on improving the fluency and coherence of a chatbot, is dedicated to making chatbots more human-like. However, very little work delves into what really separates humans from chatbots -- humans…

Computation and Language · Computer Science 2021-04-26 Hsuan Su , Jiun-Hao Jhan , Fan-yun Sun , Saurav Sahay , Hung-yi Lee

ChatGPT has gained a huge popularity since its introduction. Its positive aspects have been reported through many media platforms, and some analyses even showed that ChatGPT achieved a decent grade in professional exams, adding extra…

Computation and Language · Computer Science 2023-11-15 Myeongjun Erik Jang , Thomas Lukasiewicz

The performance of a task-completion dialogue agent usually affects the user experience: when the conversation system yields an unreasonable response, users may feel dissatisfied. Besides, early termination often occurs in disappointing…

Human-Computer Interaction · Computer Science 2021-10-06 Rui Zhang , Kai Yin , Li Li

ChatGPT is a publicly available chatbot that can quickly generate texts on given topics, but it is unknown whether the chatbot is really superior to human writers in all aspects of writing and whether its writing quality can be prominently…

Computation and Language · Computer Science 2023-03-22 Tongquan Zhou , Siyi Cao , Siruo Zhou , Yao Zhang , Aijing He

User engagement is a critical metric for evaluating the quality of open-domain dialogue systems. Prior work has focused on conversation-level engagement by using heuristically constructed features such as the number of turns and the total…

Computation and Language · Computer Science 2020-01-27 Sarik Ghazarian , Ralph Weischedel , Aram Galstyan , Nanyun Peng

This study investigates the design, development, and evaluation of a Large Language Model (LLM)-based chatbot for teaching English conversations in an English as a Foreign Language (EFL) context. Employing the Design and Development…

Human-Computer Interaction · Computer Science 2024-09-10 Jaekwon Park , Jiyoung Bae , Unggi Lee , Taekyung Ahn , Sookbun Lee , Dohee Kim , Aram Choi , Yeil Jeong , Jewoong Moon , Hyeoncheol Kim

This study focuses on emotion-sensitive spoken dialogue in human-machine speech interaction. With the advancement of Large Language Models (LLMs), dialogue systems can handle multimodal data, including audio. Recent models have enhanced the…

Sound · Computer Science 2024-07-30 Hongfei Xue , Yuhao Liang , Bingshen Mu , Shiliang Zhang , Mengzhe Chen , Qian Chen , Lei Xie

To overcome the limitations of automated metrics (e.g. BLEU, METEOR) for evaluating dialogue systems, researchers typically use human judgments to provide convergent evidence. While it has been demonstrated that human judgments can suffer…

Computation and Language · Computer Science 2019-09-24 Sashank Santhanam , Samira Shaikh

Fully data driven Chatbots for non-goal oriented dialogues are known to suffer from inconsistent behaviour across their turns, stemming from a general difficulty in controlling parameters like their assumed background personality and…

Computation and Language · Computer Science 2020-03-31 Fabian Galetzka , Chukwuemeka U. Eneh , David Schlangen

Systems powered by artificial intelligence are being developed to be more user-friendly by communicating with users in a progressively human-like conversational way. Chatbots, also known as dialogue systems, interactive conversational…

Human-Computer Interaction · Computer Science 2020-01-03 Kennedy Ralston , Yuhao Chen , Haruna Isah , Farhana Zulkernine

While dialogue remains an important end-goal of natural language research, the difficulty of evaluation is an oft-quoted reason why it remains troublesome to make real progress towards its solution. Evaluation difficulties are actually…

Computation and Language · Computer Science 2019-09-10 Margaret Li , Jason Weston , Stephen Roller

In this work, we investigate the human perception of coherence in open-domain dialogues. In particular, we address the problem of annotating and modeling the coherence of next-turn candidates while considering the entire history of the…

Computation and Language · Computer Science 2020-06-19 Alessandra Cervone , Giuseppe Riccardi

Chatbots, taking advantage of the success of the messaging apps and recent advances in Artificial Intelligence, have become very popular, from helping business to improve customer services to chatting to users for the sake of conversation…

Computation and Language · Computer Science 2018-02-21 Ana Paula Appel , Paulo Rodrigo Cavalin , Marisa Affonso Vasconcelos , Claudio Santos Pinhanez

Discourse coherence plays an important role in the translation of one text. However, the previous reported models most focus on improving performance over individual sentence while ignoring cross-sentence links and dependencies, which…

Computation and Language · Computer Science 2018-11-15 Hao Xiong , Zhongjun He , Hua Wu , Haifeng Wang

We propose ChatGPT-EDSS, an empathetic dialogue speech synthesis (EDSS) method using ChatGPT for extracting dialogue context. ChatGPT is a chatbot that can deeply understand the content and purpose of an input prompt and appropriately…

Sound · Computer Science 2023-05-24 Yuki Saito , Shinnosuke Takamichi , Eiji Iimori , Kentaro Tachibana , Hiroshi Saruwatari

Emotion Recognition in Conversation (ERC) has become a fundamental capability for large language models (LLMs) in human-centric interaction. Beyond accurate recognition, coherent emotional expression is also crucial, yet both are limited by…

Artificial Intelligence · Computer Science 2026-04-21 Shaowei Zhang , Faqiang Qian , Yan Chen , Ziliang Wang , Kang An , Yong Dai , Mengya Gao , Yichao Wu

Developing high-performing dialogue systems benefits from the automatic identification of undesirable behaviors in system responses. However, detecting such behaviors remains challenging, as it draws on a breadth of general knowledge and…

Computation and Language · Computer Science 2023-09-14 Sarah E. Finch , Ellie S. Paek , Jinho D. Choi

Developing adaptable, extensible, and accurate task bots with minimal or zero human intervention is a significant challenge in dialog research. This thesis examines the obstacles and potential solutions for creating such bots, focusing on…

Computation and Language · Computer Science 2025-08-28 Xiaoying Zhang

Chatbots can serve as a viable tool for preliminary depression diagnosis via interactive conversations with potential patients. Nevertheless, the blend of task-oriented and chit-chat in diagnosis-related dialogues necessitates professional…

Artificial Intelligence · Computer Science 2024-04-09 Kunyao Lan , Cong Ming , Binwei Yao , Lu Chen , Mengyue Wu