English
Related papers

Related papers: Approximating Interactive Human Evaluation with Se…

200 papers

Large language models (LLMs) are powerful dialogue agents, but specializing them towards fulfilling a specific function can be challenging. Instructing tuning, i.e. tuning models on instruction and sample responses generated by humans…

Computation and Language · Computer Science 2024-01-11 Dennis Ulmer , Elman Mansimov , Kaixiang Lin , Justin Sun , Xibin Gao , Yi Zhang

As dialogue systems and chatbots increasingly integrate into everyday interactions, the need for efficient and accurate evaluation methods becomes paramount. This study explores the comparative performance of human and AI assessments across…

Computation and Language · Computer Science 2024-09-11 Ike Ebubechukwu , Johane Takeuchi , Antonello Ceravola , Frank Joublin

Conversational recommender systems offer the promise of interactive, engaging ways for users to find items they enjoy. We seek to improve conversational recommendation via three dimensions: 1) We aim to mimic a common mode of human…

Computation and Language · Computer Science 2021-12-13 Shuyang Li , Bodhisattwa Prasad Majumder , Julian McAuley

We study open domain dialogue generation with dialogue acts designed to explain how people engage in social chat. To imitate human behavior, we propose managing the flow of human-machine interactions with the dialogue acts as policies. The…

Computation and Language · Computer Science 2018-07-23 Can Xu , Wei Wu , Yu Wu

Dialogue systems without consistent responses are not fascinating. In this study, we build a dialogue system that can respond based on a given character setting (persona) to bring consistency. Considering the trend of the rapidly increasing…

Computation and Language · Computer Science 2022-06-14 Tomohito Kasahara , Daisuke Kawahara , Nguyen Tung , Shengzhe Li , Kenta Shinzato , Toshinori Sato

Automatically evaluating the quality of dialogue responses for unstructured domains is a challenging problem. ADEM(Lowe et al. 2017) formulated the automatic evaluation of dialogue systems as a learning problem and showed that such a model…

Computation and Language · Computer Science 2019-02-26 Ananya B. Sai , Mithun Das Gupta , Mitesh M. Khapra , Mukundhan Srinivasan

Self-anthropomorphism in robots manifests itself through their display of human-like characteristics in dialogue, such as expressing preferences and emotions. Our study systematically analyzes self-anthropomorphic expression within various…

Computation and Language · Computer Science 2024-10-08 Yu Li , Devamanyu Hazarika , Di Jin , Julia Hirschberg , Yang Liu

Recent progress on neural approaches for language processing has triggered a resurgence of interest on building intelligent open-domain chatbots. However, even the state-of-the-art neural chatbots cannot produce satisfying responses for…

Computation and Language · Computer Science 2022-08-10 Behnam Hedayatnia , Di Jin , Yang Liu , Dilek Hakkani-Tur

In spoken dialogue systems, we aim to deploy artificial intelligence to build automated dialogue agents that can converse with humans. A part of this effort is the policy optimisation task, which attempts to find a policy describing how to…

Computation and Language · Computer Science 2018-02-13 Gellért Weisz , Paweł Budzianowski , Pei-Hao Su , Milica Gašić

Chatbots are designed to carry out human-like conversations across different domains, such as general chit-chat, knowledge exchange, and persona-grounded conversations. To measure the quality of such conversational agents, a dialogue…

Computation and Language · Computer Science 2022-01-19 Chen Zhang , Luis Fernando D'Haro , Thomas Friedrichs , Haizhou Li

Intelligent dialogue systems are expected as a new interface between humans and machines. Such an intelligent dialogue system should estimate the user's internal state (UIS) in dialogues and change its response appropriately according to…

Computation and Language · Computer Science 2020-12-08 Takashi Kodama , Ribeka Tanaka , Sadao Kurohashi

The ultimate goal of dialog research is to develop systems that can be effectively used in interactive settings by real users. To this end, we introduced the Interactive Evaluation of Dialog Track at the 9th Dialog System Technology…

Computation and Language · Computer Science 2022-08-01 Shikib Mehri , Yulan Feng , Carla Gordon , Seyed Hossein Alavi , David Traum , Maxine Eskenazi

Encoder-decoder based neural architectures serve as the basis of state-of-the-art approaches in end-to-end open domain dialog systems. Since most of such systems are trained with a maximum likelihood~(MLE) objective they suffer from issues…

Efforts towards endowing robots with the ability to speak have benefited from recent advancements in natural language processing, in particular large language models. However, current language models are not fully incremental, as their…

Computation and Language · Computer Science 2025-04-03 Casey Kennington , Pierre Lison , David Schlangen

An automated metric to evaluate dialogue quality is vital for optimizing data driven dialogue management. The common approach of relying on explicit user feedback during a conversation is intrusive and sparse. Current models to estimate…

We propose EnDex, the first human-reaction based model to evaluate dialogue engagingness. EnDex is trained on 80k Reddit-based Engagement Dataset (RED) curated using a novel distant-supervision framework. Engagingness is a key measure that…

Computation and Language · Computer Science 2022-10-25 Guangxuan Xu , Ruibo Liu , Fabrice Harel-Canada , Nischal Reddy Chandra , Nanyun Peng

There is a resurgent interest in developing intelligent open-domain dialog systems due to the availability of large amounts of conversational data and the recent progress on neural approaches to conversational AI. Unlike traditional…

Computation and Language · Computer Science 2020-03-02 Minlie Huang , Xiaoyan Zhu , Jianfeng Gao

Aligning AI agents with human values is challenging due to diverse and subjective notions of values. Standard alignment methods often aggregate crowd feedback, which can result in the suppression of unique or minority preferences. We…

Artificial Intelligence · Computer Science 2024-10-30 Carter Blair , Kate Larson , Edith Law

We propose a novel preference alignment framework for improving spoken dialogue models on real-time conversations from user interactions. Current preference learning methods primarily focus on text-based language models, and are not…

Computation and Language · Computer Science 2025-06-27 Anne Wu , Laurent Mazaré , Neil Zeghidour , Alexandre Défossez

End-to-end neural approaches are becoming increasingly common in conversational scenarios due to their promising performances when provided with sufficient amount of data. In this paper, we present a novel methodology to address the…

Computation and Language · Computer Science 2019-10-17 Sourabh Majumdar , Serra Sinem Tekiroglu , Marco Guerini
‹ Prev 1 3 4 5 6 7 10 Next ›