English
Related papers

Related papers: Understanding How People Rate Their Conversations

200 papers

Conversational agents promise conversational interaction but fail to deliver. Efforts often emulate functional rules from human speech, without considering key characteristics that conversation must encapsulate. Given its potential in…

The overall objective of 'social' dialogue systems is to support engaging, entertaining, and lengthy conversations on a wide variety of topics, including social chit-chat. Apart from raw dialogue data, user-provided ratings are the most…

Computation and Language · Computer Science 2018-11-05 Igor Shalyminov , Ondřej Dušek , Oliver Lemon

Individuals are turning to increasingly anthropomorphic, general-purpose chatbots for AI companionship, rather than roleplay-specific platforms. However, not much is known about how individuals perceive and conduct their relationships with…

Large Language Model-powered conversational agents (CAs) are increasingly capable of projecting sophisticated personalities through language, but how these projections affect users is unclear. We thus examine how CA personalities expressed…

Human-Computer Interaction · Computer Science 2026-02-20 Uğur Genç , Heng Gu , Chadha Degachi , Evangelos Niforatos , Senthil Chandrasegaran , Himanshu Verma

Evaluation of open-domain dialogue systems is highly challenging and development of better techniques is highlighted time and again as desperately needed. Despite substantial efforts to carry out reliable live evaluation of systems in…

Computation and Language · Computer Science 2022-03-14 Tianbo Ji , Yvette Graham , Gareth J. F. Jones , Chenyang Lyu , Qun Liu

Conversational recommender systems offer the promise of interactive, engaging ways for users to find items they enjoy. We seek to improve conversational recommendation via three dimensions: 1) We aim to mimic a common mode of human…

Computation and Language · Computer Science 2021-12-13 Shuyang Li , Bodhisattwa Prasad Majumder , Julian McAuley

Large Language Models (LLMs) have demonstrated remarkable capabilities in conversational tasks. Embodying an LLM as a virtual human allows users to engage in face-to-face social interactions in Virtual Reality. However, the influence of…

Human-Computer Interaction · Computer Science 2025-08-06 Leon O. H. Kroczek , Alexander May , Selina Hettenkofer , Andreas Ruider , Bernd Ludwig , Andreas Mühlberger

Engaging in discussions that involve diverse perspectives and exchanging arguments on a controversial issue is a natural way for humans to form opinions. In this process, the way arguments are presented plays a crucial role in determining…

Human-Computer Interaction · Computer Science 2024-11-19 Annalena Bea Aicher , Yuki Matsuda , Keichii Yasumoto , Wolfgang Minker , Elisabeth André , Stefan Ultes

Open-domain dialogue agents must be able to converse about many topics while incorporating knowledge about the user into the conversation. In this work we address the acquisition of such knowledge, for personalization in downstream Web…

Computation and Language · Computer Science 2019-04-25 Anna Tigunova , Andrew Yates , Paramita Mirza , Gerhard Weikum

Conversational agents have been showing lots of opportunities in healthcare by taking over a lot of tasks that used to be done by a human. One of the major functions of conversational healthcare agent is intervening users' daily behaviors.…

Human-Computer Interaction · Computer Science 2021-09-07 Youjin Hwang , Donghoon Shin , Sion Baek , Bongwon Suh , Joonhwan Lee

Personalizing dialogue agents is important for dialogue systems to generate more specific, consistent, and engaging responses. However, most current dialogue personalization approaches rely on explicit persona descriptions during inference,…

Computation and Language · Computer Science 2021-12-01 Wangchunshu Zhou , Qifei Li , Chenle Li

Mental models play an important role in whether user interaction with intelligent systems, such as dialog systems is successful or not. Adaptive dialog systems present the opportunity to align a dialog agent's behavior with heterogeneous…

Computation and Language · Computer Science 2024-08-27 Lindsey Vanderlyn , Dirk Väth , Ngoc Thang Vu

We study improving social conversational agents by learning from natural dialogue between users and a deployed model, without extra annotations. To implicitly measure the quality of a machine-generated utterance, we leverage signals like…

Computation and Language · Computer Science 2024-02-02 Richard Yuanzhe Pang , Stephen Roller , Kyunghyun Cho , He He , Jason Weston

Evaluating the quality of a dialogue interaction between two agents is a difficult task, especially in open-domain chit-chat style dialogue. There have been recent efforts to develop automatic dialogue evaluation metrics, but most of them…

Computation and Language · Computer Science 2020-05-05 Koustuv Sinha , Prasanna Parthasarathi , Jasmine Wang , Ryan Lowe , William L. Hamilton , Joelle Pineau

Accurate automatic evaluation metrics for open-domain dialogs are in high demand. Existing model-based metrics for system response evaluation are trained on human annotated data, which is cumbersome to collect. In this work, we propose to…

Computation and Language · Computer Science 2022-03-29 Sarik Ghazarian , Behnam Hedayatnia , Alexandros Papangelis , Yang Liu , Dilek Hakkani-Tur

Interactions with AI assistants are increasingly personalized to individual users. As AI personalization is dynamic and machine-learning-driven, we have limited understanding of how personalization affects interaction outcomes and user…

Human-Computer Interaction · Computer Science 2026-02-18 Maximilian Eder , Clemens Lechner , Maurice Jakesch

Communication traits in text-based human-AI conversations play pivotal roles in shaping user experiences and perceptions of systems. With the advancement of large language models (LLMs), it is now feasible to analyze these traits at a more…

Human-Computer Interaction · Computer Science 2024-11-04 Ananya Bhattacharjee , Jina Suh , Mahsa Ershadi , Shamsi T. Iqbal , Andrew D. Wilson , Javier Hernandez

We present metrics for evaluating dialog systems through a psychologically-grounded "human" lens in which conversational agents express a diversity of both states (e.g., emotion) and traits (e.g., personality), just as people do. We present…

Computation and Language · Computer Science 2023-09-19 Salvatore Giorgi , Shreya Havaldar , Farhan Ahmed , Zuhaib Akhtar , Shalaka Vaidya , Gary Pan , Lyle H. Ungar , H. Andrew Schwartz , Joao Sedoc

With the ongoing penetration of conversational user interfaces, a better understanding of social and emotional characteristic inherent to dialogue is required. Chatbots in particular face the challenge of conveying human-like behaviour…

Human-Computer Interaction · Computer Science 2021-04-29 Natascha Mariacher , Stephan Schlögl , Alexander Monz

We consider the problem of designing an artificial agent capable of interacting with humans in collaborative dialogue to produce creative, engaging narratives. In this task, the goal is to establish universe details, and to collaborate on…

Human-Computer Interaction · Computer Science 2019-02-01 Kory W. Mathewson , Pablo Samuel Castro , Colin Cherry , George Foster , Marc G. Bellemare