English
Related papers

Related papers: Perspectives for Evaluating Conversational AI

200 papers

Chatbots' growing popularity has brought new challenges to HCI, having changed the patterns of human interactions with computers. The increasing need to approximate conversational interaction styles raises expectations for chatbots to…

Human-Computer Interaction · Computer Science 2024-01-24 Ana Paula Chaves , Marco Aurelio Gerosa

Context: User intent modeling is a crucial process in Natural Language Processing that aims to identify the underlying purpose behind a user's request, enabling personalized responses. With a vast array of approaches introduced in the…

Current conversational AI systems often provide generic, one-size-fits-all interactions that overlook individual user characteristics and lack adaptive dialogue management. To address this gap, we introduce \textbf{HumAIne-chatbot}, an…

Human-Computer Interaction · Computer Science 2025-09-25 Georgios Makridis , George Fragiadakis , Jorge Oliveira , Tomaz Saraiva , Philip Mavrepis , Georgios Fatouros , Dimosthenis Kyriazis

Conversational human-AI interaction (CHAI) have recently driven mainstream adoption of AI. However, CHAI poses two key challenges for designers and researchers: users frequently have ambiguous goals and an incomplete understanding of AI…

Human-Computer Interaction · Computer Science 2025-01-31 Arthur Caetano , Kavya Verma , Atieh Taheri , Radha Kumaran , Zichen Chen , Jiaao Chen , Tobias Höllerer , Misha Sra

Conversational search is a relatively young area of research that aims at automating an information-seeking dialogue. In this paper we help to position it with respect to other research areas within conversational Artificial Intelligence…

Information Retrieval · Computer Science 2021-06-09 Svitlana Vakulenko , Evangelos Kanoulas , Maarten de Rijke

This work compares user collaboration with conversational personal assistants vs. teams of expert chatbots. Two studies were performed to investigate whether each approach affects accomplishment of tasks and collaboration costs.…

Human-Computer Interaction · Computer Science 2018-08-27 Claudio S. Pinhanez , Heloisa Candello , Mauro C. Pichiliani , Marisa Vasconcelos , Melina Guerra , Maíra G. de Bayser , Paulo Cavalin

Recommender systems are software applications that help users find items of interest in situations of information overload in a personalized way, using knowledge about the needs and preferences of individual users. In conversational…

Artificial Intelligence · Computer Science 2022-02-10 Tommaso Di Noia , Francesco Donini , Dietmar Jannach , Fedelucio Narducci , Claudio Pomo

The growing popularity of AI writing assistants presents exciting opportunities to craft tools that cater to diverse user needs. This study explores how personality shapes preferences for AI writing companions and how personalized designs…

Human-Computer Interaction · Computer Science 2025-09-16 Mengke Wu , Kexin Quan , Weizi Liu , Mike Yao , Jessie Chin

We describe experiments towards building a conversational digital assistant that considers the preferred conversational style of the user. In particular, these experiments are designed to measure whether users prefer and trust an assistant…

Human-Computer Interaction · Computer Science 2019-04-04 Katherine Metcalf , Barry-John Theobald , Garrett Weinberg , Robert Lee , Ing-Marie Jonsson , Russ Webb , Nicholas Apostoloff

From its inception, AI has had a rather ambivalent relationship to humans---swinging between their augmentation and replacement. Now, as AI technologies enter our everyday lives at an ever increasing pace, there is a greater need for AI…

Artificial Intelligence · Computer Science 2019-10-17 Subbarao Kambhampati

Virtual assistants, also known as intelligent conversational systems such as Google's Virtual Assistant and Apple's Siri, interact with human-like responses to users' queries and finish specific tasks. Meanwhile, existing recommendation…

Information Retrieval · Computer Science 2019-01-08 Dimitrios Rafailidis , Yannis Manolopoulos

The article further develops and formalizes a theory of friendly dialogue in an AI System of Dr. Watson type, as proposed in our previous publication[4],[19]. The main principle of this type of AI is to guide the user toward a solution in a…

Artificial Intelligence · Computer Science 2024-07-31 Saveli Goldberg , Vladimir Sluchak

Novice and expert users have different systematic preferences in task-oriented dialogues. However, whether catering to these preferences actually improves user experience and task performance remains understudied. To investigate the effects…

Human-Computer Interaction · Computer Science 2025-12-01 Li Siyan , Jason Zhang , Akash Maharaj , Yuanming Shi , Yunyao Li

Large, transformer-based pretrained language models like BERT, GPT, and T5 have demonstrated a deep understanding of contextual semantics and language syntax. Their success has enabled significant advances in conversational AI, including…

Computation and Language · Computer Science 2023-02-17 Christopher Richardson , Larry Heck

The integration of Artificial Intelligence (AI) necessitates determining whether systems function as tools or collaborative teammates. In this study, by synthesizing Human-AI Interaction (HAI) literature, we analyze this distinction across…

Human-Computer Interaction · Computer Science 2026-02-19 Most. Sharmin Sultana Samu , Nafisa Khan , Kazi Toufique Elahi , Tasnuva Binte Rahman , Md. Rakibul Islam , Farig Sadeque

AI alignment is about ensuring AI systems only pursue goals and activities that are beneficial to humans. Most of the current approach to AI alignment is to learn what humans value from their behavioural data. This paper proposes a…

Artificial Intelligence · Computer Science 2023-10-06 Pei-Yu Chen , Myrthe L. Tielman , Dirk K. J. Heylen , Catholijn M. Jonker , M. Birna van Riemsdijk

Enhancing user engagement through personalization in conversational agents has gained significance, especially with the advent of large language models that generate fluent responses. Personalized dialogue generation, however, is…

Computation and Language · Computer Science 2024-07-30 Yi-Pei Chen , Noriki Nishida , Hideki Nakayama , Yuji Matsumoto

Virtual assistants are becoming increasingly important speech-driven Information Retrieval platforms that assist users with various tasks. We discuss open problems and challenges with respect to modeling spoken information queries for…

Information Retrieval · Computer Science 2023-04-27 Christophe Van Gysel

A rapidly increasing amount of human conversation occurs online. But divisiveness and conflict can fester in text-based interactions on social media platforms, in messaging apps, and on other digital forums. Such toxicity increases…

Human-Computer Interaction · Computer Science 2023-10-24 Lisa P. Argyle , Ethan Busby , Joshua Gubler , Chris Bail , Thomas Howe , Christopher Rytting , David Wingate

Humanness is core to speech interface design. Yet little is known about how users conceptualise perceptions of humanness and how people define their interaction with speech interfaces through this. To map these perceptions n=21 participants…

Human-Computer Interaction · Computer Science 2019-07-30 Philip R. Doyle , Justin Edwards , Odile Dumbleton , Leigh Clark , Benjamin R. Cowan