English
Related papers

Related papers: Comprehensive Framework for Evaluating Conversatio…

200 papers

Chatbots have been studied for more than half a century. With the rapid development of natural language processing (NLP) technologies in recent years, chatbots using large language models (LLMs) have received much attention nowadays.…

Computation and Language · Computer Science 2023-12-12 Jintang Xue , Yun-Cheng Wang , Chengwei Wei , Xiaofeng Liu , Jonghye Woo , C. -C. Jay Kuo

Background: Empathy is widely recognized for improving patient outcomes, including reduced pain and anxiety and improved satisfaction, and its absence can cause harm. Meanwhile, use of artificial intelligence (AI)-based chatbots in…

Human-Computer Interaction · Computer Science 2026-02-06 Alastair Howcroft , Amber Bennett-Weston , Ahmad Khan , Joseff Griffiths , Simon Gay , Jeremy Howick

Conversational AI (CAI) systems which encompass voice- and text-based assistants are on the rise and have been largely integrated into people's everyday lives. Despite their widespread adoption, users voice concerns regarding privacy,…

Human-Computer Interaction · Computer Science 2025-02-27 Anna Leschanowsky , Silas Rech , Birgit Popp , Tom Bäckström

Conversational agents (CAs) embodied in speakers or chatbots are becoming very popular in some countries, and despite their adult-centred design, they have become part of children's lives, generating a need for children-centric trustworthy…

Human-Computer Interaction · Computer Science 2022-09-07 Marina Escobar-Planas , Emilia Gómez , Carlos-D Martínez-Hinarejos

Mental health concerns are rising globally, prompting increased reliance on technology to address the demand-supply gap in mental health services. In particular, mental health chatbots are emerging as a promising solution, but these remain…

Human-Computer Interaction · Computer Science 2026-01-23 Shreya Haran , Samiha Thatikonda , Dong Whi Yoo , Koustuv Saha

Recent studies show the effectiveness of interview chatbots for information elicitation. However, designing an effective interview chatbot is non-trivial. Few tools exist to help designers design, evaluate, and improve an interview chatbot…

Human-Computer Interaction · Computer Science 2021-04-13 Xu Han , Michelle Zhou , Matthew Turner , Tom Yeh

Designing conversational user interface experience is complicated because conversation comes with many expectations. When these expectations are met, we feel the interface is natural, but once violated, we feel something is amiss. The last…

Human-Computer Interaction · Computer Science 2018-02-27 Ahmed Fadhil

As chatbots are becoming increasingly popular, we often wonder what users perceive as natural and socially accepted manners of interacting with them. Some researchers maintain that humans should avoid engaging in emotional conversations…

Human-Computer Interaction · Computer Science 2020-09-18 Ekaterina Svikhnushina , Pearl Pu

In 2025, Large Language Model (LLM) services have launched a new feature -- AI video chat -- allowing users to interact with AI agents via real-time video communication (RTC), just like chatting with real people. Despite its significance,…

Networking and Internet Architecture · Computer Science 2025-10-02 Jiayang Xu , Xiangjie Huang , Zijie Li , Zili Meng

Despite growing recognition that responsible AI requires domain knowledge, current work on conversational AI primarily draws on clinical expertise that prioritises diagnosis and intervention. However, much of everyday emotional support…

Human-Computer Interaction · Computer Science 2026-04-15 Joel Wester , Samuel Rhys Cox , Henning Pohl , Niels van Berkel

The integration of generative Artificial Intelligence (AI) chatbots in higher education institutions (HEIs) is reshaping the educational landscape, offering opportunities for enhanced student support, and administrative and research…

Computers and Society · Computer Science 2024-03-21 Joshua Ebere Chukwuere

Conversational search systems, such as Google Assistant and Microsoft Cortana, enable users to interact with search systems in multiple rounds through natural language dialogues. Evaluating such systems is very challenging given that any…

Information Retrieval · Computer Science 2021-04-29 Zeyang Liu , Ke Zhou , Max L. Wilson

Generative AI (GenAI) chatbots are becoming increasingly integrated into virtual assistant technologies, yet their success hinges on the ability to gather meaningful user feedback to improve interaction quality, system outcomes, and overall…

Human-Computer Interaction · Computer Science 2025-04-22 Janet Rafner , Ryan Q. Guloy , Eden W. Wen , Catherine M. Chiodo , Jacob Sherson

Mental health conversational agents have the potential to deliver valuable therapeutic impact, but low user engagement remains a critical barrier hindering their efficacy. Existing therapeutic approaches have leveraged clients' internal…

Human-Computer Interaction · Computer Science 2025-09-09 Mehrnoosh Sadat Shirvani , Jackie Liu , Thomas Chao , Suky Martinez , Laura Brandt , Ig-Jae Kim , Dongwook Yoon

Patients must possess the knowledge necessary to actively participate in their care. We present NoteAid-Chatbot, a conversational AI that promotes patient understanding via a novel 'learning as conversation' framework, built on a…

Artificial Intelligence · Computer Science 2025-10-28 Won Seok Jang , Hieu Tran , Manav Mistry , SaiKiran Gandluri , Yifan Zhang , Sharmin Sultana , Sunjae Kown , Yuan Zhang , Zonghai Yao , Hong Yu

Conversational agents are systems with a conversational interface that afford interaction in spoken language. These systems are becoming prevalent and are preferred in various contexts and for many users. Despite their increasing success,…

Human-Computer Interaction · Computer Science 2019-02-19 Soodeh Atefi , Mohammad Amin Alipour

With the rapid adoption of LLM-based chatbots, there is a pressing need to evaluate what humans and LLMs can achieve together. However, standard benchmarks, such as MMLU, measure LLM capabilities in isolation (i.e., "AI-alone"). Here, we…

Computation and Language · Computer Science 2025-08-13 Serina Chang , Ashton Anderson , Jake M. Hofman

The article proposes a system for knowledge-based conversation designed for Social Robots and other conversational agents. The proposed system relies on an Ontology for the description of all concepts that may be relevant conversation…

Robotics · Computer Science 2022-08-23 Lucrezia Grassi , Carmine Tommaso Recchiuto , Antonio Sgorbissa

Millions of users turn to consumer AI chatbots to discuss mental health and behavioral concerns. While this presents unprecedented opportunities to deliver population-level support, it also highlights an urgent need for rigorous and…

Neurons and Cognition · Quantitative Biology 2026-03-10 Veith Weilnhammer , Kevin YC Hou , Lennart Luettgau , Christopher Summerfield , Raymond Dolan , Matthew M Nour

In this work, we present a multi-tool evaluation of 106 deployed web-based chatbots, across domains like healthcare, education and customer service, comprising both standalone applications and embedded widgets using automated tools (Google…

Human-Computer Interaction · Computer Science 2025-06-06 Mukesh Rajmohan , Smit Desai , Sanchari Das