中文
相关论文

相关论文: Comprehensive Framework for Evaluating Conversatio…

200 篇论文

Chatbots have been studied for more than half a century. With the rapid development of natural language processing (NLP) technologies in recent years, chatbots using large language models (LLMs) have received much attention nowadays.…

计算与语言 · 计算机科学 2023-12-12 Jintang Xue , Yun-Cheng Wang , Chengwei Wei , Xiaofeng Liu , Jonghye Woo , C. -C. Jay Kuo

Background: Empathy is widely recognized for improving patient outcomes, including reduced pain and anxiety and improved satisfaction, and its absence can cause harm. Meanwhile, use of artificial intelligence (AI)-based chatbots in…

人机交互 · 计算机科学 2026-02-06 Alastair Howcroft , Amber Bennett-Weston , Ahmad Khan , Joseff Griffiths , Simon Gay , Jeremy Howick

Conversational AI (CAI) systems which encompass voice- and text-based assistants are on the rise and have been largely integrated into people's everyday lives. Despite their widespread adoption, users voice concerns regarding privacy,…

人机交互 · 计算机科学 2025-02-27 Anna Leschanowsky , Silas Rech , Birgit Popp , Tom Bäckström

Conversational agents (CAs) embodied in speakers or chatbots are becoming very popular in some countries, and despite their adult-centred design, they have become part of children's lives, generating a need for children-centric trustworthy…

人机交互 · 计算机科学 2022-09-07 Marina Escobar-Planas , Emilia Gómez , Carlos-D Martínez-Hinarejos

Mental health concerns are rising globally, prompting increased reliance on technology to address the demand-supply gap in mental health services. In particular, mental health chatbots are emerging as a promising solution, but these remain…

人机交互 · 计算机科学 2026-01-23 Shreya Haran , Samiha Thatikonda , Dong Whi Yoo , Koustuv Saha

Recent studies show the effectiveness of interview chatbots for information elicitation. However, designing an effective interview chatbot is non-trivial. Few tools exist to help designers design, evaluate, and improve an interview chatbot…

人机交互 · 计算机科学 2021-04-13 Xu Han , Michelle Zhou , Matthew Turner , Tom Yeh

Designing conversational user interface experience is complicated because conversation comes with many expectations. When these expectations are met, we feel the interface is natural, but once violated, we feel something is amiss. The last…

人机交互 · 计算机科学 2018-02-27 Ahmed Fadhil

As chatbots are becoming increasingly popular, we often wonder what users perceive as natural and socially accepted manners of interacting with them. Some researchers maintain that humans should avoid engaging in emotional conversations…

人机交互 · 计算机科学 2020-09-18 Ekaterina Svikhnushina , Pearl Pu

In 2025, Large Language Model (LLM) services have launched a new feature -- AI video chat -- allowing users to interact with AI agents via real-time video communication (RTC), just like chatting with real people. Despite its significance,…

网络与互联网体系结构 · 计算机科学 2025-10-02 Jiayang Xu , Xiangjie Huang , Zijie Li , Zili Meng

Despite growing recognition that responsible AI requires domain knowledge, current work on conversational AI primarily draws on clinical expertise that prioritises diagnosis and intervention. However, much of everyday emotional support…

人机交互 · 计算机科学 2026-04-15 Joel Wester , Samuel Rhys Cox , Henning Pohl , Niels van Berkel

The integration of generative Artificial Intelligence (AI) chatbots in higher education institutions (HEIs) is reshaping the educational landscape, offering opportunities for enhanced student support, and administrative and research…

计算机与社会 · 计算机科学 2024-03-21 Joshua Ebere Chukwuere

Conversational search systems, such as Google Assistant and Microsoft Cortana, enable users to interact with search systems in multiple rounds through natural language dialogues. Evaluating such systems is very challenging given that any…

信息检索 · 计算机科学 2021-04-29 Zeyang Liu , Ke Zhou , Max L. Wilson

Generative AI (GenAI) chatbots are becoming increasingly integrated into virtual assistant technologies, yet their success hinges on the ability to gather meaningful user feedback to improve interaction quality, system outcomes, and overall…

人机交互 · 计算机科学 2025-04-22 Janet Rafner , Ryan Q. Guloy , Eden W. Wen , Catherine M. Chiodo , Jacob Sherson

Mental health conversational agents have the potential to deliver valuable therapeutic impact, but low user engagement remains a critical barrier hindering their efficacy. Existing therapeutic approaches have leveraged clients' internal…

人机交互 · 计算机科学 2025-09-09 Mehrnoosh Sadat Shirvani , Jackie Liu , Thomas Chao , Suky Martinez , Laura Brandt , Ig-Jae Kim , Dongwook Yoon

Patients must possess the knowledge necessary to actively participate in their care. We present NoteAid-Chatbot, a conversational AI that promotes patient understanding via a novel 'learning as conversation' framework, built on a…

Conversational agents are systems with a conversational interface that afford interaction in spoken language. These systems are becoming prevalent and are preferred in various contexts and for many users. Despite their increasing success,…

人机交互 · 计算机科学 2019-02-19 Soodeh Atefi , Mohammad Amin Alipour

With the rapid adoption of LLM-based chatbots, there is a pressing need to evaluate what humans and LLMs can achieve together. However, standard benchmarks, such as MMLU, measure LLM capabilities in isolation (i.e., "AI-alone"). Here, we…

计算与语言 · 计算机科学 2025-08-13 Serina Chang , Ashton Anderson , Jake M. Hofman

The article proposes a system for knowledge-based conversation designed for Social Robots and other conversational agents. The proposed system relies on an Ontology for the description of all concepts that may be relevant conversation…

机器人学 · 计算机科学 2022-08-23 Lucrezia Grassi , Carmine Tommaso Recchiuto , Antonio Sgorbissa

Millions of users turn to consumer AI chatbots to discuss mental health and behavioral concerns. While this presents unprecedented opportunities to deliver population-level support, it also highlights an urgent need for rigorous and…

神经元与认知 · 定量生物学 2026-03-10 Veith Weilnhammer , Kevin YC Hou , Lennart Luettgau , Christopher Summerfield , Raymond Dolan , Matthew M Nour

In this work, we present a multi-tool evaluation of 106 deployed web-based chatbots, across domains like healthcare, education and customer service, comprising both standalone applications and embedded widgets using automated tools (Google…

人机交互 · 计算机科学 2025-06-06 Mukesh Rajmohan , Smit Desai , Sanchari Das