English
Related papers

Related papers: Comprehensive Framework for Evaluating Conversatio…

200 papers

Interview chatbots engage users in a text-based conversation to draw out their views and opinions. It is, however, challenging to build effective interview chatbots that can handle user free-text responses to open-ended questions and…

Human-Computer Interaction · Computer Science 2020-02-06 Ziang Xiao , Michelle X. Zhou , Wenxi Chen , Huahai Yang , Changyan Chi

The development and deployment of chatbot technology, while spanning decades and employing different techniques, require innovative frameworks to understand and interrogate their functionality and implications. A mere technocentric account…

Computers and Society · Computer Science 2025-01-22 Mauricio Figueroa-Torres

Chatbots, the common moniker for collaborative assistants, are Artificial Intelligence (AI) software that enables people to naturally interact with them to get tasks done. Although chatbots have been studied since the dawn of AI, they have…

Human-Computer Interaction · Computer Science 2023-09-15 Biplav Srivastava , Kausik Lakkaraju , Tarmo Koppel , Vignesh Narayanan , Ashish Kundu , Sachindra Joshi

In recent times, a large number of people have been involved in establishing their own businesses. Unlike humans, chatbots can serve multiple customers at a time, are available 24/7 and reply in less than a fraction of a second. Though…

Conversational AI is increasingly deployed in emotionally charged and ethically sensitive interactions. Previous research has primarily concentrated on emotional benchmarks or static safety checks, overlooking how alignment unfolds in…

Computation and Language · Computer Science 2026-04-06 Jiawen Deng , Wentao Zhang , Ziyun Jiao , Fuji Ren

As AI chatbots increasingly incorporate empathy, understanding user-centered perceptions of chatbot empathy and its impact on conversation quality remains essential yet under-explored. This study examines how chatbot identity and perceived…

Human-Computer Interaction · Computer Science 2025-03-10 Tingting Liu , Salvatore Giorgi , Ankit Aich , Allison Lahnala , Brenda Curtis , Lyle Ungar , João Sedoc

Human evaluation is becoming a necessity to test the performance of Chatbots. However, off-the-shelf settings suffer the severe reliability and replication issues partly because of the extremely high diversity of criteria. It is high time…

Computation and Language · Computer Science 2021-05-25 Hongru Liang , Huaqing Li

In the rapidly evolving domain of artificial intelligence, chatbots have emerged as a potent tool for various applications ranging from e-commerce to healthcare. This research delves into the intricacies of chatbot technology, from its…

Human-Computer Interaction · Computer Science 2023-11-17 Feriel Khennouche , Youssef Elmir , Nabil Djebari , Yassine Himeur , Abbes Amira

Conversational chatbots are Artificial Intelligence (AI)-powered applications that assist users with various tasks by responding in natural language and are prevalent across different industries. Most of the chatbots that we encounter on…

Human-Computer Interaction · Computer Science 2020-12-17 Sarada Devaram

This study presents a unique framework that applies and extends Solove (2006)'s taxonomy to address privacy concerns in interactions with text-based AI chatbots. As chatbot prevalence grows, concerns about user privacy have heightened.…

Human-Computer Interaction · Computer Science 2024-02-16 Ece Gumusel , Kyrie Zhixuan Zhou , Madelyn Rose Sanfilippo

LLM based chatbots have become central interfaces in technical, educational, and analytical domains, supporting tasks such as code reasoning, problem solving, and information exploration. As these systems scale, sustainability concerns have…

Software Engineering · Computer Science 2025-12-17 Ronnie de Souza Santos , Cleyton Magalhães , Italo Santos

Chatbots are emerging as a promising platform for accessing and delivering healthcare services. The evidence is in the growing number of publicly available chatbots aiming at taking an active role in the provision of prevention, diagnosis,…

Human-Computer Interaction · Computer Science 2020-11-13 Mlađan Jovanović , Marcos Baez , Fabio Casati

User-configured chatbots built on top of large language models are increasingly available through centralized marketplaces such as OpenAI's GPT Store. While these platforms enforce usage policies intended to prevent harmful or inappropriate…

Computation and Language · Computer Science 2025-12-22 David Rodriguez , William Seymour , Jose M. Del Alamo , Jose Such

As AI systems advance and integrate into society, well-designed and transparent evaluations are becoming essential tools in AI governance, informing decisions by providing evidence about system capabilities and risks. Yet there remains a…

Conversational agents, such as chatbots and virtual assistants, have become essential in software development, boosting productivity, collaboration, and automating various tasks. This paper examines the role of adaptive AI-powered…

Software Engineering · Computer Science 2025-07-16 Omar Elsisi , Glaucia Melo

Generative Artificial Intelligence is set to revolutionize healthcare delivery by transforming traditional patient care into a more personalized, efficient, and proactive process. Chatbots, serving as interactive conversational models, will…

Dialog evaluation is a challenging problem, especially for non task-oriented dialogs where conversational success is not well-defined. We propose to evaluate dialog quality using topic-based metrics that describe the ability of a…

Computation and Language · Computer Science 2018-01-12 Fenfei Guo , Angeliki Metallinou , Chandra Khatri , Anirudh Raju , Anu Venkatesh , Ashwin Ram

The rise of LLMs has deflected a growing portion of human-computer interactions towards LLM-based chatbots. The remarkable abilities of these models allow users to interact using long, diverse natural language text covering a wide range of…

Computation and Language · Computer Science 2025-03-06 Shani Goren , Oren Kalinsky , Tomer Stav , Yuri Rapoport , Yaron Fairstein , Ram Yazdi , Nachshon Cohen , Alexander Libov , Guy Kushilevitz

Conversational agents are increasingly used as support tools along mental therapeutic pathways with significant societal impacts. In particular, empathy is a key non-functional requirement in therapeutic contexts, yet current chatbot…

Computation and Language · Computer Science 2026-01-14 Francesco Dettori , Matteo Forasassi , Lorenzo Veronese , Livia Lestingi , Vincenzo Scotti , Matteo Giovanni Rossi

The conversational nature of chatbots poses challenges to designers since their development is different from other software and requires investigating new practices in the context of human-AI interaction and their impact on user…

Human-Computer Interaction · Computer Science 2023-01-18 Geovana Ramos Sousa Silva , Edna Dias Canedo