English
Related papers

Related papers: Assessing Task-based Chatbots: Snapshot and Curate…

200 papers

By evaluating Large Language Models (LLMs) through uniform, text-only interfaces, current academic benchmarks obscure how the unique designs and affordances of distinct commercial platforms shape real-world user behavior and system…

Computation and Language · Computer Science 2026-05-19 Yueru Yan , Tuc Nguyen , Bo Su , Melissa Lieffers , Thai Le

Existing goal-oriented dialogue datasets focus mainly on identifying slots and values. However, customer support interactions in reality often involve agents following multi-step procedures derived from explicitly-defined company policies…

Computation and Language · Computer Science 2021-04-05 Derek Chen , Howard Chen , Yi Yang , Alex Lin , Zhou Yu

This study presents a unique framework that applies and extends Solove (2006)'s taxonomy to address privacy concerns in interactions with text-based AI chatbots. As chatbot prevalence grows, concerns about user privacy have heightened.…

Human-Computer Interaction · Computer Science 2024-02-16 Ece Gumusel , Kyrie Zhixuan Zhou , Madelyn Rose Sanfilippo

Conversational systems or chatbots are an example of AI-Infused Applications (AIIA). Chatbots are especially important as they are often the first interaction of clients with a business and are the entry point of a business into the AI…

Chatbots are one class of intelligent, conversational software agents activated by natural language input (which can be in the form of text, voice, or both). They provide conversational output in response, and if commanded, can sometimes…

Computers and Society · Computer Science 2017-04-18 Nicole M. Radziwill , Morgan C. Benton

Introduction: The use of chatbots is becoming increasingly important across various aspects of daily life. However, the privacy concerns associated with these communications have not yet been thoroughly addressed. The aim of this study was…

Human-Computer Interaction · Computer Science 2025-08-12 Julia Ive , Vishal Yadav , Mariia Ignashina , Matthew Rand , Paulina Bondaronek

Many organisations pursue digital transformation to enhance operational efficiency, reduce manual efforts, and optimise processes by automation and digital tools. To achieve this, a comprehensive understanding of their unique needs is…

Human-Computer Interaction · Computer Science 2025-11-06 Jiawei Zheng , Gokcen Yilmaz , Ji Han , Saeema Ahmed-Kristensen

We present TruthBot, an all-in-one multilingual conversational chatbot designed for seeking truth (trustworthy and verified information) on specific topics. It helps users to obtain information specific to certain topics, fact-check…

Social and Information Networks · Computer Science 2021-02-02 Ankur Gupta , Yash Varun , Prarthana Das , Nithya Muttineni , Parth Srivastava , Hamim Zafar , Tanmoy Chakraborty , Swaprava Nath

Software development relies heavily on text-based communication, making sentiment analysis a valuable tool for understanding team dynamics and supporting trustworthy AI-driven analytics in requirements engineering. However, existing…

Software Engineering · Computer Science 2025-07-11 Martin Obaidi , Marc Herrmann , Jil Klünder , Kurt Schneider

In the past decade, the financial industry has experienced a technology revolution. While we witness a rapid introduction of conversational bots for financial services, there is a lack of understanding of conversational user interfaces…

Although human evaluation remains the gold standard for open-domain dialogue evaluation, the growing popularity of automated evaluation using Large Language Models (LLMs) has also extended to dialogue. However, most frameworks leverage…

Computation and Language · Computer Science 2024-10-07 John Mendonça , Isabel Trancoso , Alon Lavie

Web-based chatbots provide website owners with the benefits of increased sales, immediate response to their customers, and insight into customer behaviour. While Web-based chatbots are getting popular, they have not received much scrutiny…

Cryptography and Security · Computer Science 2022-05-18 Nazar Waheed , Muhammad Ikram , Saad Sajid Hashmi , Xiangjian He , Priyadarsi Nanda

As Conversational Artificial Intelligence (AI) becomes more integrated into everyday life, AI-powered chatbot mobile applications are increasingly adopted across industries, particularly in the healthcare domain. These chatbots offer…

Human-Computer Interaction · Computer Science 2025-09-19 Ramazan Yener , Guan-Hung Chen , Ece Gumusel , Masooda Bashir

The emergence of instruction-tuned large language models (LLMs) has advanced the field of dialogue systems, enabling both realistic user simulations and robust multi-turn conversational agents. However, existing research often evaluates…

Computation and Language · Computer Science 2025-07-22 Chalamalasetti Kranti , Sherzod Hakimov , David Schlangen

The research community has traditionally shown a keen interest in emotion modeling, with a notable emphasis on the detection aspect. In contrast, the exploration of emotion generation has received less attention.This study delves into an…

Human-Computer Interaction · Computer Science 2024-11-06 Taseen Mubassira , Mehedi Hasan , A. B. M. Alim Al Iislam

The lack of time-efficient and reliable evaluation methods hamper the development of conversational dialogue systems (chatbots). Evaluations requiring humans to converse with chatbots are time and cost-intensive, put high cognitive demands…

Artificial Intelligence · Computer Science 2020-10-06 Jan Deriu , Don Tuggener , Pius von Däniken , Jon Ander Campos , Alvaro Rodrigo , Thiziri Belkacem , Aitor Soroa , Eneko Agirre , Mark Cieliebak

Human evaluation is becoming a necessity to test the performance of Chatbots. However, off-the-shelf settings suffer the severe reliability and replication issues partly because of the extremely high diversity of criteria. It is high time…

Computation and Language · Computer Science 2021-05-25 Hongru Liang , Huaqing Li

Robust task-oriented spoken dialogue agents require exposure to the full diversity of how people interact through speech. Building spoken user simulators that address this requires large-scale spoken task-oriented dialogue (TOD) data…

Computation and Language · Computer Science 2026-03-18 Jonggeun Lee , Junseong Pyo , Jeongmin Park , Yohan Jo

Bots are frequently used in Github repositories to automate repetitive activities that are part of the distributed software development process. They communicate with human actors through comments. While detecting their presence is…

Software Engineering · Computer Science 2021-01-29 Mehdi Golzadeh , Alexandre Decan , Damien Legay , Tom Mens

Software development is a cognitively intensive process requiring multitasking, adherence to evolving workflows, and continuous learning. With the rise of large language model (LLM)-based tools, such as conversational agents (CAs), there is…

Software Engineering · Computer Science 2025-05-14 Glaucia Melo , Paulo Alencar , Donald Cowan