English
Related papers

Related papers: Assessing Task-based Chatbots: Snapshot and Curate…

200 papers

Dialogue safety remains a pervasive challenge in open-domain human-machine interaction. Existing approaches propose distinctive dialogue safety taxonomies and datasets for detecting explicitly harmful responses. However, these taxonomies…

Computation and Language · Computer Science 2023-08-01 Huachuan Qiu , Tong Zhao , Anqi Li , Shuai Zhang , Hongliang He , Zhenzhong Lan

With the rapid adoption of LLM-based chatbots, there is a pressing need to evaluate what humans and LLMs can achieve together. However, standard benchmarks, such as MMLU, measure LLM capabilities in isolation (i.e., "AI-alone"). Here, we…

Computation and Language · Computer Science 2025-08-13 Serina Chang , Ashton Anderson , Jake M. Hofman

Online harms are a growing problem in digital spaces, putting user safety at risk and reducing trust in social media platforms. One of the most persistent forms of harm is hate speech. To address this, we need tools that combine the speed…

Computation and Language · Computer Science 2025-09-03 Paloma Piot , Diego Sánchez , Javier Parapar

Objective: Domestic abuse cases have risen significantly over the last four years, in part due to the COVID-19 pandemic and the challenges for victims and survivors in accessing support. In this study, we investigate the role that chatbots…

Computers and Society · Computer Science 2024-02-28 Rahime Belen Saglam , Jason R. C. Nurse , Lisa Sugiura

Conversation agents, commonly referred to as chatbots, are increasingly deployed in many domains to allow people to have a natural interaction while trying to solve a specific problem. Given their widespread use, it is important to provide…

Social and Information Networks · Computer Science 2020-10-13 Biplav Srivastava , Francesca Rossi , Sheema Usmani , and Mariana Bernagozzi

Recent technological advances have made it possible to build real-time, interactive spoken dialogue systems for a wide variety of applications. However, when users do not respect the limitations of such systems, performance typically…

Computation and Language · Computer Science 2007-05-23 Diane J. Litman , Shimei Pan

This paper introduces the Ubuntu Dialogue Corpus, a dataset containing almost 1 million multi-turn dialogues, with a total of over 7 million utterances and 100 million words. This provides a unique resource for research into building…

Computation and Language · Computer Science 2016-07-26 Ryan Lowe , Nissan Pow , Iulian Serban , Joelle Pineau

In today's contemporary digital landscape, chatbots have become indispensable tools across various sectors, streamlining customer service, providing personal assistance, automating routine tasks, and offering health advice. However, their…

Cryptography and Security · Computer Science 2024-08-09 Mugheez Asif , Abdul Manan , Abdul Moiz ur Rehman , Mamoona Naveed Asghar , Muhammad Umair

Standardized surveys scale efficiently but sacrifice depth, while conversational interviews improve response quality at the cost of scalability and consistency. This study bridges the gap between these methods by introducing a framework for…

Human-Computer Interaction · Computer Science 2025-12-02 Soubhik Barari , Jarret Angbazo , Natalie Wang , Leah M. Christian , Elizabeth Dean , Zoe Slowinski , Brandon Sepulvado

Despite advancements in conversational AI, language models encounter challenges to handle diverse conversational tasks, and existing dialogue dataset collections often lack diversity and comprehensiveness. To tackle these issues, we…

Computation and Language · Computer Science 2024-02-06 Jianguo Zhang , Kun Qian , Zhiwei Liu , Shelby Heinecke , Rui Meng , Ye Liu , Zhou Yu , Huan Wang , Silvio Savarese , Caiming Xiong

Task-Oriented Dialogue (TOD) systems have become crucial components in interactive artificial intelligence applications. While recent advances have capitalized on pre-trained language models (PLMs), they exhibit limitations regarding…

Computation and Language · Computer Science 2023-12-11 Sungryull Sohn , Yiwei Lyu , Anthony Liu , Lajanugen Logeswaran , Dong-Ki Kim , Dongsub Shim , Honglak Lee

Studying how people interact with large language models (LLMs) in real-world scenarios is increasingly important due to their widespread use in various applications. In this paper, we introduce LMSYS-Chat-1M, a large-scale dataset…

We introduce the Situated Corpus Of Understanding Transactions (SCOUT), a multi-modal collection of human-robot dialogue in the task domain of collaborative exploration. The corpus was constructed from multiple Wizard-of-Oz experiments…

AI chatbots are becoming a primary interface for seeking information. As their popularity grows, chatbot providers are starting to deploy advertising and analytics. Despite this, tracking on AI chatbots has not been systematically studied.…

Cryptography and Security · Computer Science 2026-05-14 Muhammad Jazlan , Ethan Wang , Yash Vekaria , Zubair Shafiq

Chai empowers users to create and interact with customized chatbots, offering unique and engaging experiences. Despite the exciting prospects, the work recognizes the inherent challenges of a commitment to modern safety standards.…

Artificial Intelligence · Computer Science 2023-06-06 Xiaoding Lu , Aleksey Korshuk , Zongyi Liu , William Beauchamp

Automated service agents require well-structured workflows to provide consistent and accurate responses to customer queries. However, these workflows are often undocumented, and their automatic extraction from conversations remains…

Computation and Language · Computer Science 2025-02-25 Prafulla Kumar Choubey , Xiangyu Peng , Shilpa Bhagavath , Caiming Xiong , Shiva Kumar Pentyala , Chien-Sheng Wu

Recent studies show the effectiveness of interview chatbots for information elicitation. However, designing an effective interview chatbot is non-trivial. Few tools exist to help designers design, evaluate, and improve an interview chatbot…

Human-Computer Interaction · Computer Science 2021-04-13 Xu Han , Michelle Zhou , Matthew Turner , Tom Yeh

Deep learning-based vulnerability detection has shown great performance and, in some studies, outperformed static analysis tools. However, the highest-performing approaches use token-based transformer models, which are not the most…

Software Engineering · Computer Science 2023-10-03 Benjamin Steenhoek , Hongyang Gao , Wei Le

Telegram, initially a messaging app, has evolved into a platform where users can interact with various services through programmable applications, bots. Bots provide a wide range of uses, from moderating groups, helping with online…

Cryptography and Security · Computer Science 2026-04-16 Taro Tsuchiya , Haoxiang Yu , Tina Marjanov , Alice Hutchings , Nicolas Christin , Alejandro Cuevas

This paper presents a bibliometric analysis of the scientific literature related to chatbots, focusing specifically on ChatGPT. Chatbots have gained increasing attention recently, with an annual growth rate of 19.16% and 27.19% on the Web…

Digital Libraries · Computer Science 2023-04-13 Hamed Khosravi , Mohammad Reza Shafie , Morteza Hajiabadi , Ahmed Shoyeb Raihan , Imtiaz Ahmed