English
Related papers

Related papers: MutaBot: A Mutation Testing Approach for Chatbots

200 papers

Testing is an important aspect in professional software development, both to avoid and identify bugs as well as to increase maintainability. However, increasing the number of tests beyond a reasonable amount hinders development progress. To…

Programming Languages · Computer Science 2022-05-23 Alexandros Efremidis , Joshua Schmidt , Sebastian Krings , Philipp Körner

Is chatbot able to completely replace the human agent? The short answer could be - "it depends...". For some challenging cases, e.g., dialogue's topical spectrum spreads beyond the training corpus coverage, the chatbot may malfunction and…

Computation and Language · Computer Science 2020-12-15 Jiawei Liu , Zhe Gao , Yangyang Kang , Zhuoren Jiang , Guoxiu He , Changlong Sun , Xiaozhong Liu , Wei Lu

Innovation is a key component in trying new solutions for the students to learn efficiently and in ways that correspond to their own experience, where chatbots are one of these new solutions. One of the main problem that chatbots face today…

Computation and Language · Computer Science 2022-07-01 Dimitrios Chaskopoulos , Jonas Eilertsen Hægdahl , Petter Sagvold , Claire Trinquet , Maryam Edalati

The growing demand for software developers and the increasing development complexity have emphasized the need for support in software engineering projects. This is especially relevant in light of advancements in artificial intelligence,…

Software Engineering · Computer Science 2023-05-02 Glaucia Melo

The ubiquitous nature of chatbots and their interaction with users generate an enormous amount of data. Can we improve chatbots using this data? A self-feeding chatbot improves itself by asking natural language feedback when a user is…

Computation and Language · Computer Science 2020-10-16 Makesh Narsimhan Sreedhar , Kun Ni , Siva Reddy

Open-domain dialog systems (also known as chatbots) have increasingly drawn attention in natural language processing. Some of the recent work aims at incorporating affect information into sequence-to-sequence neural dialog modeling, making…

Computation and Language · Computer Science 2020-06-25 Yubo Xie , Ekaterina Svikhnushina , Pearl Pu

Effective task management is essential to successful team collaboration. While the past decade has seen considerable innovation in systems that track and manage group tasks, these innovations have typically been outside of the principal…

Human-Computer Interaction · Computer Science 2018-02-12 Carlos Toxtli , Andrés Monroy-Hernández , Justin Cranshaw

Providing the best customer experience is one of the primary concerns for the firms that are based online. The advancement of machine learning is revolutionising the company's attitude towards the client through improving the service…

Computation and Language · Computer Science 2022-07-22 Rejwan Bin Sulaiman

The integration of Large Language Models (LLMs) into healthcare settings has gained significant attention, particularly for question-answering tasks. Given the high-stakes nature of healthcare, it is essential to ensure that LLM-generated…

Human evaluation is becoming a necessity to test the performance of Chatbots. However, off-the-shelf settings suffer the severe reliability and replication issues partly because of the extremely high diversity of criteria. It is high time…

Computation and Language · Computer Science 2021-05-25 Hongru Liang , Huaqing Li

Chatbots are often designed to mimic social roles attributed to humans. However, little is known about the impact on user's perceptions of using language that fails to conform to the associated social role. Our research draws on…

Human-Computer Interaction · Computer Science 2024-01-24 Ana Paula Chaves , Jesse Egbert , Toby Hocking , Eck Doerry , Marco Aurelio Gerosa

We introduce $\mu$BERT, a mutation testing tool that uses a pre-trained language model (CodeBERT) to generate mutants. This is done by masking a token from the expression given as input and using CodeBERT to predict it. Thus, the mutants…

Software Engineering · Computer Science 2022-03-08 Renzo Degiovanni , Mike Papadakis

Apart from the coherence and fluency of responses, an empathetic chatbot emphasizes more on people's feelings. By considering altruistic behaviors between human interaction, empathetic chatbots enable people to get a better interactive and…

Computation and Language · Computer Science 2021-10-11 Jiun-Hao Jhan , Chao-Peng Liu , Shyh-Kang Jeng , Hung-Yi Lee

The manual modeling of complex systems is a daunting task; and although a plethora of methods exist that mitigate this issue, the problem remains very difficult. Recent advances in generative AI have allowed the creation of general-purpose…

Software Engineering · Computer Science 2024-01-05 David Harel , Guy Katz , Assaf Marron , Smadar Szekely

As emotional support chatbots have recently gained significant traction across both research and industry, a common evaluation strategy has emerged: use help-seeker simulators to interact with supporter chatbots. However, current simulators…

Computation and Language · Computer Science 2026-04-28 Chaewon Heo , Cheyon Jin , Yohan Jo

AI chatbots are an emerging security attack vector, vulnerable to threats such as prompt injection, and rogue chatbot creation. When deployed in domains such as corporate security policy, they could be weaponized to deliver guidance that…

Human-Computer Interaction · Computer Science 2025-10-13 Brandon Lit , Edward Crowder , Daniel Vogel , Hassan Khan

In recent times, discussions on social media platforms have increasingly come under scrutiny due to the proliferation of science denial and fake news. Traditional solutions, such as regulatory actions, have been implemented to mitigate the…

Computers and Society · Computer Science 2025-11-25 Ingo Siegert , Jan Nehring , Aranxa Márquez Ampudia , Matthias Busch , Stefan Hillmann

Conversational agents, also known as chatbots, are versatile tools that have the potential of being used in dialogical argumentation. They could possibly be deployed in tasks such as persuasion for behaviour change (e.g. persuading people…

Artificial Intelligence · Computer Science 2019-05-03 Lisa A. Chalaguine , Anthony Hunter , Fiona L. Hamilton , Henry W. W. Potts

As we build towards developing interactive systems that can recognize human emotional states and respond to individual needs more intuitively and empathetically in more personalized and context-aware computing time. This is especially…

Human-Computer Interaction · Computer Science 2024-06-25 Rahul Islam , Sang Won Bae

Mutation testing is used extensively to support the experimentation of software engineering studies. Its application to real-world projects is possible thanks to modern tools that automate the whole mutation analysis process. However,…

Software Engineering · Computer Science 2016-01-12 Thomas Laurent , Anthony Ventresque , Mike Papadakis , Christopher Henard , Yves Le Traon