English
Related papers

Related papers: Multi-Level Testing of Conversational AI Systems

200 papers

Conversational search enables multi-turn interactions between users and systems to fulfill users' complex information needs. During this interaction, the system should understand the users' search intent within the conversational context…

Information Retrieval · Computer Science 2025-06-13 Fengran Mo , Chuan Meng , Mohammad Aliannejadi , Jian-Yun Nie

As Large Language Models (LLMs) have become integral to both research and daily operations, rigorous evaluation is crucial. This assessment is important not only for individual tasks but also for understanding their societal impact and…

Software Engineering · Computer Science 2024-04-02 Zeeshan Rasheed , Muhammad Waseem , Kari Systä , Pekka Abrahamsson

Large Language Models based on transformer algorithms have revolutionized Artificial Intelligence by enabling verbal interaction with machines akin to human conversation. These AI agents have surpassed the Turing Test, achieving confusion…

This paper outlines the challenges and opportunities of research on conversational agents with children and young people across four countries, exploring the ways AI technologies can support children's well-being across social and cultural…

Human-Computer Interaction · Computer Science 2025-08-21 Natalia Kucirkova , Alexis Hiniker , Megumi Ishikawa , Sho Tsuji , Aayushi Dangol , Robert Wolfe

Concerns that interacting with generative AI homogenizes human cognition are largely based on evidence from text-based interactions, potentially conflating the effects of AI systems with those of written communication. This study examines…

Human-Computer Interaction · Computer Science 2026-03-31 Neelam Modi Jain , Dan J. Wang

Generative AI systems have rapidly advanced, with multimodal input capabilities enabling reasoning beyond text-based tasks. In education, these advancements could influence assessment design and question answering, presenting both…

Computers and Society · Computer Science 2025-07-08 Aymeric de Chillaz , Anna Sotnikova , Patrick Jermann , Antoine Bosselut

Inspired by recent and revolutionary developments in AI, particularly in language understanding and generation, we set about designing AI systems that are able to address complex scientific tasks that challenge human capabilities to make…

Computation and Language · Computer Science 2022-11-01 José Manuel Gómez-Pérez

Data-driven approaches are becoming more common as problem-solving techniques in many areas of research and industry. In most cases, machine learning models are the key component of these solutions, but a solution involves multiple such…

Artificial Intelligence · Computer Science 2019-06-20 Parisa Kordjamshidi , Dan Roth , Kristian Kersting

Due to the migration megatrend, efficient and effective second-language acquisition is vital. One proposed solution involves AI-enabled conversational agents for person-centered interactive language practice. We present results from ongoing…

Software Engineering · Computer Science 2022-03-30 Markus Borg , Johan Bengtsson , Harald Österling , Alexander Hagelborn , Isabella Gagner , Piotr Tomaszewski

Building embodied autonomous agents capable of participating in social interactions with humans is one of the main challenges in AI. This problem motivated many research directions on embodied language use. Current approaches focus on…

Machine Learning · Computer Science 2021-04-28 Grgur Kovač , Rémy Portelas , Katja Hofmann , Pierre-Yves Oudeyer

Political biases in Large Language Model (LLM)-based artificial intelligence (AI) systems, such as OpenAI's ChatGPT or Google's Gemini, have been previously reported. While several prior studies have attempted to quantify these biases using…

Computers and Society · Computer Science 2025-03-17 David Rozado

This article presents a modular, component-based architecture for developing and evaluating AI agents that bridge the gap between natural language interfaces and complex enterprise data warehouses. The system directly addresses core…

Artificial Intelligence · Computer Science 2025-09-30 Nooshin Bahador

Recent advancements in Large Language Models (LLMs) offer new opportunities to create natural language interfaces for Autonomous Driving Systems (ADSs), moving beyond rigid inputs. This paper addresses the challenge of mapping the…

Robotics · Computer Science 2026-01-26 Marvin Seegert , Korbinian Moller , Johannes Betz

Explainable artificial intelligence (XAI) methods are being proposed to help interpret and understand how AI systems reach specific predictions. Inspired by prior work on conversational user interfaces, we argue that augmenting existing XAI…

Human-Computer Interaction · Computer Science 2025-01-30 Gaole He , Nilay Aishwarya , Ujwal Gadiraju

The article further develops and formalizes a theory of friendly dialogue in an AI System of Dr. Watson type, as proposed in our previous publication[4],[19]. The main principle of this type of AI is to guide the user toward a solution in a…

Artificial Intelligence · Computer Science 2024-07-31 Saveli Goldberg , Vladimir Sluchak

We explore the potential for productive team-based collaboration between humans and Artificial Intelligence (AI) by presenting and conducting initial tests with a general framework that enables multiple human and AI agents to work together…

Human-Computer Interaction · Computer Science 2024-12-04 Benjamin Klieger , Charis Charitsis , Miroslav Suzara , Sierra Wang , Nick Haber , John C. Mitchell

AI systems, in particular with deep learning techniques, have demonstrated superior performance for various real-world applications. Given the need for tailored optimization in specific scenarios, as well as the concerns related to the…

Artificial Intelligence · Computer Science 2024-11-12 Zhiyu Zhu , Zhibo Jin , Hongsheng Hu , Minhui Xue , Ruoxi Sun , Seyit Camtepe , Praveen Gauravaram , Huaming Chen

This paper introduces a methodological framework for empirically testing AI alignment strategies through structured multi-model dialogue. Drawing on Peace Studies traditions - particularly interest-based negotiation, conflict…

Artificial Intelligence · Computer Science 2026-01-29 Gray Cox

Conversational agents have been gaining increasing popularity in recent years. Influenced by the widespread adoption of task-oriented agents such as Apple Siri and Amazon Alexa, these agents are being deployed into various applications to…

Human-Computer Interaction · Computer Science 2024-01-17 Christopher Clarke , Karthik Krishnamurthy , Walter Talamonti , Yiping Kang , Lingjia Tang , Jason Mars

The focus of AI development has shifted from academic research to practical applications. However, AI development faces numerous challenges at various levels. This article will attempt to analyze the opportunities and challenges of AI from…

Artificial Intelligence · Computer Science 2026-01-06 Bor-Sung Liang