English
Related papers

Related papers: Perspectives for Evaluating Conversational AI

200 papers

Conversational interfaces are likely to become more efficient, intuitive and engaging way for human-computer interaction than today's text or touch-based interfaces. Current research efforts concerning conversational interfaces focus…

Human-Computer Interaction · Computer Science 2017-09-18 Svitlana Vakulenko , Ilya Markov , Maarten de Rijke

My research centers on the development of context-adaptive AI systems to improve end-user adoption through the integration of technical methods. I deploy these AI systems across various interaction modalities, including user interfaces and…

Human-Computer Interaction · Computer Science 2024-01-25 Christine P Lee

This paper discusses the potential for creating academic resources (tools, data, and evaluation approaches) to support research in conversational search, by focusing on realistic information needs and conversational interactions.…

As robots and digital assistants are deployed in the real world, these agents must be able to communicate their decision-making criteria to build trust, improve human-robot teaming, and enable collaboration. While the field of explainable…

Human-Computer Interaction · Computer Science 2025-04-22 Andrew Silva , Pradyumna Tambwekar , Mariah Schrum , Matthew Gombolay

Building dialogue systems that naturally converse with humans is being an attractive and an active research domain. Multiple systems are being designed everyday and several datasets are being available. For this reason, it is being hard to…

Computation and Language · Computer Science 2019-07-31 Basma El Amel Boussaha , Nicolas Hernandez , Christine Jacquin , Emmanuel Morin

While XAI focuses on providing AI explanations to humans, can the reverse - humans explaining their judgments to AI - foster richer, synergistic human-AI systems? This paper explores various forms of human inputs to AI and examines how…

Computers and Society · Computer Science 2025-03-07 Alan Dix , Tommaso Turchi , Ben Wilson , Anna Monreale , Matt Roach

The growing popularity of AI writing assistants creates exciting opportunities to support diverse writers. This study examines how personality shapes expectations for AI writing companions and how personality-informed design can enhance…

Human-Computer Interaction · Computer Science 2026-05-05 Mengke Wu , Kexin Quan , Weizi Liu , Mike Yao , Jessie Chin

Artificial Intelligence is being employed by humans to collaboratively solve complicated tasks for search and rescue, manufacturing, etc. Efficient teamwork can be achieved by understanding user preferences and recommending different…

Information Retrieval · Computer Science 2023-01-20 Lakshita Dodeja , Pradyumna Tambwekar , Erin Hedlund-Botti , Matthew Gombolay

Conversational agents are exploding in popularity. However, much work remains in the area of social conversation as well as free-form conversation over a broad range of domains and topics. To advance the state of the art in conversational…

This paper explores the efficacy of online versus offline evaluation methods in assessing conversational chatbots, specifically comparing first-party direct interactions with third-party observational assessments. By extending a…

Human-Computer Interaction · Computer Science 2024-09-13 Ekaterina Svikhnushina , Pearl Pu

In the rapidly evolving field of artificial intelligence (AI) agents, designing the agent's characteristics is crucial for shaping user experience. This workshop aims to establish a research community focused on AI agent persona design for…

Human-Computer Interaction · Computer Science 2024-10-31 Nima Zargham , Mateusz Dubiel , Smit Desai , Thomas Mildner , Hanz-Joachim Belz

How can we design AI tools that effectively support human decision-making by complementing and enhancing users' reasoning processes? Common recommendation-centric approaches face challenges such as inappropriate reliance or a lack of…

Human-Computer Interaction · Computer Science 2025-04-10 Leon Reicherts , Zelun Tony Zhang , Elisabeth von Oswald , Yuanting Liu , Yvonne Rogers , Mariam Hassib

As AI becomes more common in everyday living, there is an increasing demand for intelligent systems that are both performant and understandable. Explainable AI (XAI) systems aim to provide comprehensible explanations of decisions and…

Artificial Intelligence · Computer Science 2025-10-15 Aline Mangold , Juliane Zietz , Susanne Weinhold , Sebastian Pannasch

Conversational AI agents are proliferating, embodying a range of devices such as smart speakers, smart displays, robots, cars, and more. We can envision a future where a personal conversational agent could migrate across different form…

Computers and Society · Computer Science 2021-09-07 Ravi Tejwani , Felipe Moreno , Sooyeon Jeong , Hae Won Park , Cynthia Breazeal

More recently, Explainable Artificial Intelligence (XAI) research has shifted to focus on a more pragmatic or naturalistic account of understanding, that is, whether the stakeholders understand the explanation. This point is especially…

Human-Computer Interaction · Computer Science 2021-08-05 Janet Hui-wen Hsiao , Hilary Hei Ting Ngai , Luyu Qiu , Yi Yang , Caleb Chen Cao

We present a review of personality in neural conversational agents (CAs), also called chatbots. First, we define Personality, Persona, and Profile. We explain all personality schemes which have been used in CAs, and list models under the…

Computation and Language · Computer Science 2024-01-02 Richard Sutcliffe

Conversational systems use spoken language to interact with their users. Although conversational systems, such as Amazon Alexa, are becoming common and afford interesting functionalities, there is little known about the issues users of…

Software Engineering · Computer Science 2020-03-03 Soodeh Atefi , Andrew Truelove , Matheus Rheinschmitt , Eduardo Almeida , Iftekhar Ahmed , Amin Alipour

Research and development on conversational recommender systems (CRSs) critically depends on sound and reliable evaluation methodologies. However, the interactive nature of these systems poses significant challenges for automatic evaluation.…

Information Retrieval · Computer Science 2025-10-08 Nolwenn Bernard , Krisztian Balog

We often rely on our intuition to anticipate the direction of a conversation. Endowing automated systems with similar foresight can enable them to assist human-human interactions. Recent work on developing models with this predictive…

Computation and Language · Computer Science 2025-07-28 Son Quoc Tran , Tushaar Gangavarapu , Nicholas Chernogor , Jonathan P. Chang , Cristian Danescu-Niculescu-Mizil

Privacy policies play a vital role in safeguarding user privacy as legal jurisdictions worldwide emphasize the need for transparent data processing. While the suitability of privacy policies to enhance transparency has been critically…

Computation and Language · Computer Science 2023-11-21 Zahra Kolagar , Anna Katharina Leschanowsky , Birgit Popp
‹ Prev 1 8 9 10 Next ›