Expanding the Set of Pragmatic Considerations in Conversational AI
Abstract
Despite considerable performance improvements, current conversational AI systems often fail to meet user expectations. We discuss several pragmatic limitations of current conversational AI systems. We illustrate pragmatic limitations with examples that are syntactically appropriate, but have clear pragmatic deficiencies. We label our complaints as "Turing Test Triggers" (TTTs) as they indicate where current conversational AI systems fall short compared to human behavior. We develop a taxonomy of pragmatic considerations intended to identify what pragmatic competencies a conversational AI system requires and discuss implications for the design and evaluation of conversational AI systems.
Keywords
Cite
@article{arxiv.2310.18435,
title = {Expanding the Set of Pragmatic Considerations in Conversational AI},
author = {S. M. Seals and Valerie L. Shalin},
journal= {arXiv preprint arXiv:2310.18435},
year = {2023}
}
Comments
Pre-print version of paper that appeared at Multidisciplinary Perspectives on COntext-aware embodied Spoken Interactions (MP-COSIN) workshop at IEEE RO-MAN 2023