People with disabilities that affect their speech may use speech-generating devices (SGD), commonly referred to as Augmentative and Alternative Communication (AAC) technology. This technology enables practical conversation; however, delivering expressive and timely comments remains challenging. This paper explores how to extend AAC technology to support a subset of humorous expressions: delivering timely humorous comments -- witty remarks -- through AI-powered interfaces. To understand the role of humor in AAC and the challenges and experiences of delivering humor with AAC, we conducted seven qualitative interviews with AAC users. Based on these insights and the lead author's firsthand experience as an AAC user, we designed four AI-powered interfaces to assist in delivering well-timed humorous comments during ongoing conversations. Our user study with five AAC users found that when timing is critical (e.g., delivering a humorous comment), AAC users are willing to trade agency for efficiency contrasting prior research where they hesitated to delegate decision-making to AI. We conclude by discussing the trade-off between agency and efficiency in AI-powered interfaces, how AI can shape user intentions, and offer design recommendations for AI-powered AAC interfaces.
@article{arxiv.2410.16634,
title = {Why So Serious? Exploring Timely Humorous Comments in AAC Through AI-Powered Interfaces},
author = {Tobias Weinberg and Kowe Kadoma and Ricardo E. Gonzalez Penuela and Stephanie Valencia and Thijs Roumen},
journal= {arXiv preprint arXiv:2410.16634},
year = {2025}
}
Comments
See our project and demos at: https://tobiwg.github.io/research/why_so_serious