What nonverbal behaviors should a robot respond to? Understanding how children-both neurotypical and autistic-engage with embodied artificial agents is critical for developing inclusive and socially interactive systems. In this paper, we study "open-ended" unconstrained interactions with embodied agents, where little is known about how children behave nonverbally when given few instructions. We conducted a Wizard-of-Oz study in which children were invited to interact nonverbally with 6 different embodied virtual characters displayed on a television screen. We collected 563 (141 unique) nonverbal behaviors produced by children and compare the childre's interaction patterns with those previously reported in an adult study. We also report the presence of repetitive face and hand movements, which should be considered in the development of nonverbally interactive artificial agents.
@article{arxiv.2603.07843,
title = {How Neurotypical and Autistic Children Interact Nonverbally with Anthropomorphic Agents in Open-Ended Tasks},
author = {Chuxuan Zhang and Bermet Burkanova and Lawrence H. Kim and Grace Iarocci and Elina Birmingham and Angelica Lim},
journal= {arXiv preprint arXiv:2603.07843},
year = {2026}
}
Comments
4 pages, 4 figures, 3 tables, accepted by HRI Late Break Report