English

Gesture Evaluation in Virtual Reality

Human-Computer Interaction 2025-09-17 v1 Artificial Intelligence Computer Vision and Pattern Recognition Machine Learning

Abstract

Gestures are central to human communication, enriching interactions through non-verbal expression. Virtual avatars increasingly use AI-generated gestures to enhance life-likeness, yet evaluations have largely been confined to 2D. Virtual Reality (VR) provides an immersive alternative that may affect how gestures are perceived. This paper presents a comparative evaluation of computer-generated gestures in VR and 2D, examining three models from the 2023 GENEA Challenge. Results show that gestures viewed in VR were rated slightly higher on average, with the strongest effect observed for motion-capture "true movement." While model rankings remained consistent across settings, VR influenced participants' overall perception and offered unique benefits over traditional 2D evaluation.

Keywords

Cite

@article{arxiv.2509.12816,
  title  = {Gesture Evaluation in Virtual Reality},
  author = {Axel Wiebe Werner and Jonas Beskow and Anna Deichler},
  journal= {arXiv preprint arXiv:2509.12816},
  year   = {2025}
}

Comments

Published in Proceedings of the 26th International Conference on Multimodal Interaction (ICMI '24), ACM. Copyright 2024 ACM. Licensed under CC BY

R2 v1 2026-07-01T05:38:40.734Z