English

Multimodality in VR: A survey

Human-Computer Interaction 2024-05-24 v3 Graphics

Abstract

Virtual reality (VR) is rapidly growing, with the potential to change the way we create and consume content. In VR, users integrate multimodal sensory information they receive, to create a unified perception of the virtual world. In this survey, we review the body of work addressing multimodality in VR, and its role and benefits in user experience, together with different applications that leverage multimodality in many disciplines. These works thus encompass several fields of research, and demonstrate that multimodality plays a fundamental role in VR; enhancing the experience, improving overall performance, and yielding unprecedented abilities in skill and knowledge transfer.

Keywords

Cite

@article{arxiv.2101.07906,
  title  = {Multimodality in VR: A survey},
  author = {Daniel Martin and Sandra Malpica and Diego Gutierrez and Belen Masia and Ana Serrano},
  journal= {arXiv preprint arXiv:2101.07906},
  year   = {2024}
}

Comments

35 pages (24 pages not including references), 10 figures, 4 tables

R2 v1 2026-06-23T22:20:08.956Z