English

Co-Designing Multimodal Systems for Accessible Asynchronous Dance Instruction

Human-Computer Interaction 2026-03-02 v4

Abstract

Videos make exercise instruction widely available, but they rely on visual demonstrations that blind and low vision (BLV) learners cannot see. While audio descriptions (AD) can make videos accessible, describing movements remains challenging as the AD must convey what to do (mechanics, location, orientation) and how to do it (speed, fluidity, timing). Prior work thus used multimodal instruction to support BLV learners with individual simple movements. However, it is unclear how these approaches scale to dance instruction with unique, complex movements and precise timing constraints. To inform accessible asynchronous dance instruction systems, we conducted three co-design workshops (N=28) with BLV dancers, instructors, and experts in sound, haptics, and AD. Participants designed 8 systems revealing common themes: staged learning to dissect routines, crafting vocabularies for movements, and selectively using modalities (narration for movement structure, sound for expression, and haptics for spatial cues). We conclude with design implications to make learning dance accessible.

Keywords

Cite

@article{arxiv.2511.09658,
  title  = {Co-Designing Multimodal Systems for Accessible Asynchronous Dance Instruction},
  author = {Ujjaini Das and Shreya Kappala and Meng Chen and Mina Huh and Amy Pavel},
  journal= {arXiv preprint arXiv:2511.09658},
  year   = {2026}
}

Comments

Accepted to CHI 2026

R2 v1 2026-07-01T07:34:32.401Z