English

Did somebody say "Gest-IT"? A pilot exploration of multimodal data management

Computation and Language 2026-03-20 v1

Abstract

The paper presents a pilot exploration of the construction, management and analysis of a multimodal corpus. Through a three-layer annotation that provides orthographic, prosodic, and gestural transcriptions, the Gest-IT resource allows to investigate the variation of gesture-making patterns in conversations between sighted people and people with visual impairment. After discussing the transcription methods and technical procedures employed in our study, we propose a unified CoNLL-U corpus and indicate our future steps

Keywords

Cite

@article{arxiv.2410.15825,
  title  = {Did somebody say "Gest-IT"? A pilot exploration of multimodal data management},
  author = {Ludovica Pannitto and Lorenzo Albanesi and Laura Marion and Federica Maria Martines and Carmelo Caruso and Claudia S. Bianchini and Francesca Masini and Caterina Mauri},
  journal= {arXiv preprint arXiv:2410.15825},
  year   = {2026}
}