Speech-based Mark for Data Sonification
Human-Computer Interaction
2024-08-14 v1
Abstract
Sonification serves as a powerful tool for data accessibility, especially for people with vision loss. Among various modalities, speech is a familiar means of communication similar to the role of text in visualization. However, speech-based sonification is underexplored. We introduce SpeechTone, a novel speech-based mark for data sonification and extension to the existing Erie declarative grammar for sonification. It encodes data into speech attributes such as pitch, speed, voice and speech content. We demonstrate the efficacy of SpeechTone through three examples.
Keywords
Cite
@article{arxiv.2408.06942,
title = {Speech-based Mark for Data Sonification},
author = {Yichun Zhao and Jingyi Lu and Miguel A Nacenta},
journal= {arXiv preprint arXiv:2408.06942},
year = {2024}
}
Comments
Accepted in ASSETS '24, October 27-30, 2024, St. John's, NL, Canada