Fully Automatic Page Turning on Real Scores
Sound
2021-11-15 v1 Computer Vision and Pattern Recognition
Machine Learning
Audio and Speech Processing
Abstract
We present a prototype of an automatic page turning system that works directly on real scores, i.e., sheet images, without any symbolic representation. Our system is based on a multi-modal neural network architecture that observes a complete sheet image page as input, listens to an incoming musical performance, and predicts the corresponding position in the image. Using the position estimation of our system, we use a simple heuristic to trigger a page turning event once a certain location within the sheet image is reached. As a proof of concept we further combine our system with an actual machine that will physically turn the page on command.
Cite
@article{arxiv.2111.06643,
title = {Fully Automatic Page Turning on Real Scores},
author = {Florian Henkel and Stephanie Schwaiger and Gerhard Widmer},
journal= {arXiv preprint arXiv:2111.06643},
year = {2021}
}
Comments
ISMIR 2021 Late Breaking/Demo