English

Towards Human-in-the-Loop Onset Detection: A Transfer Learning Approach for Maracatu

Sound 2025-07-08 v1 Artificial Intelligence Machine Learning Audio and Speech Processing

Abstract

We explore transfer learning strategies for musical onset detection in the Afro-Brazilian Maracatu tradition, which features complex rhythmic patterns that challenge conventional models. We adapt two Temporal Convolutional Network architectures: one pre-trained for onset detection (intra-task) and another for beat tracking (inter-task). Using only 5-second annotated snippets per instrument, we fine-tune these models through layer-wise retraining strategies for five traditional percussion instruments. Our results demonstrate significant improvements over baseline performance, with F1 scores reaching up to 0.998 in the intra-task setting and improvements of over 50 percentage points in best-case scenarios. The cross-task adaptation proves particularly effective for time-keeping instruments, where onsets naturally align with beat positions. The optimal fine-tuning configuration varies by instrument, highlighting the importance of instrument-specific adaptation strategies. This approach addresses the challenges of underrepresented musical traditions, offering an efficient human-in-the-loop methodology that minimizes annotation effort while maximizing performance. Our findings contribute to more inclusive music information retrieval tools applicable beyond Western musical contexts.

Keywords

Cite

@article{arxiv.2507.04858,
  title  = {Towards Human-in-the-Loop Onset Detection: A Transfer Learning Approach for Maracatu},
  author = {António Sá Pinto},
  journal= {arXiv preprint arXiv:2507.04858},
  year   = {2025}
}

Comments

Accepted at ISMIR 2025

R2 v1 2026-07-01T03:49:13.616Z