English

Synthetic data enables context-aware bioacoustic sound event detection

Sound 2025-09-09 v2 Machine Learning Audio and Speech Processing

Abstract

We propose a methodology for training foundation models that enhances their in-context learning capabilities within the domain of bioacoustic signal processing. We use synthetically generated training data, introducing a domain-randomization-based pipeline that constructs diverse acoustic scenes with temporally strong labels. We generate over 8.8 thousand hours of strongly-labeled audio and train a query-by-example, transformer-based model to perform few-shot bioacoustic sound event detection. Our second contribution is a public benchmark of 13 diverse few-shot bioacoustics tasks. Our model outperforms previously published methods, and improves relative to other training-free methods by 64%64\%. We demonstrate that this is due to increase in model size and data scale, as well as algorithmic improvements. We make our trained model available via an API, to provide ecologists and ethologists with a training-free tool for bioacoustic sound event detection.

Keywords

Cite

@article{arxiv.2503.00296,
  title  = {Synthetic data enables context-aware bioacoustic sound event detection},
  author = {Benjamin Hoffman and David Robinson and Marius Miron and Vittorio Baglione and Daniela Canestrari and Damian Elias and Eva Trapote and Felix Effenberger and Maddie Cusimano and Masato Hagiwara and Olivier Pietquin},
  journal= {arXiv preprint arXiv:2503.00296},
  year   = {2025}
}
R2 v1 2026-06-28T22:02:46.964Z