English

CREPE: A Convolutional Representation for Pitch Estimation

Audio and Speech Processing 2018-02-20 v1 Machine Learning Sound Machine Learning

Abstract

The task of estimating the fundamental frequency of a monophonic sound recording, also known as pitch tracking, is fundamental to audio processing with multiple applications in speech processing and music information retrieval. To date, the best performing techniques, such as the pYIN algorithm, are based on a combination of DSP pipelines and heuristics. While such techniques perform very well on average, there remain many cases in which they fail to correctly estimate the pitch. In this paper, we propose a data-driven pitch tracking algorithm, CREPE, which is based on a deep convolutional neural network that operates directly on the time-domain waveform. We show that the proposed model produces state-of-the-art results, performing equally or better than pYIN. Furthermore, we evaluate the model's generalizability in terms of noise robustness. A pre-trained version of CREPE is made freely available as an open-source Python module for easy application.

Keywords

Cite

@article{arxiv.1802.06182,
  title  = {CREPE: A Convolutional Representation for Pitch Estimation},
  author = {Jong Wook Kim and Justin Salamon and Peter Li and Juan Pablo Bello},
  journal= {arXiv preprint arXiv:1802.06182},
  year   = {2018}
}

Comments

ICASSP 2018

R2 v1 2026-06-23T00:25:12.279Z