English

Real-Time Pitch/F0 Detection Using Spectrogram Images and Convolutional Neural Networks

Sound 2025-04-09 v1 Artificial Intelligence Audio and Speech Processing

Abstract

This paper presents a novel approach to detect F0 through Convolutional Neural Networks and image processing techniques to directly estimate pitch from spectrogram images. Our new approach demonstrates a very good detection accuracy; a total of 92% of predicted pitch contours have strong or moderate correlations to the true pitch contours. Furthermore, the experimental comparison between our new approach and other state-of-the-art CNN methods reveals that our approach can enhance the detection rate by approximately 5% across various Signal-to-Noise Ratio conditions.

Keywords

Cite

@article{arxiv.2504.06165,
  title  = {Real-Time Pitch/F0 Detection Using Spectrogram Images and Convolutional Neural Networks},
  author = {Xufang Zhao and Omer Tsimhoni},
  journal= {arXiv preprint arXiv:2504.06165},
  year   = {2025}
}
R2 v1 2026-06-28T22:51:03.844Z