A Multi-modal Deep Neural Network approach to Bird-song identification
Sound
2018-11-13 v1 Audio and Speech Processing
Abstract
We present a multi-modal Deep Neural Network (DNN) approach for bird song identification. The presented approach takes both audio samples and metadata as input. The audio is fed into a Convolutional Neural Network (CNN) using four convolutional layers. The additionally provided metadata is processed using fully connected layers. The flattened convolutional layers and the fully connected layer of the metadata are joined and fed into a fully connected layer. The resulting architecture achieved 2., 3. and 4. rank in the BirdCLEF2017 task in various training configurations.
Cite
@article{arxiv.1811.04448,
title = {A Multi-modal Deep Neural Network approach to Bird-song identification},
author = {Botond Fazeka and Alexander Schindler and Thomas Lidy and Andreas Rauber},
journal= {arXiv preprint arXiv:1811.04448},
year = {2018}
}
Comments
LifeCLEF 2017 working notes, Dublin, Ireland