Augmented Contrastive Self-Supervised Learning for Audio Invariant Representations
Audio and Speech Processing
2021-12-22 v1 Machine Learning
Sound
Abstract
Improving generalization is a major challenge in audio classification due to labeled data scarcity. Self-supervised learning (SSL) methods tackle this by leveraging unlabeled data to learn useful features for downstream classification tasks. In this work, we propose an augmented contrastive SSL framework to learn invariant representations from unlabeled data. Our method applies various perturbations to the unlabeled input data and utilizes contrastive learning to learn representations robust to such perturbations. Experimental results on the Audioset and DESED datasets show that our framework significantly outperforms state-of-the-art SSL and supervised learning methods on sound/event classification tasks.
Keywords
Cite
@article{arxiv.2112.10950,
title = {Augmented Contrastive Self-Supervised Learning for Audio Invariant Representations},
author = {Melikasadat Emami and Dung Tran and Kazuhito Koishida},
journal= {arXiv preprint arXiv:2112.10950},
year = {2021}
}
Comments
4 pages, 4 figures