English

Few-shot Class-incremental Audio Classification Using Adaptively-refined Prototypes

Sound 2023-05-30 v1 Multimedia Audio and Speech Processing

Abstract

New classes of sounds constantly emerge with a few samples, making it challenging for models to adapt to dynamic acoustic environments. This challenge motivates us to address the new problem of few-shot class-incremental audio classification. This study aims to enable a model to continuously recognize new classes of sounds with a few training samples of new classes while remembering the learned ones. To this end, we propose a method to generate discriminative prototypes and use them to expand the model's classifier for recognizing sounds of new and learned classes. The model is first trained with a random episodic training strategy, and then its backbone is used to generate the prototypes. A dynamic relation projection module refines the prototypes to enhance their discriminability. Results on two datasets (derived from the corpora of Nsynth and FSD-MIX-CLIPS) show that the proposed method exceeds three state-of-the-art methods in average accuracy and performance dropping rate.

Keywords

Cite

@article{arxiv.2305.18045,
  title  = {Few-shot Class-incremental Audio Classification Using Adaptively-refined Prototypes},
  author = {Wei Xie and Yanxiong Li and Qianhua He and Wenchang Cao and Tuomas Virtanen},
  journal= {arXiv preprint arXiv:2305.18045},
  year   = {2023}
}

Comments

5 pages,2 figures, Accepted by Interspeech 2023

R2 v1 2026-06-28T10:49:11.280Z