English

MALEFA: Multi-grAnularity Learning and Effective False Alarm Suppression for Zero-shot Keyword Spotting

Audio and Speech Processing 2026-04-07 v1

Abstract

User-defined keyword spotting (KWS) without resorting to domain-specific pre-labeled training data is of fundamental importance in building adaptable and personalized voice interfaces. However, such systems are still faced with arduous challenges, including constrained computational resources and limited annotated training data. Existing methods also struggle to distinguish acoustically similar keywords, often leading to a pesky false alarm rate (FAR) in real-world deployments. To mitigate these limitations, we put forward MALEFA, a novel lightweight zero-shot KWS framework that jointly learns utterance- and phoneme-level alignments via cross-attention and a multi-granularity contrastive learning objective. Evaluations on four public benchmark datasets show that MALEFA achieves a high accuracy of 90%, significantly reducing FAR to 0.007% on the AMI dataset. Beyond its strong performance, MALEFA demonstrates high computational efficiency and can readily support real-time deployment on resource-constrained devices.

Keywords

Cite

@article{arxiv.2604.03689,
  title  = {MALEFA: Multi-grAnularity Learning and Effective False Alarm Suppression for Zero-shot Keyword Spotting},
  author = {Lo-Ya Li and Tien-Hong Lo and Jeih-Weih Hung and Shih-Chieh Huang and Berlin Chen},
  journal= {arXiv preprint arXiv:2604.03689},
  year   = {2026}
}

Comments

Accepted by ICASSP 2026. 5 pages, 4 figures

R2 v1 2026-07-01T11:53:49.894Z