English
Related papers

Related papers: Developing Far-Field Speaker System Via Teacher-St…

200 papers

Spoken keyword spotting (KWS) deals with the identification of keywords in audio streams and has become a fast-growing technology thanks to the paradigm shift introduced by deep learning a few years ago. This has allowed the rapid embedding…

Sound · Computer Science 2021-11-23 Iván López-Espejo , Zheng-Hua Tan , John Hansen , Jesper Jensen

Small-Footprint Keyword Spotting (SF-KWS) has gained popularity in today's landscape of smart voice-activated devices, smartphones, and Internet of Things (IoT) applications. This surge is attributed to the advancements in Deep Learning,…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-16 Soumen Garai , Suman Samui

Large scale machine learning (ML) systems such as the Alexa automatic speech recognition (ASR) system continue to improve with increasing amounts of manually transcribed training data. Instead of scaling manual transcription to impractical…

In this paper, we propose an attention-based end-to-end model for multi-channel keyword spotting (KWS), which is trained to optimize the KWS result directly. As a result, our model outperforms the baseline model with signal pre-processing…

Sound · Computer Science 2018-11-06 Haitong Zhang , Junbo Zhang , Yujun Wang

In this work, we investigated the teacher-student training paradigm to train a fully learnable multi-channel acoustic model for far-field automatic speech recognition (ASR). Using a large offline teacher model trained on beamformed audio,…

Sound · Computer Science 2020-05-05 Sanna Wager , Aparna Khare , Minhua Wu , Kenichi Kumatani , Shiva Sundaram

High accuracy speech recognition requires a large amount of transcribed data for supervised training. In the absence of such data, domain adaptation of a well-trained acoustic model can be performed, but even here, high accuracy usually…

Computation and Language · Computer Science 2017-08-21 Jinyu Li , Michael L. Seltzer , Xi Wang , Rui Zhao , Yifan Gong

Robustness against noise is critical for keyword spotting (KWS) in real-world environments. To improve the robustness, a speech enhancement front-end is involved. Instead of treating the speech enhancement as a separated preprocessing…

Sound · Computer Science 2019-06-21 Yue Gu , Zhihao Du , Hui Zhang , Xueliang Zhang

We present results from Alexa speech teams on semi-supervised learning (SSL) of acoustic models (AM) with experiments spanning over 3000 hours of GPU time, making our study one of the largest of its kind. We discuss SSL for AMs in a small…

Learning to recognize new keywords with just a few examples is essential for personalizing keyword spotting (KWS) models to a user's choice of keywords. However, modern KWS models are typically trained on large datasets and restricted to a…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-07 Abhijeet Awasthi , Kevin Kilgour , Hassan Rom

Spoken keyword spotting (KWS) aims to identify keywords in audio for wide applications, especially on edge devices. Current small-footprint KWS systems focus on efficient model designs. However, their inference performance can decline in…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-21 Yang Xiao , Tianyi Peng , Yanghao Zhou , Rohan Kumar Das

Custom keyword spotting (KWS) allows detecting user-defined spoken keywords from streaming audio. This is achieved by comparing the embeddings from voice enrollments and input audio. State-of-the-art custom KWS models are typically trained…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-06 Pai Zhu , Quan Wang , Dhruuv Agarwal , Kurt Partridge

Few-shot keyword spotting (FS-KWS) models usually require large-scale annotated datasets to generalize to unseen target keywords. However, existing KWS datasets are limited in scale and gathering keyword-like labeled data is costly…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-06 Seunghan Yang , Byeonggeun Kim , Kyuhong Shim , Simyung Chang

The teacher-student (T/S) learning has been shown to be effective for a variety of problems such as domain adaptation and model compression. One shortcoming of the T/S learning is that a teacher model, not always perfect, sporadically…

Machine Learning · Computer Science 2019-04-30 Zhong Meng , Jinyu Li , Yong Zhao , Yifan Gong

Keyword Spotting (KWS) systems with small footprint models deployed on edge devices face significant accuracy and robustness challenges due to domain shifts caused by varying noise and recording conditions. To address this, we propose a…

Sound · Computer Science 2026-01-23 Prakash Dhungana , Sayed Ahmad Salehi

Keyword spotting (KWS) is an important technique for speech applications, which enables users to activate devices by speaking a keyword phrase. Although a phoneme classifier can be used for KWS, exploiting a large amount of transcribed data…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-23 Takuya Higuchi , Anmol Gupta , Chandra Dhir

In this paper, we investigated a speech augmentation based unsupervised learning approach for keyword spotting (KWS) task. KWS is a useful speech application, yet also heavily depends on the labeled data. We designed a CNN-Attention…

Sound · Computer Science 2022-05-31 Jian Luo , Jianzong Wang , Ning Cheng , Haobin Tang , Jing Xiao

The recognition of rare named entities, such as personal names and terminologies, is challenging for automatic speech recognition (ASR) systems, especially when they are not frequently observed in the training data. In this paper, we…

Artificial Intelligence · Computer Science 2024-06-07 Yuang Li , Min Zhang , Chang Su , Yinglu Li , Xiaosong Qiao , Mengxin Ren , Miaomiao Ma , Daimeng Wei , Shimin Tao , Hao Yang

In this paper, we investigate representation learning for low-resource keyword spotting (KWS). The main challenges of KWS are limited labeled data and limited available device resources. To address those challenges, we explore…

Sound · Computer Science 2023-03-21 Fan Cui , Liyong Guo , Quandong Wang , Peng Gao , Yujun Wang

In this paper, we present a novel approach to adapt a sequence-to-sequence Transformer-Transducer ASR system to the keyword spotting (KWS) task. We achieve this by replacing the keyword in the text transcription with a special token <kw>…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-15 Beltrán Labrador , Guanlong Zhao , Ignacio López Moreno , Angelo Scorza Scarpati , Liam Fowl , Quan Wang

Keyword Spotting (KWS) models are becoming increasingly integrated into various systems, e.g. voice assistants. To achieve satisfactory performance, these models typically rely on a large amount of labelled data, limiting their applications…

Sound · Computer Science 2023-05-25 Holger Severin Bovbjerg , Zheng-Hua Tan