English
Related papers

Related papers: Enhancing Few-shot Keyword Spotting Performance th…

200 papers

Keyword Spotting (KWS) is a critical aspect of audio-based applications on mobile devices and virtual assistants. Recent developments in Federated Learning (FL) have significantly expanded the ability to train machine learning models by…

Machine Learning · Computer Science 2023-05-10 Enmao Diao , Eric W. Tramel , Jie Ding , Tao Zhang

We propose GE2E-KWS -- a generalized end-to-end training and evaluation framework for customized keyword spotting. Specifically, enrollment utterances are separated and grouped by keywords from the training batch and their embedding…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-06 Pai Zhu , Jacob W. Bartel , Dhruuv Agarwal , Kurt Partridge , Hyun Jin Park , Quan Wang

Robustness against noise is critical for keyword spotting (KWS) in real-world environments. To improve the robustness, a speech enhancement front-end is involved. Instead of treating the speech enhancement as a separated preprocessing…

Sound · Computer Science 2019-06-21 Yue Gu , Zhihao Du , Hui Zhang , Xueliang Zhang

Deep neural networks provide effective solutions to small-footprint keyword spotting (KWS). However, if training data is limited, it remains challenging to achieve robust and highly accurate KWS in real-world scenarios where unseen sounds…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-14 Menglong Xu , Shengqiang Li , Chengdong Liang , Xiao-Lei Zhang

Keyword spotting (KWS) on mobile devices generally requires a small memory footprint. However, most current models still maintain a large number of parameters in order to ensure good performance. To solve this problem, this paper proposes a…

Sound · Computer Science 2021-09-02 Shenghua Hu , Jing Wang , Yujun Wang , Lidong Yang , Wenjing Yang

The keyword spotting (KWS) problem requires large amounts of real speech training data to achieve high accuracy across diverse populations. Utilizing large amounts of text-to-speech (TTS) synthesized data can reduce the cost and time…

Keyword Spotting (KWS) systems with small footprint models deployed on edge devices face significant accuracy and robustness challenges due to domain shifts caused by varying noise and recording conditions. To address this, we propose a…

Sound · Computer Science 2026-01-23 Prakash Dhungana , Sayed Ahmad Salehi

In this paper, we propose a multilingual query-by-example keyword spotting (KWS) system based on a residual neural network. The model is trained as a classifier on a multilingual keyword dataset extracted from Common Voice sentences and…

Audio and Speech Processing · Electrical Eng. & Systems 2023-04-20 Paul M. Reuter , Christian Rollwage , Bernd T. Meyer

User-defined keyword spotting is a task to detect new spoken terms defined by users. This can be viewed as a few-shot learning problem since it is unreasonable for users to define their desired keywords by providing many examples. To solve…

Machine Learning · Computer Science 2022-10-06 Wei-Tsung Kao , Yuan-Kuei Wu , Chia-Ping Chen , Zhi-Sheng Chen , Yu-Pao Tsai , Hung-Yi Lee

Spoken keyword spotting (KWS) aims to identify keywords in audio for wide applications, especially on edge devices. Current small-footprint KWS systems focus on efficient model designs. However, their inference performance can decline in…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-21 Yang Xiao , Tianyi Peng , Yanghao Zhou , Rohan Kumar Das

Keyword spotting (KWS) offers a vital mechanism to identify spoken commands in voice-enabled systems, where user demands often shift, requiring models to learn new keywords continually over time. However, a major problem is catastrophic…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-20 Yang Xiao , Tianyi Peng , Rohan Kumar Das , Yuchen Hu , Huiping Zhuang

In this paper, we present a novel approach to adapt a sequence-to-sequence Transformer-Transducer ASR system to the keyword spotting (KWS) task. We achieve this by replacing the keyword in the text transcription with a special token <kw>…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-15 Beltrán Labrador , Guanlong Zhao , Ignacio López Moreno , Angelo Scorza Scarpati , Liam Fowl , Quan Wang

Keyword spotting (KWS) in historical documents is an important tool for the initial exploration of digitized collections. Nowadays, the most efficient KWS methods are relying on machine learning techniques that require a large amount of…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Sana Khamekhem Jemni , Sourour Ammar , Mohamed Ali Souibgui , Yousri Kessentini , Abbas Cheddad

Fixed-point (FXP) inference has proven suitable for embedded devices with limited computational resources, and yet model training is continually performed in floating-point (FLP). FXP training has not been fully explored and the non-trivial…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-08 Sashank Macha , Om Oza , Alex Escott , Francesco Caliva , Robbie Armitano , Santosh Kumar Cheekatmalla , Sree Hari Krishnan Parthasarathi , Yuzong Liu

In this paper, we propose an attention-based end-to-end neural approach for small-footprint keyword spotting (KWS), which aims to simplify the pipelines of building a production-quality KWS system. Our model consists of an encoder and an…

Sound · Computer Science 2018-03-30 Changhao Shan , Junbo Zhang , Yujun Wang , Lei Xie

Few-shot segmentation~(FSS) performance has been extensively promoted by introducing episodic training and class-wise prototypes. However, the FSS problem remains challenging due to three limitations: (1) Models are distracted by…

Computer Vision and Pattern Recognition · Computer Science 2021-06-02 Jian-Wei Zhang , Lei Lv , Yawei Luo , Hao-Zhe Feng , Yi Yang , Wei Chen

Few-shot Learning aims to learn and distinguish new categories with a very limited number of available images, presenting a significant challenge in the realm of deep learning. Recent researchers have sought to leverage the additional…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Chunpeng Zhou , Haishuai Wang , Xilu Yuan , Zhi Yu , Jiajun Bu

Keyword spotting (KWS) is a key enabling technology for hands-free interaction in embedded and IoT devices, where stringent memory and energy constraints challenge the deployment of AI-enabeld devices. In this work, we systematically…

Speech models have long been known to overfit individual speakers for many classification tasks. This leads to poor generalization in settings where the speakers are out-of-domain or out-of-distribution, as is common in production…

Computation and Language · Computer Science 2024-11-08 Maximillian Chen , Zhou Yu

Customized keyword spotting (KWS) has great potential to be deployed on edge devices to achieve hands-free user experience. However, in real applications, false alarm (FA) would be a serious problem for spotting dozens or even hundreds of…

Sound · Computer Science 2022-07-05 Zhanheng Yang , Sining Sun , Jin Li , Xiaoming Zhang , Xiong Wang , Long Ma , Lei Xie