English
Related papers

Related papers: Hardware Aware Training for Efficient Keyword Spot…

200 papers

We propose GE2E-KWS -- a generalized end-to-end training and evaluation framework for customized keyword spotting. Specifically, enrollment utterances are separated and grouped by keywords from the training batch and their embedding…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-06 Pai Zhu , Jacob W. Bartel , Dhruuv Agarwal , Kurt Partridge , Hyun Jin Park , Quan Wang

Deep neural networks provide effective solutions to small-footprint keyword spotting (KWS). However, if training data is limited, it remains challenging to achieve robust and highly accurate KWS in real-world scenarios where unseen sounds…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-14 Menglong Xu , Shengqiang Li , Chengdong Liang , Xiao-Lei Zhang

This paper introduces neural architecture search (NAS) for the automatic discovery of end-to-end keyword spotting (KWS) models in limited resource environments. We employ a differentiable NAS approach to optimize the structure of…

Sound · Computer Science 2021-04-15 David Peter , Wolfgang Roth , Franz Pernkopf

Open-vocabulary keyword spotting (KWS) refers to the task of detecting words or terms within speech recordings, regardless of whether they were included in the training data. This paper introduces an open-vocabulary keyword spotting model…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-08 Yael Segal-Feldman , Ann R. Bradlow , Matthew Goldrick , Joseph Keshet

In this paper, we propose an attention-based end-to-end model for multi-channel keyword spotting (KWS), which is trained to optimize the KWS result directly. As a result, our model outperforms the baseline model with signal pre-processing…

Sound · Computer Science 2018-11-06 Haitong Zhang , Junbo Zhang , Yujun Wang

Spoken keyword spotting (KWS) deals with the identification of keywords in audio streams and has become a fast-growing technology thanks to the paradigm shift introduced by deep learning a few years ago. This has allowed the rapid embedding…

Sound · Computer Science 2021-11-23 Iván López-Espejo , Zheng-Hua Tan , John Hansen , Jesper Jensen

Custom keyword spotting (KWS) allows detecting user-defined spoken keywords from streaming audio. This is achieved by comparing the embeddings from voice enrollments and input audio. State-of-the-art custom KWS models are typically trained…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-06 Pai Zhu , Quan Wang , Dhruuv Agarwal , Kurt Partridge

This paper introduces neural architecture search (NAS) for the automatic discovery of small models for keyword spotting (KWS) in limited resource environments. We employ a differentiable NAS approach to optimize the structure of…

Audio and Speech Processing · Electrical Eng. & Systems 2020-12-21 David Peter , Wolfgang Roth , Franz Pernkopf

In this paper, we propose a multilingual query-by-example keyword spotting (KWS) system based on a residual neural network. The model is trained as a classifier on a multilingual keyword dataset extracted from Common Voice sentences and…

Audio and Speech Processing · Electrical Eng. & Systems 2023-04-20 Paul M. Reuter , Christian Rollwage , Bernd T. Meyer

Non-invasive brain-computer interfaces (BCIs) are beginning to benefit from large, public benchmarks. However, current benchmarks target relatively simple, foundational tasks like Speech Detection and Phoneme Classification, while…

Machine Learning · Computer Science 2025-10-31 Gereon Elvers , Gilad Landau , Oiwi Parker Jones

Keyword Spotting (KWS) models on embedded devices should adapt fast to new user-defined words without forgetting previous ones. Embedded devices have limited storage and computational resources, thus, they cannot save samples or update…

Sound · Computer Science 2023-07-25 Umberto Michieli , Pablo Peso Parada , Mete Ozay

Keyword Spotting (KWS) systems with small footprint models deployed on edge devices face significant accuracy and robustness challenges due to domain shifts caused by varying noise and recording conditions. To address this, we propose a…

Sound · Computer Science 2026-01-23 Prakash Dhungana , Sayed Ahmad Salehi

Keyword spotting (KWS) constitutes a major component of human-technology interfaces. Maximizing the detection accuracy at a low false alarm (FA) rate, while minimizing the footprint size, latency and complexity are the goals for KWS.…

Computation and Language · Computer Science 2017-07-06 Sercan O. Arik , Markus Kliegl , Rewon Child , Joel Hestness , Andrew Gibiansky , Chris Fougner , Ryan Prenger , Adam Coates

Visual keyword spotting (KWS) is the problem of estimating whether a text query occurs in a given recording using only video information. This paper focuses on visual KWS for words unseen during training, a real-world, practical setting…

Computer Vision and Pattern Recognition · Computer Science 2018-07-27 Themos Stafylakis , Georgios Tzimiropoulos

In the context of keyword spotting (KWS), the replacement of handcrafted speech features by learnable features has not yielded superior KWS performance. In this study, we demonstrate that filterbank learning outperforms handcrafted speech…

Audio and Speech Processing · Electrical Eng. & Systems 2023-02-27 Iván López-Espejo , Ram C. M. C. Shekar , Zheng-Hua Tan , Jesper Jensen , John H. L. Hansen

Keyword Spotting nowadays is an integral part of speech-oriented user interaction targeted for smart devices. To this extent, neural networks are extensively used for their flexibility and high accuracy. However, coming up with a suitable…

Machine Learning · Computer Science 2022-02-08 Arnab Neelim Mazumder , Tinoosh Mohsenin

User-defined keyword spotting (KWS) without resorting to domain-specific pre-labeled training data is of fundamental importance in building adaptable and personalized voice interfaces. However, such systems are still faced with arduous…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-07 Lo-Ya Li , Tien-Hong Lo , Jeih-Weih Hung , Shih-Chieh Huang , Berlin Chen

Fixed-point (FXP) inference has proven suitable for embedded devices with limited computational resources, and yet model training is continually performed in floating-point (FLP). FXP training has not been fully explored and the non-trivial…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-08 Sashank Macha , Om Oza , Alex Escott , Francesco Caliva , Robbie Armitano , Santosh Kumar Cheekatmalla , Sree Hari Krishnan Parthasarathi , Yuzong Liu

Despite their great performance over the years, handcrafted speech features are not necessarily optimal for any particular speech application. Consequently, with greater or lesser success, optimal filterbank learning has been studied for…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-02 Iván López-Espejo , Zheng-Hua Tan , Jesper Jensen

Always-on artificial intelligent (AI) functions such as keyword spotting (KWS) and visual wake-up tend to dominate total power consumption in ultra-low power devices. A key observation is that the signals to an always-on function are sparse…

Neural and Evolutionary Computing · Computer Science 2020-06-24 Dewei Wang , Pavan Kumar Chundi , Sung Justin Kim , Minhao Yang , Joao Pedro Cerqueira , Joonsung Kang , Seungchul Jung , Sangjoon Kim , Mingoo Seok