English
Related papers

Related papers: MFA-KWS: Effective Keyword Spotting with Multi-hea…

200 papers

Keyword Spotting (KWS) from speech signals is widely applied to perform fully hands-free speech recognition. The KWS network is designed as a small-footprint model so it can continuously be active. Recent efforts have explored dynamic…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-25 Donghyeon Kim , Kyungdeuk Ko , Jeonggi Kwak , David K. Han , Hanseok Ko

One of the challenges in developing a high quality custom keyword spotting (KWS) model is the lengthy and expensive process of collecting training data covering a wide range of languages, phrases and speaking styles. We introduce Synth4Kws…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-06 Pai Zhu , Dhruuv Agarwal , Jacob W. Bartel , Kurt Partridge , Hyun Jin Park , Quan Wang

Despite the recent successes of deep neural networks, it remains challenging to achieve high precision keyword spotting task (KWS) on resource-constrained devices. In this study, we propose a novel context-aware and compact architecture for…

Sound · Computer Science 2019-12-12 Xi Chen , Shouyi Yin , Dandan Song , Peng Ouyang , Leibo Liu , Shaojun Wei

Custom keyword spotting (KWS) allows detecting user-defined spoken keywords from streaming audio. This is achieved by comparing the embeddings from voice enrollments and input audio. State-of-the-art custom KWS models are typically trained…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-06 Pai Zhu , Quan Wang , Dhruuv Agarwal , Kurt Partridge

In this paper, we propose a multilingual query-by-example keyword spotting (KWS) system based on a residual neural network. The model is trained as a classifier on a multilingual keyword dataset extracted from Common Voice sentences and…

Audio and Speech Processing · Electrical Eng. & Systems 2023-04-20 Paul M. Reuter , Christian Rollwage , Bernd T. Meyer

Query by String Keyword Spotting (KWS) is here considered as a key technology for indexing large collections of handwritten text images to allow fast textual access to the contents of these collections. Under this perspective, a…

Information Retrieval · Computer Science 2021-04-13 E. Vidal , A. H. Toselli , J. Puigcerver

Keyword Spotting (KWS) is a critical aspect of audio-based applications on mobile devices and virtual assistants. Recent developments in Federated Learning (FL) have significantly expanded the ability to train machine learning models by…

Machine Learning · Computer Science 2023-05-10 Enmao Diao , Eric W. Tramel , Jie Ding , Tao Zhang

Keyword Spotting (KWS) is essential in edge computing requiring rapid and energy-efficient responses. Spiking Neural Networks (SNNs) are well-suited for KWS for their efficiency and temporal capacity for speech. To further reduce the…

Sound · Computer Science 2024-06-19 Zeyang Song , Qianhui Liu , Qu Yang , Yizhou Peng , Haizhou Li

This paper introduces neural architecture search (NAS) for the automatic discovery of end-to-end keyword spotting (KWS) models in limited resource environments. We employ a differentiable NAS approach to optimize the structure of…

Sound · Computer Science 2021-04-15 David Peter , Wolfgang Roth , Franz Pernkopf

Keyword spotting (KWS) identifies words for voice assistants, but environmental noise frequently reduces accuracy. Standard adaptation fixes this issue and strictly requires original or labeled audio. Test time adaptation (TTA) solves this…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-09 Hanyu Ding , Yang Xiao , Jiaheng Dong , Ting Dang

Despite their great performance over the years, handcrafted speech features are not necessarily optimal for any particular speech application. Consequently, with greater or lesser success, optimal filterbank learning has been studied for…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-02 Iván López-Espejo , Zheng-Hua Tan , Jesper Jensen

Thanks to Deep Neural Networks (DNNs), the accuracy of Keyword Spotting (KWS) has made substantial progress. However, as KWS systems are usually implemented on edge devices, energy efficiency becomes a critical requirement besides…

Sound · Computer Science 2024-06-21 Shuai Wang , Dehao Zhang , Kexin Shi , Yuchen Wang , Wenjie Wei , Jibin Wu , Malu Zhang

The emergence of Artificial Intelligence (AI) driven Keyword Spotting (KWS) technologies has revolutionized human to machine interaction. Yet, the challenge of end-to-end energy efficiency, memory footprint and system complexity of current…

Audio and Speech Processing · Electrical Eng. & Systems 2021-01-28 Jie Lei , Tousif Rahman , Rishad Shafik , Adrian Wheeldon , Alex Yakovlev , Ole-Christoffer Granmo , Fahim Kawsar , Akhil Mathur

Spoken keyword spotting (KWS) is the task of identifying a keyword in an audio stream and is widely used in smart devices at the edge in order to activate voice assistants and perform hands-free tasks. The task is daunting as there is a…

Computation and Language · Computer Science 2024-05-07 Mahmoud Salhab , Haidar Harmanani

In this work we explore the latency and accuracy of keyword spotting (KWS) models in streaming and non-streaming modes on mobile phones. NN model conversion from non-streaming mode (model receives the whole input sequence and then returns…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-29 Oleg Rybakov , Natasha Kononenko , Niranjan Subrahmanya , Mirko Visontai , Stella Laurenzo

The Tsetlin Machine (TM) has recently attracted attention as a low-power alternative to neural networks due to its simple and interpretable inference mechanisms. However, its performance on speech-related tasks remains limited. This paper…

Sound · Computer Science 2025-10-29 Baizhou Lin , Yuetong Fang , Renjing Xu , Rishad Shafik , Jagmohan Chauhan

The deep neural networks, such as the Deep-FSMN, have been widely studied for keyword spotting (KWS) applications. However, computational resources for these networks are significantly constrained since they usually run on-call on edge…

Computation and Language · Computer Science 2022-10-21 Haotong Qin , Xudong Ma , Yifu Ding , Xiaoyang Li , Yang Zhang , Yao Tian , Zejun Ma , Jie Luo , Xianglong Liu

Smart audio devices are gated by an always-on lightweight keyword spotting program to reduce power consumption. It is however challenging to design models that have both high accuracy and low latency for accurate and fast responsiveness.…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-23 Bo Zhang , Wenfeng Li , Qingyuan Li , Weiji Zhuang , Xiangxiang Chu , Yujun Wang

The keyword spotting (KWS) problem requires large amounts of real speech training data to achieve high accuracy across diverse populations. Utilizing large amounts of text-to-speech (TTS) synthesized data can reduce the cost and time…

Recent advances in flexible keyword spotting (KWS) with text enrollment allow users to personalize keywords without uttering them during enrollment. However, there is still room for improvement in target keyword performance. In this work,…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-27 Youngmoon Jung , Jinyoung Lee , Seungjin Lee , Myunghun Jung , Yong-Hyeok Lee , Hoon-Young Cho