English
Related papers

Related papers: Sub-mW Keyword Spotting on an MCU: Analog Binary F…

200 papers

In the context of keyword spotting (KWS), the replacement of handcrafted speech features by learnable features has not yielded superior KWS performance. In this study, we demonstrate that filterbank learning outperforms handcrafted speech…

Audio and Speech Processing · Electrical Eng. & Systems 2023-02-27 Iván López-Espejo , Ram C. M. C. Shekar , Zheng-Hua Tan , Jesper Jensen , John H. L. Hansen

User-defined keyword spotting (KWS) is crucial for personalized voice interaction, yet existing methods face several challenges: (1) insufficient discriminability among confusable words, (2) performance inconsistency across speakers with…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-22 Zhiqi Ai , Han Cheng , Shiyi Mu , Xinnuo Li , Yongjin Zhou , Shugong Xu

Thanks to Deep Neural Networks (DNNs), the accuracy of Keyword Spotting (KWS) has made substantial progress. However, as KWS systems are usually implemented on edge devices, energy efficiency becomes a critical requirement besides…

Sound · Computer Science 2024-06-21 Shuai Wang , Dehao Zhang , Kexin Shi , Yuchen Wang , Wenjie Wei , Jibin Wu , Malu Zhang

This paper addresses the persistent challenge in Keyword Spotting (KWS), a fundamental component in speech technology, regarding the acquisition of substantial labeled data for training. Given the difficulty in obtaining large quantities of…

Sound · Computer Science 2024-09-04 Weinan Dai , Yifeng Jiang , Yuanjing Liu , Jinkun Chen , Xin Sun , Jinglei Tao

Keyword spotting (KWS) refers to the task of identifying a set of predefined words in audio streams. With the advances seen recently with deep neural networks, it has become a popular technology to activate and control small devices, such…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-25 Heitor R. Guimarães , Arthur Pimentel , Anderson Avila , Tiago H. Falk

Deep neural networks provide effective solutions to small-footprint keyword spotting (KWS). However, if training data is limited, it remains challenging to achieve robust and highly accurate KWS in real-world scenarios where unseen sounds…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-14 Menglong Xu , Shengqiang Li , Chengdong Liang , Xiao-Lei Zhang

In this paper, we propose a multilingual query-by-example keyword spotting (KWS) system based on a residual neural network. The model is trained as a classifier on a multilingual keyword dataset extracted from Common Voice sentences and…

Audio and Speech Processing · Electrical Eng. & Systems 2023-04-20 Paul M. Reuter , Christian Rollwage , Bernd T. Meyer

As advancements in technologies like Internet of Things (IoT), Automatic Speech Recognition (ASR), Speaker Verification (SV), and Text-to-Speech (TTS) lead to increased usage of intelligent voice assistants, the demand for privacy and…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-20 Jianan Pan , Kejie Huang

Few-shot keyword spotting (FS-KWS) models usually require large-scale annotated datasets to generalize to unseen target keywords. However, existing KWS datasets are limited in scale and gathering keyword-like labeled data is costly…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-06 Seunghan Yang , Byeonggeun Kim , Kyuhong Shim , Simyung Chang

Visual keyword spotting (KWS) is the problem of estimating whether a text query occurs in a given recording using only video information. This paper focuses on visual KWS for words unseen during training, a real-world, practical setting…

Computer Vision and Pattern Recognition · Computer Science 2018-07-27 Themos Stafylakis , Georgios Tzimiropoulos

Always-on keyword spotting (KWS) demands on-device adaptation to cope with user- and environment-specific distribution shifts under tight latency and energy budgets. This paper proposes, for the first time, coupling weight adaptation (i.e.,…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-04 Matteo Risso , Alessio Burrello , Daniele Jahier Pagliari

Keyword spotting (KWS) constitutes a major component of human-technology interfaces. Maximizing the detection accuracy at a low false alarm (FA) rate, while minimizing the footprint size, latency and complexity are the goals for KWS.…

Computation and Language · Computer Science 2017-07-06 Sercan O. Arik , Markus Kliegl , Rewon Child , Joel Hestness , Andrew Gibiansky , Chris Fougner , Ryan Prenger , Adam Coates

Always-on artificial intelligent (AI) functions such as keyword spotting (KWS) and visual wake-up tend to dominate total power consumption in ultra-low power devices. A key observation is that the signals to an always-on function are sparse…

Neural and Evolutionary Computing · Computer Science 2020-06-24 Dewei Wang , Pavan Kumar Chundi , Sung Justin Kim , Minhao Yang , Joao Pedro Cerqueira , Joonsung Kang , Seungchul Jung , Sangjoon Kim , Mingoo Seok

Keyword spotting (KWS) on mobile devices generally requires a small memory footprint. However, most current models still maintain a large number of parameters in order to ensure good performance. To solve this problem, this paper proposes a…

Sound · Computer Science 2021-09-02 Shenghua Hu , Jing Wang , Yujun Wang , Lidong Yang , Wenjing Yang

Keyword spotting (KWS) aims to discriminate a specific wake-up word from other signals precisely and efficiently for different users. Recent works utilize various deep networks to train KWS models with all users' speech data centralized…

Machine Learning · Computer Science 2022-06-20 Xin-Chun Li , Jin-Lin Tang , Shaoming Song , Bingshuai Li , Yinchuan Li , Yunfeng Shao , Le Gan , De-Chuan Zhan

In this paper, we propose MM-KWS, a novel approach to user-defined keyword spotting leveraging multi-modal enrollments of text and speech templates. Unlike previous methods that focus solely on either text or speech features, MM-KWS…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-12 Zhiqi Ai , Zhiyong Chen , Shugong Xu

In this paper, we propose DS-KWS, a two-stage framework for robust user-defined keyword spotting. It combines a CTC-based method with a streaming phoneme search module to locate candidate segments, followed by a QbyT-based method with a…

Sound · Computer Science 2025-10-14 Zhiqi Ai , Han Cheng , Yuxin Wang , Shiyi Mu , Shugong Xu , Yongjin Zhou

In this paper, we present a novel approach to adapt a sequence-to-sequence Transformer-Transducer ASR system to the keyword spotting (KWS) task. We achieve this by replacing the keyword in the text transcription with a special token <kw>…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-15 Beltrán Labrador , Guanlong Zhao , Ignacio López Moreno , Angelo Scorza Scarpati , Liam Fowl , Quan Wang

Spoken keyword spotting (KWS) aims to identify keywords in audio for wide applications, especially on edge devices. Current small-footprint KWS systems focus on efficient model designs. However, their inference performance can decline in…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-21 Yang Xiao , Tianyi Peng , Yanghao Zhou , Rohan Kumar Das

In this paper, we propose an attention-based end-to-end model for multi-channel keyword spotting (KWS), which is trained to optimize the KWS result directly. As a result, our model outperforms the baseline model with signal pre-processing…

Sound · Computer Science 2018-11-06 Haitong Zhang , Junbo Zhang , Yujun Wang