English
Related papers

Related papers: Query-by-example on-device keyword spotting

200 papers

This paper proposes a self-learning method to incrementally train (fine-tune) a personalized Keyword Spotting (KWS) model after the deployment on ultra-low power smart audio sensors. We address the fundamental problem of the absence of…

Sound · Computer Science 2025-03-10 Manuele Rusci , Francesco Paci , Marco Fariselli , Eric Flamand , Tinne Tuytelaars

For training a few-shot keyword spotting (FS-KWS) model, a large labeled dataset containing massive target keywords has known to be essential to generalize to arbitrary target keywords with only a few enrollment samples. To alleviate the…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-10 Dongjune Lee , Minchan Kim , Sung Hwan Mun , Min Hyun Han , Nam Soo Kim

Keyword spotting (KWS) on mobile devices generally requires a small memory footprint. However, most current models still maintain a large number of parameters in order to ensure good performance. To solve this problem, this paper proposes a…

Sound · Computer Science 2021-09-02 Shenghua Hu , Jing Wang , Yujun Wang , Lidong Yang , Wenjing Yang

Small footprint embedded devices require keyword spotters (KWS) with small model size and detection latency for enabling voice assistants. Such a keyword is often referred to as \textit{wake word} as it is used to wake up voice assistant…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-16 Christin Jose , Yuriy Mishchenko , Thibaud Senechal , Anish Shah , Alex Escott , Shiv Vitaladevuni

Catastrophic forgetting is a thorny challenge when updating keyword spotting (KWS) models after deployment. To tackle such challenges, we propose a progressive continual learning strategy for small-footprint spoken keyword spotting…

Computation and Language · Computer Science 2022-02-08 Yizheng Huang , Nana Hou , Nancy F. Chen

Keyword Spotting (KWS) from speech signals is widely applied to perform fully hands-free speech recognition. The KWS network is designed as a small-footprint model so it can continuously be active. Recent efforts have explored dynamic…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-25 Donghyeon Kim , Kyungdeuk Ko , Jeonggi Kwak , David K. Han , Hanseok Ko

Spoken keyword spotting (KWS) aims to identify keywords in audio for wide applications, especially on edge devices. Current small-footprint KWS systems focus on efficient model designs. However, their inference performance can decline in…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-21 Yang Xiao , Tianyi Peng , Yanghao Zhou , Rohan Kumar Das

A keyword spotting (KWS) engine that is continuously running on device is exposed to various speech signals that are usually unseen before. It is a challenging problem to build a small-footprint and high-performing KWS model with robustness…

Sound · Computer Science 2024-08-27 Zhenyu Wang , Li Wan , Biqiao Zhang , Yiteng Huang , Shang-Wen Li , Ming Sun , Xin Lei , Zhaojun Yang

Keyword spotting (KWS) is one of the speech recognition tasks most sensitive to the quality of the feature representation. However, the research on KWS has traditionally focused on new model topologies, putting little emphasis on other…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-08 Douglas Baptista de Souza , Khaled Jamal Bakri , Fernanda Ferreira , Juliana Inacio

Spoken keyword spotting (KWS) is the task of identifying a keyword in an audio stream and is widely used in smart devices at the edge in order to activate voice assistants and perform hands-free tasks. The task is daunting as there is a…

Computation and Language · Computer Science 2024-05-07 Mahmoud Salhab , Haidar Harmanani

Current keyword spotting systems primarily use phoneme-level matching to distinguish confusable words but ignore user-specific pronunciation traits like prosody (intonation, stress, rhythm). This paper presents ProKWS, a novel framework…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-20 Jianan Pan , Yuanming Zhang , Kejie Huang

Keyword spotting (KWS) is an essential function that enables interaction with ubiquitous smart devices. However, in resource-limited devices, KWS models are often static and can thus not adapt to new scenarios, such as added keywords. To…

The performance of keyword spotting (KWS), measured in false alarms and false rejects, degrades significantly under the far field and noisy conditions. In this paper, we propose a multi-look neural network modeling for speech enhancement…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-22 Meng Yu , Xuan Ji , Bo Wu , Dan Su , Dong Yu

In this paper, we present a novel approach to adapt a sequence-to-sequence Transformer-Transducer ASR system to the keyword spotting (KWS) task. We achieve this by replacing the keyword in the text transcription with a special token <kw>…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-15 Beltrán Labrador , Guanlong Zhao , Ignacio López Moreno , Angelo Scorza Scarpati , Liam Fowl , Quan Wang

Keyword Spotting (KWS) systems with small footprint models deployed on edge devices face significant accuracy and robustness challenges due to domain shifts caused by varying noise and recording conditions. To address this, we propose a…

Sound · Computer Science 2026-01-23 Prakash Dhungana , Sayed Ahmad Salehi

Continuous Speech Keyword Spotting (CSKWS) is a task to detect predefined keywords in a continuous speech. In this paper, we regard CSKWS as a one-dimensional object detection task and propose a novel anchor-free detector, named AF-KWS, to…

Audio and Speech Processing · Electrical Eng. & Systems 2022-08-10 Zhiyuan Zhao , Chuanxin Tang , Chengdong Yao , Chong Luo

As advancements in technologies like Internet of Things (IoT), Automatic Speech Recognition (ASR), Speaker Verification (SV), and Text-to-Speech (TTS) lead to increased usage of intelligent voice assistants, the demand for privacy and…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-20 Jianan Pan , Kejie Huang

Evaluation of keyword spotting (KWS) systems that detect keywords in speech is a challenging task under realistic privacy constraints. The KWS is designed to only collect data when the keyword is present, limiting the availability of hard…

Keyword spotting (KWS) plays a critical role in enabling speech-based user interactions on smart devices. Recent developments in the field of deep learning have led to wide adoption of convolutional neural networks (CNNs) in KWS systems due…

Non-invasive brain-computer interfaces (BCIs) are beginning to benefit from large, public benchmarks. However, current benchmarks target relatively simple, foundational tasks like Speech Detection and Phoneme Classification, while…

Machine Learning · Computer Science 2025-10-31 Gereon Elvers , Gilad Landau , Oiwi Parker Jones