English
Related papers

Related papers: Domain-Incremental Continual Learning for Robust a…

200 papers

The currently most prominent algorithm to train keyword spotting (KWS) models with deep neural networks (DNNs) requires strong supervision i.e., precise knowledge of the spoken keyword location in time. Thus, most KWS approaches treat the…

Sound · Computer Science 2023-05-31 Heinrich Dinkel , Weiji Zhuang , Zhiyong Yan , Yongqing Wang , Junbo Zhang , Yujun Wang

In this paper, we propose an attention-based end-to-end model for multi-channel keyword spotting (KWS), which is trained to optimize the KWS result directly. As a result, our model outperforms the baseline model with signal pre-processing…

Sound · Computer Science 2018-11-06 Haitong Zhang , Junbo Zhang , Yujun Wang

Designing an efficient keyword spotting (KWS) system that delivers exceptional performance on resource-constrained edge devices has long been a subject of significant attention. Existing KWS search algorithms typically follow a…

Audio and Speech Processing · Electrical Eng. & Systems 2024-03-21 Yu Xi , Hao Li , Baochen Yang , Haoyu Li , Hainan Xu , Kai Yu

Keyword spotting (KWS) on mobile devices generally requires a small memory footprint. However, most current models still maintain a large number of parameters in order to ensure good performance. To solve this problem, this paper proposes a…

Sound · Computer Science 2021-09-02 Shenghua Hu , Jing Wang , Yujun Wang , Lidong Yang , Wenjing Yang

Using audio and text embeddings jointly for Keyword Spotting (KWS) has shown high-quality results, but the key challenge of how to semantically align two embeddings for multi-word keywords of different sequence lengths remains largely…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-09 Kumari Nishu , Minsik Cho , Devang Naik

This article presents a method for improving a keyword spotter (KWS) algorithm in noisy environments. Although beamforming (BF) and adaptive noise cancellation (ANC) techniques are robust in some conditions, they may degrade the performance…

Keyword Spotting plays a critical role in enabling hands-free interaction for battery-powered edge devices. Few-Shot Keyword Spotting (FS-KWS) addresses the scalability and adaptability challenges of traditional systems by enabling…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-09 Alican Gok , Oguzhan Buyuksolak , Osman Erman Okman , Murat Saraclar

A personalized KeyWord Spotting (KWS) pipeline typically requires the training of a Deep Learning model on a large set of user-defined speech utterances, preventing fast customization directly applied on-device. To fill this gap, this paper…

Machine Learning · Computer Science 2023-06-06 Manuele Rusci , Tinne Tuytelaars

Mainly for the sake of solving the lack of keyword-specific data, we propose one Keyword Spotting (KWS) system using Deep Neural Network (DNN) and Connectionist Temporal Classifier (CTC) on power-constrained small-footprint mobile devices,…

Computation and Language · Computer Science 2017-09-13 Zhiming Wang , Xiaolong Li , Jun Zhou

In this paper, we propose a multilingual query-by-example keyword spotting (KWS) system based on a residual neural network. The model is trained as a classifier on a multilingual keyword dataset extracted from Common Voice sentences and…

Audio and Speech Processing · Electrical Eng. & Systems 2023-04-20 Paul M. Reuter , Christian Rollwage , Bernd T. Meyer

Spoken keyword spotting (KWS) aims to identify keywords in audio for wide applications, especially on edge devices. Current small-footprint KWS systems focus on efficient model designs. However, their inference performance can decline in…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-21 Yang Xiao , Tianyi Peng , Yanghao Zhou , Rohan Kumar Das

Open-vocabulary keyword spotting (KWS), which allows users to customize keywords, has attracted increasingly more interest. However, existing methods based on acoustic models and post-processing train the acoustic model with ASR training…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-18 Ao Zhang , Pan Zhou , Kaixun Huang , Yong Zou , Ming Liu , Lei Xie

Keyword spotting (KWS) is a crucial function enabling the interaction with the many ubiquitous smart devices in our surroundings, either activating them through wake-word or directly as a human-computer interface. For many applications, KWS…

The performance of the keyword spotting (KWS) system based on audio modality, commonly measured in false alarms and false rejects, degrades significantly under the far field and noisy conditions. Therefore, audio-visual keyword spotting,…

Sound · Computer Science 2023-03-15 Ao Zhang , He Wang , Pengcheng Guo , Yihui Fu , Lei Xie , Yingying Gao , Shilei Zhang , Junlan Feng

Deep neural networks provide effective solutions to small-footprint keyword spotting (KWS). However, if training data is limited, it remains challenging to achieve robust and highly accurate KWS in real-world scenarios where unseen sounds…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-14 Menglong Xu , Shengqiang Li , Chengdong Liang , Xiao-Lei Zhang

Current keyword spotting systems primarily use phoneme-level matching to distinguish confusable words but ignore user-specific pronunciation traits like prosody (intonation, stress, rhythm). This paper presents ProKWS, a novel framework…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-20 Jianan Pan , Yuanming Zhang , Kejie Huang

In this paper, we propose DS-KWS, a two-stage framework for robust user-defined keyword spotting. It combines a CTC-based method with a streaming phoneme search module to locate candidate segments, followed by a QbyT-based method with a…

Sound · Computer Science 2025-10-14 Zhiqi Ai , Han Cheng , Yuxin Wang , Shiyi Mu , Shugong Xu , Yongjin Zhou

Smart audio devices are gated by an always-on lightweight keyword spotting program to reduce power consumption. It is however challenging to design models that have both high accuracy and low latency for accurate and fast responsiveness.…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-23 Bo Zhang , Wenfeng Li , Qingyuan Li , Weiji Zhuang , Xiangxiang Chu , Yujun Wang

Deep neural networks, such as the Deep-FSMN, have been widely studied for keyword spotting (KWS) applications while suffering expensive computation and storage. Therefore, network compression technologies like binarization are studied to…

Computation and Language · Computer Science 2023-02-07 Haotong Qin , Xudong Ma , Yifu Ding , Xiaoyang Li , Yang Zhang , Zejun Ma , Jiakai Wang , Jie Luo , Xianglong Liu

Open-vocabulary keyword spotting (KWS) in continuous speech streams holds significant practical value across a wide range of real-world applications. While increasing attention has been paid to the role of different modalities in KWS, their…

Sound · Computer Science 2025-12-18 Kewei Li , Yinan Zhong , Xiaotao Liang , Tianchi Dai , Shaofei Xue