English
Related papers

Related papers: Multiple-Instance, Cascaded Classification for Key…

200 papers

Smart audio devices are gated by an always-on lightweight keyword spotting program to reduce power consumption. It is however challenging to design models that have both high accuracy and low latency for accurate and fast responsiveness.…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-23 Bo Zhang , Wenfeng Li , Qingyuan Li , Weiji Zhuang , Xiangxiang Chu , Yujun Wang

Keyword spotting (KWS) plays a critical role in enabling speech-based user interactions on smart devices. Recent developments in the field of deep learning have led to wide adoption of convolutional neural networks (CNNs) in KWS systems due…

Keyword spotting (KWS) is essential for voice-driven applications, demanding both accuracy and efficiency. Traditional ASR-based KWS methods, such as greedy and beam search, explore the entire search space without explicitly prioritizing…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-01 Yu Xi , Haoyu Li , Xiaoyu Gu , Yidi Jiang , Kai Yu

Small footprint embedded devices require keyword spotters (KWS) with small model size and detection latency for enabling voice assistants. Such a keyword is often referred to as \textit{wake word} as it is used to wake up voice assistant…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-16 Christin Jose , Yuriy Mishchenko , Thibaud Senechal , Anish Shah , Alex Escott , Shiv Vitaladevuni

In this work we explore the latency and accuracy of keyword spotting (KWS) models in streaming and non-streaming modes on mobile phones. NN model conversion from non-streaming mode (model receives the whole input sequence and then returns…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-29 Oleg Rybakov , Natasha Kononenko , Niranjan Subrahmanya , Mirko Visontai , Stella Laurenzo

Keyword spotting is often implemented by keyword classifier to the encoder in acoustic models, enabling the classification of predefined or open vocabulary keywords. Although keyword spotting is a crucial task in various applications and…

Sound · Computer Science 2025-01-22 Myeonghoon Ryu , June-Woo Kim , Minseok Oh , Suji Lee , Han Park

User-defined keyword spotting (KWS) is crucial for personalized voice interaction, yet existing methods face several challenges: (1) insufficient discriminability among confusable words, (2) performance inconsistency across speakers with…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-22 Zhiqi Ai , Han Cheng , Shiyi Mu , Xinnuo Li , Yongjin Zhou , Shugong Xu

In this paper, we propose an attention-based end-to-end neural approach for small-footprint keyword spotting (KWS), which aims to simplify the pipelines of building a production-quality KWS system. Our model consists of an encoder and an…

Sound · Computer Science 2018-03-30 Changhao Shan , Junbo Zhang , Yujun Wang , Lei Xie

A keyword spotting (KWS) system determines the existence of, usually predefined, keyword in a continuous speech stream. This paper presents a query-by-example on-device KWS system which is user-specific. The proposed system consists of two…

Machine Learning · Computer Science 2020-01-15 Byeonggeun Kim , Mingu Lee , Jinkyu Lee , Yeonseok Kim , Kyuwoong Hwang

This report presents our audio event detection system submitted for Task 2, "Detection of rare sound events", of DCASE 2017 challenge. The proposed system is based on convolutional neural networks (CNNs) and deep neural networks (DNNs)…

Sound · Computer Science 2017-10-19 Huy Phan , Martin Krawczyk-Becker , Timo Gerkmann , Alfred Mertins

Custom keyword spotting (KWS) allows detecting user-defined spoken keywords from streaming audio. This is achieved by comparing the embeddings from voice enrollments and input audio. State-of-the-art custom KWS models are typically trained…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-06 Pai Zhu , Quan Wang , Dhruuv Agarwal , Kurt Partridge

Compensation for channel mismatch and noise interference is essential for robust automatic speech recognition. Enhanced speech has been introduced into the multi-condition training of acoustic models to improve their generalization ability.…

Sound · Computer Science 2022-11-24 Hung-Shin Lee , Pin-Yuan Chen , Yao-Fei Cheng , Yu Tsao , Hsin-Min Wang

Keyword spotting (KWS) is a key enabling technology for hands-free interaction in embedded and IoT devices, where stringent memory and energy constraints challenge the deployment of AI-enabeld devices. In this work, we systematically…

Designing an efficient keyword spotting (KWS) system that delivers exceptional performance on resource-constrained edge devices has long been a subject of significant attention. Existing KWS search algorithms typically follow a…

Audio and Speech Processing · Electrical Eng. & Systems 2024-03-21 Yu Xi , Hao Li , Baochen Yang , Haoyu Li , Hainan Xu , Kai Yu

Thanks to Deep Neural Networks (DNNs), the accuracy of Keyword Spotting (KWS) has made substantial progress. However, as KWS systems are usually implemented on edge devices, energy efficiency becomes a critical requirement besides…

Sound · Computer Science 2024-06-21 Shuai Wang , Dehao Zhang , Kexin Shi , Yuchen Wang , Wenjie Wei , Jibin Wu , Malu Zhang

Keyword Spotting (KWS) models on embedded devices should adapt fast to new user-defined words without forgetting previous ones. Embedded devices have limited storage and computational resources, thus, they cannot save samples or update…

Sound · Computer Science 2023-07-25 Umberto Michieli , Pablo Peso Parada , Mete Ozay

To segment a signal into blocks to be analyzed, few-shot keyword spotting (KWS) systems often utilize a sliding window of fixed size. Because of the varying lengths of different keywords or their spoken instances, choosing the right window…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-15 Kevin Wilkinghoff , Alessia Cornaggia-Urrigshardt

In this paper, we propose DS-KWS, a two-stage framework for robust user-defined keyword spotting. It combines a CTC-based method with a streaming phoneme search module to locate candidate segments, followed by a QbyT-based method with a…

Sound · Computer Science 2025-10-14 Zhiqi Ai , Han Cheng , Yuxin Wang , Shiyi Mu , Shugong Xu , Yongjin Zhou

We propose a novel approach for semi-supervised learning (SSL) designed to overcome distribution shifts between training and real-world data arising in the keyword spotting (KWS) task. Shifts from training data distribution are a key…

Sound · Computer Science 2022-07-15 Sree Hari Krishnan Parthasarathi , Lu Zeng , Christin Jose , Joseph Wang

Most of the existing neural-based models for keyword spotting (KWS) in smart devices require thousands of training samples to learn a decent audio representation. However, with the rising demand for smart devices to become more…