English
Related papers

Related papers: Matching Latent Encoding for Audio-Text based Keyw…

200 papers

Learning to recognize new keywords with just a few examples is essential for personalizing keyword spotting (KWS) models to a user's choice of keywords. However, modern KWS models are typically trained on large datasets and restricted to a…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-07 Abhijeet Awasthi , Kevin Kilgour , Hassan Rom

The performance of keyword spotting (KWS), measured in false alarms and false rejects, degrades significantly under the far field and noisy conditions. In this paper, we propose a multi-look neural network modeling for speech enhancement…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-22 Meng Yu , Xuan Ji , Bo Wu , Dan Su , Dong Yu

Real-world complex acoustic environments especially the ones with a low signal-to-noise ratio (SNR) will bring tremendous challenges to a keyword spotting (KWS) system. Inspired by the recent advances of neural speech enhancement and…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-14 Shubo Lv , Xiong Wang , Sining Sun , Long Ma , Lei Xie

The performance of the keyword spotting (KWS) system based on audio modality, commonly measured in false alarms and false rejects, degrades significantly under the far field and noisy conditions. Therefore, audio-visual keyword spotting,…

Sound · Computer Science 2023-03-15 Ao Zhang , He Wang , Pengcheng Guo , Yihui Fu , Lei Xie , Yingying Gao , Shilei Zhang , Junlan Feng

This paper introduces the system submitted by the DKU-SMIIP team for the Auto-KWS 2021 Challenge. Our implementation consists of a two-stage keyword spotting system based on query-by-example spoken term detection and a speaker verification…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-13 Yechen Wang , Yan Jia , Murong Ma , Zexin Cai , Ming Li

In this paper, we propose an attention-based end-to-end model for multi-channel keyword spotting (KWS), which is trained to optimize the KWS result directly. As a result, our model outperforms the baseline model with signal pre-processing…

Sound · Computer Science 2018-11-06 Haitong Zhang , Junbo Zhang , Yujun Wang

Keyword Spotting (KWS) systems with small footprint models deployed on edge devices face significant accuracy and robustness challenges due to domain shifts caused by varying noise and recording conditions. To address this, we propose a…

Sound · Computer Science 2026-01-23 Prakash Dhungana , Sayed Ahmad Salehi

Keyword Spotting (KWS) enables speech-based user interaction on smart devices. Always-on and battery-powered application scenarios for smart devices put constraints on hardware resources and power consumption, while also demanding high…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-05 Simon Mittermaier , Ludwig Kürzinger , Bernd Waschneck , Gerhard Rigoll

Designing an efficient keyword spotting (KWS) system that delivers exceptional performance on resource-constrained edge devices has long been a subject of significant attention. Existing KWS search algorithms typically follow a…

Audio and Speech Processing · Electrical Eng. & Systems 2024-03-21 Yu Xi , Hao Li , Baochen Yang , Haoyu Li , Hainan Xu , Kai Yu

Keyword spotting (KWS) is a critical component for enabling speech based user interactions on smart devices. It requires real-time response and high accuracy for good user experience. Recently, neural networks have become an attractive…

Sound · Computer Science 2018-02-16 Yundong Zhang , Naveen Suda , Liangzhen Lai , Vikas Chandra

In this paper, we propose an attention-based end-to-end neural approach for small-footprint keyword spotting (KWS), which aims to simplify the pipelines of building a production-quality KWS system. Our model consists of an encoder and an…

Sound · Computer Science 2018-03-30 Changhao Shan , Junbo Zhang , Yujun Wang , Lei Xie

End-to-end (E2E) systems have achieved competitive results compared to conventional hybrid hidden Markov model (HMM)-deep neural network based automatic speech recognition (ASR) systems. Such E2E systems are attractive due to the lack of…

Computation and Language · Computer Science 2018-02-14 Kartik Audhkhasi , Andrew Rosenberg , Abhinav Sethy , Bhuvana Ramabhadran , Brian Kingsbury

Detecting occurrences of keywords with keyword spotting (KWS) systems requires thresholding continuous detection scores. Selecting appropriate thresholds is a non-trivial task, typically relying on optimizing performance on a validation…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-23 Kevin Wilkinghoff , Alessia Cornaggia-Urrigshardt , Zheng-Hua Tan

Acoustic Word Embeddings (AWEs) improve the efficiency of speech retrieval tasks such as Spoken Term Detection (STD) and Keyword Spotting (KWS). However, existing approaches suffer from limitations, including unimodal supervision, disjoint…

Sound · Computer Science 2025-12-17 Ramesh Gundluru , Shubham Gupta , Sri Rama Murty K

Custom keyword spotting (KWS) allows detecting user-defined spoken keywords from streaming audio. This is achieved by comparing the embeddings from voice enrollments and input audio. State-of-the-art custom KWS models are typically trained…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-06 Pai Zhu , Quan Wang , Dhruuv Agarwal , Kurt Partridge

A keyword spotting (KWS) engine that is continuously running on device is exposed to various speech signals that are usually unseen before. It is a challenging problem to build a small-footprint and high-performing KWS model with robustness…

Sound · Computer Science 2024-08-27 Zhenyu Wang , Li Wan , Biqiao Zhang , Yiteng Huang , Shang-Wen Li , Ming Sun , Xin Lei , Zhaojun Yang

With the increasing prevalence of voice-activated devices and applications, keyword spotting (KWS) models enable users to interact with technology hands-free, enhancing convenience and accessibility in various contexts. Deploying KWS models…

Audio and Speech Processing · Electrical Eng. & Systems 2025-04-29 Jonathan Svirsky , Uri Shaham , Ofir Lindenbaum

In the paper we present an architecture of a keyword spotting (KWS) system that is based on modern neural networks, yields good performance on various types of speech data and can run very fast. We focus mainly on the last aspect and…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-09 Jan Nouza , Petr Cerva , Jindrich Zdansky

Open-vocabulary keyword spotting (KWS), which allows users to customize keywords, has attracted increasingly more interest. However, existing methods based on acoustic models and post-processing train the acoustic model with ASR training…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-18 Ao Zhang , Pan Zhou , Kaixun Huang , Yong Zou , Ming Liu , Lei Xie

For text enrollment-based open-vocabulary keyword spotting (KWS), acoustic and text embeddings are typically compared at either the phoneme or utterance level. To facilitate this, we optimize acoustic and text encoders using deep metric…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-26 Youngmoon Jung , Yong-Hyeok Lee , Myunghun Jung , Jaeyoung Roh , Chang Woo Han , Hoon-Young Cho