English
Related papers

Related papers: Metric Learning for User-defined Keyword Spotting

200 papers

Few-shot keyword spotting (KWS) aims to detect unknown keywords with limited training samples. A commonly used approach is the pre-training and fine-tuning framework. While effective in clean conditions, this approach struggles with mixed…

Sound · Computer Science 2024-07-09 Junming Yuan , Ying Shi , LanTian Li , Dong Wang , Askar Hamdulla

In this paper, we investigated a speech augmentation based unsupervised learning approach for keyword spotting (KWS) task. KWS is a useful speech application, yet also heavily depends on the labeled data. We designed a CNN-Attention…

Sound · Computer Science 2022-05-31 Jian Luo , Jianzong Wang , Ning Cheng , Haobin Tang , Jing Xiao

Conversational agents commonly utilize keyword spotting (KWS) to initiate voice interaction with the user. For user experience and privacy considerations, existing approaches to KWS largely focus on accuracy, which can often come at the…

Audio and Speech Processing · Electrical Eng. & Systems 2022-09-30 Christin Jose , Joseph Wang , Grant P. Strimel , Mohammad Omar Khursheed , Yuriy Mishchenko , Brian Kulis

Deep neural networks provide effective solutions to small-footprint keyword spotting (KWS). However, if training data is limited, it remains challenging to achieve robust and highly accurate KWS in real-world scenarios where unseen sounds…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-14 Menglong Xu , Shengqiang Li , Chengdong Liang , Xiao-Lei Zhang

This paper proposes a novel user-defined keyword spotting framework that accurately detects audio keywords based on text enrollment. Since audio data possesses additional acoustic information compared to text, there are discrepancies…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-23 Youkyum Kim , Jaemin Jung , Jihwan Park , Byeong-Yeol Kim , Joon Son Chung

Keyword Spotting (KWS) from speech signals is widely applied to perform fully hands-free speech recognition. The KWS network is designed as a small-footprint model so it can continuously be active. Recent efforts have explored dynamic…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-25 Donghyeon Kim , Kyungdeuk Ko , Jeonggi Kwak , David K. Han , Hanseok Ko

Despite their great performance over the years, handcrafted speech features are not necessarily optimal for any particular speech application. Consequently, with greater or lesser success, optimal filterbank learning has been studied for…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-02 Iván López-Espejo , Zheng-Hua Tan , Jesper Jensen

The keyword spotting (KWS) problem requires large amounts of real speech training data to achieve high accuracy across diverse populations. Utilizing large amounts of text-to-speech (TTS) synthesized data can reduce the cost and time…

Keyword spotting (KWS) is an important technique for speech applications, which enables users to activate devices by speaking a keyword phrase. Although a phoneme classifier can be used for KWS, exploiting a large amount of transcribed data…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-23 Takuya Higuchi , Anmol Gupta , Chandra Dhir

Catastrophic forgetting is a thorny challenge when updating keyword spotting (KWS) models after deployment. To tackle such challenges, we propose a progressive continual learning strategy for small-footprint spoken keyword spotting…

Computation and Language · Computer Science 2022-02-08 Yizheng Huang , Nana Hou , Nancy F. Chen

A keyword spotting (KWS) engine that is continuously running on device is exposed to various speech signals that are usually unseen before. It is a challenging problem to build a small-footprint and high-performing KWS model with robustness…

Sound · Computer Science 2024-08-27 Zhenyu Wang , Li Wan , Biqiao Zhang , Yiteng Huang , Shang-Wen Li , Ming Sun , Xin Lei , Zhaojun Yang

End-to-end (E2E) approaches to keyword search (KWS) are considerably simpler in terms of training and indexing complexity when compared to approaches which use the output of automatic speech recognition (ASR) systems. This simplification…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-08 Bolaji Yusuf , Murat Saraçlar

Keyword Spotting (KWS) remains challenging to achieve the trade-off between small footprint and high accuracy. Recently proposed metric learning approaches improved the generalizability of models for the KWS task, and 1D-CNN based KWS…

Sound · Computer Science 2021-08-13 Li Wang , Rongzhi Gu , Nuo Chen , Yuexian Zou

Keyword spotting (KWS) offers a vital mechanism to identify spoken commands in voice-enabled systems, where user demands often shift, requiring models to learn new keywords continually over time. However, a major problem is catastrophic…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-20 Yang Xiao , Tianyi Peng , Rohan Kumar Das , Yuchen Hu , Huiping Zhuang

Keyword spotting (KWS) is experiencing an upswing due to the pervasiveness of small electronic devices that allow interaction with them via speech. Often, KWS systems are speaker-independent, which means that any person --user or not--…

Sound · Computer Science 2019-06-27 Iván López-Espejo , Zheng-Hua Tan , Jesper Jensen

In this paper, we propose a novel end-to-end user-defined keyword spotting method that utilizes linguistically corresponding patterns between speech and text sequences. Unlike previous approaches requiring speech keyword enrollment, our…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-04 Hyeon-Kyeong Shin , Hyewon Han , Doyeon Kim , Soo-Whan Chung , Hong-Goo Kang

Open vocabulary keyword spotting is a crucial and challenging task in automatic speech recognition (ASR) that focuses on detecting user-defined keywords within a spoken utterance. Keyword spotting methods commonly map the audio utterance…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-18 Aviv Navon , Aviv Shamsian , Neta Glazer , Gill Hetz , Joseph Keshet

This paper explores the use of TTS synthesized training data for KWS (keyword spotting) task while minimizing development cost and time. Keyword spotting models require a huge amount of training data to be accurate, and obtaining such…

With the increasing prevalence of voice-activated devices and applications, keyword spotting (KWS) models enable users to interact with technology hands-free, enhancing convenience and accessibility in various contexts. Deploying KWS models…

Audio and Speech Processing · Electrical Eng. & Systems 2025-04-29 Jonathan Svirsky , Uri Shaham , Ofir Lindenbaum

Keyword spotting (KWS) is one of the speech recognition tasks most sensitive to the quality of the feature representation. However, the research on KWS has traditionally focused on new model topologies, putting little emphasis on other…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-08 Douglas Baptista de Souza , Khaled Jamal Bakri , Fernanda Ferreira , Juliana Inacio