English
Related papers

Related papers: Query-by-example on-device keyword spotting

200 papers

This paper explores the use of TTS synthesized training data for KWS (keyword spotting) task while minimizing development cost and time. Keyword spotting models require a huge amount of training data to be accurate, and obtaining such…

Connectionist Temporal Classification (CTC), a non-autoregressive training criterion, is widely used in online keyword spotting (KWS). However, existing CTC-based KWS decoding strategies either rely on Automatic Speech Recognition (ASR),…

Audio and Speech Processing · Electrical Eng. & Systems 2024-12-25 Yu Xi , Haoyu Li , Xiaoyu Gu , Hao Li , Yidi Jiang , Kai Yu

In recent years, there has been a growing interest in designing small-footprint yet effective Connectionist Temporal Classification based keyword spotting (CTC-KWS) systems. They are typically deployed on low-resource computing platforms,…

Audio and Speech Processing · Electrical Eng. & Systems 2024-12-25 Yu Xi , Haoyu Li , Hao Li , Jiaqi Guo , Xu Li , Wen Ding , Kai Yu

Real-world complex acoustic environments especially the ones with a low signal-to-noise ratio (SNR) will bring tremendous challenges to a keyword spotting (KWS) system. Inspired by the recent advances of neural speech enhancement and…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-14 Shubo Lv , Xiong Wang , Sining Sun , Long Ma , Lei Xie

Keyword spotting (KWS) and speaker verification (SV) are two important tasks in speech applications. Research shows that the state-of-art KWS and SV models are trained independently using different datasets since they expect to learn…

Sound · Computer Science 2022-04-01 Li Wang , Rongzhi Gu , Weiji Zhuang , Peng Gao , Yujun Wang , Yuexian Zou

Catastrophic forgetting is a thorny challenge when updating keyword spotting (KWS) models after deployment. This problem will be more challenging if KWS models are further required for edge devices due to their limited memory. To alleviate…

Sound · Computer Science 2022-07-01 Yang Xiao , Nana Hou , Eng Siong Chng

Most of the existing neural-based models for keyword spotting (KWS) in smart devices require thousands of training samples to learn a decent audio representation. However, with the rising demand for smart devices to become more…

In this study, we develop the keyword spotting (KWS) and acoustic model (AM) components in a far-field speaker system. Specifically, we use teacher-student (T/S) learning to adapt a close-talk well-trained production AM to far-field by…

Computation and Language · Computer Science 2018-04-17 Jinyu Li , Rui Zhao , Zhuo Chen , Changliang Liu , Xiong Xiao , Guoli Ye , Yifan Gong

This paper focuses on wake on intent (WOI) techniques for platforms with limited compute and memory. Our approach of utterance-level intent classification is based on a sequence of keywords in the utterance instead of a single fixed key…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-18 Wenda Chen , Jonathan Huang , Mark Hasegawa-Johnson

Punctuation and word casing prediction are necessary for automatic speech recognition (ASR). With the popularity of on-device end-to-end streaming ASR systems, the on-device punctuation and word casing prediction become a necessity while we…

Computation and Language · Computer Science 2024-07-19 Jian You , Xiangfeng Li

Continuous Speech Keyword Spotting (CSKS) is the problem of spotting keywords in recorded conversations, when a small number of instances of keywords are available in training data. Unlike the more common Keyword Spotting, where an…

Sound · Computer Science 2019-01-15 Harshita Seth , Pulkit Kumar , Muktabh Mayank Srivastava

Within the audio research community and the industry, keyword spotting (KWS) and audio tagging (AT) are seen as two distinct tasks and research fields. However, from a technical point of view, both of these tasks are identical: they predict…

Sound · Computer Science 2022-09-26 Heinrich Dinkel , Yongqing Wang , Zhiyong Yan , Junbo Zhang , Yujun Wang

In this paper we explore the possibility of maximizing the information represented in spectrograms by making the spectrogram basis functions trainable. We experiment with two different tasks, namely keyword spotting (KWS) and automatic…

Sound · Computer Science 2022-04-26 Kwan Yee Heung , Kin Wai Cheuk , Dorien Herremans

Query-by-example search often uses dynamic time warping (DTW) for comparing queries and proposed matching segments. Recent work has shown that comparing speech segments by representing them as fixed-dimensional vectors --- acoustic word…

Computation and Language · Computer Science 2017-06-14 Shane Settle , Keith Levin , Herman Kamper , Karen Livescu

Keyword Spotting (KWS) remains challenging to achieve the trade-off between small footprint and high accuracy. Recently proposed metric learning approaches improved the generalizability of models for the KWS task, and 1D-CNN based KWS…

Sound · Computer Science 2021-08-13 Li Wang , Rongzhi Gu , Nuo Chen , Yuexian Zou

This literature review surveys the advancements of keyword spotting (KWS) technologies, specifically focusing on Urdu, Pakistan's low-resource language (LRL), which has complex phonetics. Despite the global strides in speech technology,…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-26 Syed Muhammad Aqdas Rizvi

We present a cascade architecture for keyword spotting with speaker verification on mobile devices. By pairing a small computational footprint with specialized digital signal processing (DSP) chips, we are able to achieve low power…

Sound · Computer Science 2017-12-12 Alexander Gruenstein , Raziel Alvarez , Chris Thornton , Mohammadali Ghodrat

Keyword spotting (KWS) identifies words for voice assistants, but environmental noise frequently reduces accuracy. Standard adaptation fixes this issue and strictly requires original or labeled audio. Test time adaptation (TTA) solves this…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-09 Hanyu Ding , Yang Xiao , Jiaheng Dong , Ting Dang

This paper describes a novel method of live keyword spotting using a two-stage time delay neural network. The model is trained using transfer learning: initial training with phone targets from a large speech corpus is followed by training…

Audio and Speech Processing · Electrical Eng. & Systems 2018-08-29 Samuel Myer , Vikrant Singh Tomar

In this paper, we propose a deep convolutional neural network-based acoustic word embedding system on code-switching query by example spoken term detection. Different from previous configurations, we combine audio data in two languages for…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-26 Murong Ma , Haiwei Wu , Xuyang Wang , Lin Yang , Junjie Wang , Ming Li