English
Related papers

Related papers: Sequence-to-sequence Models for Small-Footprint Ke…

200 papers

In this work, we propose small footprint Convolutional Recurrent Neural Network models applied to the problem of wakeword detection and augment them with scaled dot product attention. We find that false accepts compared to Convolutional…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-26 Mohammad Omar Khursheed , Christin Jose , Rajath Kumar , Gengshen Fu , Brian Kulis , Santosh Kumar Cheekatmalla

In this paper, we aim to improve the robustness of Keyword Spotting (KWS) systems in noisy environments while keeping a small memory footprint. We propose a new convolutional neural network (CNN) called FCA-Net, which combines mixer…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-30 Yuanxi Lin , Yuriy Evgenyevich Gapanyuk

Keyword spotting (KWS) is beneficial for voice-based user interactions with low-power devices at the edge. The edge devices are usually always-on, so edge computing brings bandwidth savings and privacy protection. The devices typically have…

Sound · Computer Science 2022-08-05 Jingyi Wang , Shengchen Li

Deep neural networks provide effective solutions to small-footprint keyword spotting (KWS). However, if training data is limited, it remains challenging to achieve robust and highly accurate KWS in real-world scenarios where unseen sounds…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-14 Menglong Xu , Shengqiang Li , Chengdong Liang , Xiao-Lei Zhang

Sequence-to-sequence attention-based models on subword units allow simple open-vocabulary end-to-end speech recognition. In this work, we show that such models can achieve competitive results on the Switchboard 300h and LibriSpeech 1000h…

Computation and Language · Computer Science 2019-08-06 Albert Zeyer , Kazuki Irie , Ralf Schlüter , Hermann Ney

Keyword spotting (KWS) is crucial for many speech-driven applications, but robust KWS in noisy environments remains challenging. Conventional systems often rely on single-channel inputs and a cascaded pipeline separating front-end…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-11 Rui Wang , Zhifei Zhang , Yu Gao , Xiaofeng Mou , Yi Xu

End-to-end approaches have recently become popular as a means of simplifying the training and deployment of speech recognition systems. However, they often require large amounts of data to perform well on large vocabulary tasks. With the…

Computation and Language · Computer Science 2019-03-25 Bertrand Higy , Peter Bell

In recent years, there has been a growing interest in designing small-footprint yet effective Connectionist Temporal Classification based keyword spotting (CTC-KWS) systems. They are typically deployed on low-resource computing platforms,…

Audio and Speech Processing · Electrical Eng. & Systems 2024-12-25 Yu Xi , Haoyu Li , Hao Li , Jiaqi Guo , Xu Li , Wen Ding , Kai Yu

This paper proposes a self-learning method to incrementally train (fine-tune) a personalized Keyword Spotting (KWS) model after the deployment on ultra-low power smart audio sensors. We address the fundamental problem of the absence of…

Sound · Computer Science 2025-03-10 Manuele Rusci , Francesco Paci , Marco Fariselli , Eric Flamand , Tinne Tuytelaars

A Multilingual Keyword Spotting (KWS) system detects spokenkeywords over multiple locales. Conventional monolingual KWSapproaches do not scale well to multilingual scenarios because ofhigh development/maintenance costs and lack of resource…

Computation and Language · Computer Science 2023-02-28 Pai Zhu , Hyun Jin Park , Alex Park , Angelo Scorza Scarpati , Ignacio Lopez Moreno

Evaluation of keyword spotting (KWS) systems that detect keywords in speech is a challenging task under realistic privacy constraints. The KWS is designed to only collect data when the keyword is present, limiting the availability of hard…

Few-shot keyword spotting (FS-KWS) models usually require large-scale annotated datasets to generalize to unseen target keywords. However, existing KWS datasets are limited in scale and gathering keyword-like labeled data is costly…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-06 Seunghan Yang , Byeonggeun Kim , Kyuhong Shim , Simyung Chang

Since Bahdanau et al. [1] first introduced attention for neural machine translation, most sequence-to-sequence models made use of attention mechanisms [2, 3, 4]. While they produce soft-alignment matrices that could be interpreted as…

Computation and Language · Computer Science 2019-09-12 Marcely Zanon Boito , Aline Villavicencio , Laurent Besacier

In this work, we propose Tiny-CRNN (Tiny Convolutional Recurrent Neural Network) models applied to the problem of wakeword detection, and augment them with scaled dot product attention. We find that, compared to Convolutional Neural Network…

Machine Learning · Computer Science 2021-10-01 Mohammad Omar Khursheed , Christin Jose , Rajath Kumar , Gengshen Fu , Brian Kulis , Santosh Kumar Cheekatmalla

One of the challenges in developing a high quality custom keyword spotting (KWS) model is the lengthy and expensive process of collecting training data covering a wide range of languages, phrases and speaking styles. We introduce Synth4Kws…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-06 Pai Zhu , Dhruuv Agarwal , Jacob W. Bartel , Kurt Partridge , Hyun Jin Park , Quan Wang

Keyword spotting (KWS) is an important technique for speech applications, which enables users to activate devices by speaking a keyword phrase. Although a phoneme classifier can be used for KWS, exploiting a large amount of transcribed data…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-23 Takuya Higuchi , Anmol Gupta , Chandra Dhir

It is generally believed that direct sequence-to-sequence (seq2seq) speech recognition models are competitive with hybrid models only when a large amount of data, at least a thousand hours, is available for training. In this paper, we show…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-21 Zoltán Tüske , George Saon , Kartik Audhkhasi , Brian Kingsbury

Sequence-to-sequence models, such as attention-based models in automatic speech recognition (ASR), are typically trained to optimize the cross-entropy criterion which corresponds to improving the log-likelihood of the data. However, system…

Computation and Language · Computer Science 2017-12-06 Rohit Prabhavalkar , Tara N. Sainath , Yonghui Wu , Patrick Nguyen , Zhifeng Chen , Chung-Cheng Chiu , Anjuli Kannan

User-defined keyword spotting (KWS) is crucial for personalized voice interaction, yet existing methods face several challenges: (1) insufficient discriminability among confusable words, (2) performance inconsistency across speakers with…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-22 Zhiqi Ai , Han Cheng , Shiyi Mu , Xinnuo Li , Yongjin Zhou , Shugong Xu

Keyword spotting (KWS) is an essential function that enables interaction with ubiquitous smart devices. However, in resource-limited devices, KWS models are often static and can thus not adapt to new scenarios, such as added keywords. To…