English
Related papers

Related papers: Streaming Small-Footprint Keyword Spotting using S…

200 papers

Recently, the recurrent neural network transducer (RNN-T) architecture has become an emerging trend in end-to-end automatic speech recognition research due to its advantages of being capable for online streaming speech recognition. However,…

Computation and Language · Computer Science 2020-05-05 Hu Hu , Rui Zhao , Jinyu Li , Liang Lu , Yifan Gong

In this paper, we propose an attention-based end-to-end neural approach for small-footprint keyword spotting (KWS), which aims to simplify the pipelines of building a production-quality KWS system. Our model consists of an encoder and an…

Sound · Computer Science 2018-03-30 Changhao Shan , Junbo Zhang , Yujun Wang , Lei Xie

The RNN-Transducers and improved attention-based encoder-decoder models are widely applied to streaming speech recognition. Compared with these two end-to-end models, the CTC model is more efficient in training and inference. However, it…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-06 Zhengkun Tian , Jiangyan Yi , Ye Bai , Jianhua Tao , Shuai Zhang , Zhengqi Wen

In the last few years, an emerging trend in automatic speech recognition research is the study of end-to-end (E2E) systems. Connectionist Temporal Classification (CTC), Attention Encoder-Decoder (AED), and RNN Transducer (RNN-T) are the…

Computation and Language · Computer Science 2019-09-30 Jinyu Li , Rui Zhao , Hu Hu , Yifan Gong

Keyword spotting is an important research field because it plays a key role in device wake-up and user interaction on smart devices. However, it is challenging to minimize errors while operating efficiently in devices with limited resources…

Sound · Computer Science 2023-07-06 Byeonggeun Kim , Simyung Chang , Jinkyu Lee , Dooyong Sung

In this paper, we propose a sequence-to-sequence model for keyword spotting (KWS). Compared with other end-to-end architectures for KWS, our model simplifies the pipelines of production-quality KWS system and satisfies the requirement of…

Sound · Computer Science 2018-11-02 Haitong Zhang , Junbo Zhang , Yujun Wang

Open-vocabulary keyword spotting (KWS) refers to the task of detecting words or terms within speech recordings, regardless of whether they were included in the training data. This paper introduces an open-vocabulary keyword spotting model…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-08 Yael Segal-Feldman , Ann R. Bradlow , Matthew Goldrick , Joseph Keshet

Recent studies reveal the potential of recurrent neural network transducer (RNN-T) for end-to-end (E2E) speech recognition. Among some most popular E2E systems including RNN-T, Attention Encoder-Decoder (AED), and Connectionist Temporal…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-19 Bin Wang , Yan Yin , Hui Lin

In this paper we present an end-to-end speech recognition model with Transformer encoders that can be used in a streaming speech recognition system. Transformer computation blocks based on self-attention are used to encode both audio and…

Audio and Speech Processing · Electrical Eng. & Systems 2020-02-18 Qian Zhang , Han Lu , Hasim Sak , Anshuman Tripathi , Erik McDermott , Stephen Koo , Shankar Kumar

This paper develops a model that addresses sentence embedding, a hot topic in current natural language processing research, using recurrent neural networks with Long Short-Term Memory (LSTM) cells. Due to its ability to capture long term…

Computation and Language · Computer Science 2016-11-18 Hamid Palangi , Li Deng , Yelong Shen , Jianfeng Gao , Xiaodong He , Jianshu Chen , Xinying Song , Rabab Ward

Popular solutions to Named Entity Recognition (NER) include conditional random fields, sequence-to-sequence models, or utilizing the question-answering framework. However, they are not suitable for nested and overlapping spans with large…

Computation and Language · Computer Science 2022-03-08 Hagen Soltau , Izhak Shafran , Mingqiu Wang , Laurent El Shafey

Models based on attention mechanisms have shown unprecedented speech recognition performance. However, they are computationally expensive and unnecessarily complex for keyword spotting, a task targeted to small-footprint devices. This work…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-02 Biel Tura , Santiago Escuder , Ferran Diego , Carlos Segura , Jordi Luque

Recurrent Neural Networks (RNNs) have become the standard modeling technique for sequence data, and are used in a number of novel text-to-speech models. However, training a TTS model including RNN components has certain requirements for GPU…

Computation and Language · Computer Science 2023-04-18 Ziqi Liang

In this paper, we present a novel approach to adapt a sequence-to-sequence Transformer-Transducer ASR system to the keyword spotting (KWS) task. We achieve this by replacing the keyword in the text transcription with a special token <kw>…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-15 Beltrán Labrador , Guanlong Zhao , Ignacio López Moreno , Angelo Scorza Scarpati , Liam Fowl , Quan Wang

In this work, we propose Tiny-CRNN (Tiny Convolutional Recurrent Neural Network) models applied to the problem of wakeword detection, and augment them with scaled dot product attention. We find that, compared to Convolutional Neural Network…

Machine Learning · Computer Science 2021-10-01 Mohammad Omar Khursheed , Christin Jose , Rajath Kumar , Gengshen Fu , Brian Kulis , Santosh Kumar Cheekatmalla

Keyword spotting (KWS) constitutes a major component of human-technology interfaces. Maximizing the detection accuracy at a low false alarm (FA) rate, while minimizing the footprint size, latency and complexity are the goals for KWS.…

Computation and Language · Computer Science 2017-07-06 Sercan O. Arik , Markus Kliegl , Rewon Child , Joel Hestness , Andrew Gibiansky , Chris Fougner , Ryan Prenger , Adam Coates

In this paper, we propose a novel end-to-end user-defined keyword spotting method that utilizes linguistically corresponding patterns between speech and text sequences. Unlike previous approaches requiring speech keyword enrollment, our…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-04 Hyeon-Kyeong Shin , Hyewon Han , Doyeon Kim , Soo-Whan Chung , Hong-Goo Kang

Having a sequence-to-sequence model which can operate in an online fashion is important for streaming applications such as Voice Search. Neural transducer is a streaming sequence-to-sequence model, but has shown a significant degradation in…

Computation and Language · Computer Science 2017-12-06 Tara N. Sainath , Chung-Cheng Chiu , Rohit Prabhavalkar , Anjuli Kannan , Yonghui Wu , Patrick Nguyen , Zhifeng Chen

The attention-based Transformer model has achieved promising results for speech recognition (SR) in the offline mode. However, in the streaming mode, the Transformer model usually incurs significant latency to maintain its recognition…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-05 Chengyi Wang , Yu Wu , Shujie Liu , Jinyu Li , Liang Lu , Guoli Ye , Ming Zhou

Language identification is critical for many downstream tasks in automatic speech recognition (ASR), and is beneficial to integrate into multilingual end-to-end ASR as an additional task. In this paper, we propose to modify the structure of…

Audio and Speech Processing · Electrical Eng. & Systems 2022-09-14 Chao Zhang , Bo Li , Tara Sainath , Trevor Strohman , Sepand Mavandadi , Shuo-yiin Chang , Parisa Haghani