English
Related papers

Related papers: Efficient keyword spotting using time delay neural…

200 papers

In this paper, we consider the task of spotting spoken keywords in silent video sequences -- also known as visual keyword spotting. To this end, we investigate Transformer-based models that ingest two streams, a visual encoding of the video…

Computer Vision and Pattern Recognition · Computer Science 2021-11-01 K R Prajwal , Liliane Momeni , Triantafyllos Afouras , Andrew Zisserman

The goal of this work is to detect new spoken terms defined by users. While most previous works address Keyword Spotting (KWS) as a closed-set classification problem, this limits their transferability to unseen terms. The ability to define…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-02 Jaemin Jung , Youkyum Kim , Jihwan Park , Youshin Lim , Byeong-Yeol Kim , Youngjoon Jang , Joon Son Chung

Keyword spotting aims to identify specific keyword audio utterances. In recent years, deep convolutional neural networks have been widely utilized in keyword spotting systems. However, their model architectures are mainly based on off-the…

Machine Learning · Computer Science 2021-06-08 Tong Mo , Bang Liu

We introduce a few-shot transfer learning method for keyword spotting in any language. Leveraging open speech corpora in nine languages, we automate the extraction of a large multilingual keyword bank and use it to train an embedding model.…

Computation and Language · Computer Science 2021-09-13 Mark Mazumder , Colby Banbury , Josh Meyer , Pete Warden , Vijay Janapa Reddi

In this paper, we propose DS-KWS, a two-stage framework for robust user-defined keyword spotting. It combines a CTC-based method with a streaming phoneme search module to locate candidate segments, followed by a QbyT-based method with a…

Sound · Computer Science 2025-10-14 Zhiqi Ai , Han Cheng , Yuxin Wang , Shiyi Mu , Shugong Xu , Yongjin Zhou

We present a system for keyword spotting that, except for a frontend component for feature generation, it is entirely contained in a deep neural network (DNN) model trained "end-to-end" to predict the presence of the keyword in a stream of…

Computation and Language · Computer Science 2019-02-19 Alvarez Raziel , Park Hyun-Jin

In this paper, we propose a novel end-to-end user-defined keyword spotting method that utilizes linguistically corresponding patterns between speech and text sequences. Unlike previous approaches requiring speech keyword enrollment, our…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-04 Hyeon-Kyeong Shin , Hyewon Han , Doyeon Kim , Soo-Whan Chung , Hong-Goo Kang

As an important part of speech recognition technology, automatic speech keyword recognition has been intensively studied in recent years. Such technology becomes especially pivotal under situations with limited infrastructures and…

Machine Learning · Computer Science 2019-07-11 Ruisen Luo , Tianran Sun , Chen Wang , Miao Du , Zuodong Tang , Kai Zhou , Xiaofeng Gong , Xiaomei Yang

Till now, attention-based models have been used with great success in the keyword spotting problem domain. However, in light of recent advances in deep learning, the question arises whether self-attention is truly irreplaceable for…

Machine Learning · Computer Science 2022-04-12 Mashrur M. Morshed , Ahmad Omar Ahsan

Keyword spotting (KWS) on mobile devices generally requires a small memory footprint. However, most current models still maintain a large number of parameters in order to ensure good performance. To solve this problem, this paper proposes a…

Sound · Computer Science 2021-09-02 Shenghua Hu , Jing Wang , Yujun Wang , Lidong Yang , Wenjing Yang

Automatic speech recognition systems have created exciting possibilities for applications, however they also enable opportunities for systematic eavesdropping. We propose a method to camouflage a person's voice over-the-air from these…

Sound · Computer Science 2022-02-18 Mia Chiquier , Chengzhi Mao , Carl Vondrick

The mechanism proposed here is for real-time speaker change detection in conversations, which firstly trains a neural network text-independent speaker classifier using in-domain speaker data. Through the network, features of conversational…

Sound · Computer Science 2017-03-20 Zhenhao Ge , Ananth N. Iyer , Srinath Cheluvaraja , Aravind Ganapathiraju

Keyword spotting is a process of finding some specific words or phrases in recorded speeches by computers. Deep neural network algorithms, as a powerful engine, can handle this problem if they are trained over an appropriate dataset. To…

Sound · Computer Science 2021-01-01 Amir Mohammad Rostami , Ali Karimi , Mohammad Ali Akhaee

The Transformer architecture has been successful across many domains, including natural language processing, computer vision and speech recognition. In keyword spotting, self-attention has primarily been used on top of convolutional or…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-11 Axel Berg , Mark O'Connor , Miguel Tairum Cruz

We present dual-attention neural biasing, an architecture designed to boost Wake Words (WW) recognition and improve inference time latency on speech recognition tasks. This architecture enables a dynamic switch for its runtime compute paths…

Keyword spotting in edge devices is becoming increasingly important as voice-activated assistants are widely used. However, its deployment is often limited by the extreme low-power constraints of the target embedded systems. Here, we…

Neural and Evolutionary Computing · Computer Science 2025-03-20 Alejandro Pequeño-Zurro , Lyes Khacef , Stefano Panzeri , Elisabetta Chicca

While speech interaction finds widespread utility within the Extended Reality (XR) domain, conventional vocal speech keyword spotting systems continue to grapple with formidable challenges, including suboptimal performance in noisy…

Human-Computer Interaction · Computer Science 2024-01-29 Zhuojiang Cai , Yuhan Ma , Feng Lu

Smart audio devices are gated by an always-on lightweight keyword spotting program to reduce power consumption. It is however challenging to design models that have both high accuracy and low latency for accurate and fast responsiveness.…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-23 Bo Zhang , Wenfeng Li , Qingyuan Li , Weiji Zhuang , Xiangxiang Chu , Yujun Wang

Most existing keyword spotting research focuses on conditions with slight or moderate noise. In this paper, we try to tackle a more challenging task: detecting keywords buried under strong interfering speech (10 times higher than the…

Sound · Computer Science 2023-10-10 Ying Shi , Dong Wang , Lantian Li , Jiqing Han , Shi Yin

This study addresses the task of performing robust and reliable time-delay estimation in signals in noisy and reverberating environments. In contrast to the popular signal processing based methods, this paper proposes to transform the input…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-03 Akshay Raina , Vipul Arora