English
Related papers

Related papers: Temporal Convolution for Real-time Keyword Spottin…

200 papers

Keyword Spotting (KWS) from speech signals is widely applied to perform fully hands-free speech recognition. The KWS network is designed as a small-footprint model so it can continuously be active. Recent efforts have explored dynamic…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-25 Donghyeon Kim , Kyungdeuk Ko , Jeonggi Kwak , David K. Han , Hanseok Ko

In this paper, we present a novel approach to adapt a sequence-to-sequence Transformer-Transducer ASR system to the keyword spotting (KWS) task. We achieve this by replacing the keyword in the text transcription with a special token <kw>…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-15 Beltrán Labrador , Guanlong Zhao , Ignacio López Moreno , Angelo Scorza Scarpati , Liam Fowl , Quan Wang

In this paper, we propose several methods that incorporate vocal tract length (VTL) warped features for spoken keyword spotting (KWS). The first method, VTL-independent KWS, involves training a single deep neural network (DNN) that utilizes…

Sound · Computer Science 2025-01-08 Achintya kr. Sarkar , Priyanka Dwivedi , Zheng-Hua Tan

The performance of the keyword spotting (KWS) system based on audio modality, commonly measured in false alarms and false rejects, degrades significantly under the far field and noisy conditions. Therefore, audio-visual keyword spotting,…

Sound · Computer Science 2023-03-15 Ao Zhang , He Wang , Pengcheng Guo , Yihui Fu , Lei Xie , Yingying Gao , Shilei Zhang , Junlan Feng

Fixed-point (FXP) inference has proven suitable for embedded devices with limited computational resources, and yet model training is continually performed in floating-point (FLP). FXP training has not been fully explored and the non-trivial…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-08 Sashank Macha , Om Oza , Alex Escott , Francesco Caliva , Robbie Armitano , Santosh Kumar Cheekatmalla , Sree Hari Krishnan Parthasarathi , Yuzong Liu

We explore Neural Networks (NNs) for keyword spotting (KWS) on IoT devices like smart speakers and wearables. Since we target to execute our NN on a constrained memory and computation footprint, we propose a CNN design that. (i) uses a…

Machine Learning · Computer Science 2021-01-05 Rakesh Dhakshinamurthy

Keyword Spotting (KWS) is an essential component in a smart device for alerting the system when a user prompts it with a command. As these devices are typically constrained by computational and energy resources, the KWS model should be…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-24 Donghyeon Kim , Kyungdeuk Ko , David K. Han , Hanseok Ko

Recognizing a particular command or a keyword, keyword spotting has been widely used in many voice interfaces such as Amazon's Alexa and Google Home. In order to recognize a set of keywords, most of the recent deep learning based approaches…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-14 Archit Parnami , Minwoo Lee

Open-vocabulary keyword spotting (KWS), which allows users to customize keywords, has attracted increasingly more interest. However, existing methods based on acoustic models and post-processing train the acoustic model with ASR training…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-18 Ao Zhang , Pan Zhou , Kaixun Huang , Yong Zou , Ming Liu , Lei Xie

The goal of this work is to automatically determine whether and when a word of interest is spoken by a talking face, with or without the audio. We propose a zero-shot method suitable for in the wild videos. Our key contributions are: (1) a…

Computer Vision and Pattern Recognition · Computer Science 2020-09-07 Liliane Momeni , Triantafyllos Afouras , Themos Stafylakis , Samuel Albanie , Andrew Zisserman

Keyword Spotting (KWS) models are becoming increasingly integrated into various systems, e.g. voice assistants. To achieve satisfactory performance, these models typically rely on a large amount of labelled data, limiting their applications…

Sound · Computer Science 2023-05-25 Holger Severin Bovbjerg , Zheng-Hua Tan

Spoken keyword spotting (KWS) is the task of identifying a keyword in an audio stream and is widely used in smart devices at the edge in order to activate voice assistants and perform hands-free tasks. The task is daunting as there is a…

Computation and Language · Computer Science 2024-05-07 Mahmoud Salhab , Haidar Harmanani

User-defined keyword spotting (KWS) is crucial for personalized voice interaction, yet existing methods face several challenges: (1) insufficient discriminability among confusable words, (2) performance inconsistency across speakers with…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-22 Zhiqi Ai , Han Cheng , Shiyi Mu , Xinnuo Li , Yongjin Zhou , Shugong Xu

In this paper, we propose an attention-based end-to-end neural approach for small-footprint keyword spotting (KWS), which aims to simplify the pipelines of building a production-quality KWS system. Our model consists of an encoder and an…

Sound · Computer Science 2018-03-30 Changhao Shan , Junbo Zhang , Yujun Wang , Lei Xie

This paper describes a novel method of live keyword spotting using a two-stage time delay neural network. The model is trained using transfer learning: initial training with phone targets from a large speech corpus is followed by training…

Audio and Speech Processing · Electrical Eng. & Systems 2018-08-29 Samuel Myer , Vikrant Singh Tomar

This paper proposes a novel user-defined keyword spotting framework that accurately detects audio keywords based on text enrollment. Since audio data possesses additional acoustic information compared to text, there are discrepancies…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-23 Youkyum Kim , Jaemin Jung , Jihwan Park , Byeong-Yeol Kim , Joon Son Chung

In order to maximize detection precision rate as well as the recall rate, this paper proposes an in-vehicle multi-source fusion scheme in Keyword Spotting (KWS) System for vehicle applications. Vehicle information, as a new source for the…

Machine Learning · Computer Science 2019-02-19 Yue Tan , Kan Zheng , Lei Lei

This paper introduces a novel approach for streaming openvocabulary keyword spotting (KWS) with text-based keyword enrollment. For every input frame, the proposed method finds the optimal alignment ending at the frame using connectionist…

Sound · Computer Science 2024-09-27 Sichen Jin , Youngmoon Jung , Seungjin Lee , Jaeyoung Roh , Changwoo Han , Hoonyoung Cho

The emergence of Artificial Intelligence (AI) driven Keyword Spotting (KWS) technologies has revolutionized human to machine interaction. Yet, the challenge of end-to-end energy efficiency, memory footprint and system complexity of current…

Audio and Speech Processing · Electrical Eng. & Systems 2021-01-28 Jie Lei , Tousif Rahman , Rishad Shafik , Adrian Wheeldon , Alex Yakovlev , Ole-Christoffer Granmo , Fahim Kawsar , Akhil Mathur

The goal of this work is to detect new spoken terms defined by users. While most previous works address Keyword Spotting (KWS) as a closed-set classification problem, this limits their transferability to unseen terms. The ability to define…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-02 Jaemin Jung , Youkyum Kim , Jihwan Park , Youshin Lim , Byeong-Yeol Kim , Youngjoon Jang , Joon Son Chung