English
Related papers

Related papers: End-to-end Keyword Spotting using Neural Architect…

200 papers

The performance of the keyword spotting (KWS) system based on audio modality, commonly measured in false alarms and false rejects, degrades significantly under the far field and noisy conditions. Therefore, audio-visual keyword spotting,…

Sound · Computer Science 2023-03-15 Ao Zhang , He Wang , Pengcheng Guo , Yihui Fu , Lei Xie , Yingying Gao , Shilei Zhang , Junlan Feng

Neural Architecture Search (NAS) is a popular tool for automatically generating Neural Network (NN) architectures. In early NAS works, these tools typically optimized NN architectures for a single metric, such as accuracy. However, in the…

Neural and Evolutionary Computing · Computer Science 2023-04-05 Emil Njor , Jan Madsen , Xenofon Fafoutis

End-to-end (E2E) keyword search (KWS) has emerged as an alternative and complimentary approach to conventional keyword search which depends on the output of automatic speech recognition (ASR) systems. While E2E methods greatly simplify the…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-08 Bolaji Yusuf , Jan "Honza" Černocký , Murat Saraçlar

Neural Architecture Search (NAS) has become the de-facto approach for designing accurate and efficient networks for edge devices. Since models are typically quantized for edge deployment, recent work has investigated quantization-aware NAS…

Computer Vision and Pattern Recognition · Computer Science 2024-01-24 Yao Lu , Hiram Rayo Torres Rodriguez , Sebastian Vogel , Nick van de Waterlaat , Pavol Jancura

Neural architecture search (NAS) has shown promise towards automating neural network design for a given task, but it is computationally demanding due to training costs associated with evaluating a large number of architectures to find the…

Computer Vision and Pattern Recognition · Computer Science 2025-02-07 Shahid Siddiqui , Christos Kyrkou , Theocharis Theocharides

Mainly for the sake of solving the lack of keyword-specific data, we propose one Keyword Spotting (KWS) system using Deep Neural Network (DNN) and Connectionist Temporal Classifier (CTC) on power-constrained small-footprint mobile devices,…

Computation and Language · Computer Science 2017-09-13 Zhiming Wang , Xiaolong Li , Jun Zhou

We propose using cascaded classifiers for a keyword spotting (KWS) task on narrow-band (NB), 8kHz audio acquired in non-IID environments -- a more challenging task than most state-of-the-art KWS systems face. We present a model that…

Machine Learning · Computer Science 2025-04-28 Ahmad AbdulKader , Kareem Nassar , Mohamed El-Geish , Daniel Galvez , Chetan Patil

We propose GE2E-KWS -- a generalized end-to-end training and evaluation framework for customized keyword spotting. Specifically, enrollment utterances are separated and grouped by keywords from the training batch and their embedding…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-06 Pai Zhu , Jacob W. Bartel , Dhruuv Agarwal , Kurt Partridge , Hyun Jin Park , Quan Wang

Mobile and edge computing devices for always-on classification tasks require energy-efficient neural network architectures. In this paper we present several changes to neural architecture searches (NAS) that improve the chance of success in…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-02 Daniel T. Speckhard , Karolis Misiunas , Sagi Perel , Tenghui Zhu , Simon Carlile , Malcolm Slaney

This paper proposes a self-learning method to incrementally train (fine-tune) a personalized Keyword Spotting (KWS) model after the deployment on ultra-low power smart audio sensors. We address the fundamental problem of the absence of…

Sound · Computer Science 2025-03-10 Manuele Rusci , Francesco Paci , Marco Fariselli , Eric Flamand , Tinne Tuytelaars

Neural Architecture Search (NAS) methods have been growing in popularity. These techniques have been fundamental to automate and speed up the time consuming and error-prone process of synthesizing novel Deep Learning (DL) architectures. NAS…

Machine Learning · Computer Science 2021-01-26 Hadjer Benmeziane , Kaoutar El Maghraoui , Hamza Ouarnoughi , Smail Niar , Martin Wistuba , Naigang Wang

In the recent past, the success of Neural Architecture Search (NAS) has enabled researchers to broadly explore the design space using learning-based methods. Apart from finding better neural network architectures, the idea of automation has…

Machine Learning · Computer Science 2019-11-04 Qing Lu , Weiwen Jiang , Xiaowei Xu , Yiyu Shi , Jingtong Hu

Neural architecture search (NAS) algorithms save tremendous labor from human experts. Recent advancements further reduce the computational overhead to an affordable level. However, it is still cumbersome to deploy the NAS techniques in…

Computer Vision and Pattern Recognition · Computer Science 2022-06-10 Zhuowei Li , Yibo Gao , Zhenzhou Zha , Zhiqiang HU , Qing Xia , Shaoting Zhang , Dimitris N. Metaxas

This article presents a method for improving a keyword spotter (KWS) algorithm in noisy environments. Although beamforming (BF) and adaptive noise cancellation (ANC) techniques are robust in some conditions, they may degrade the performance…

Neural architecture search (NAS) approaches aim at automatically finding novel CNN architectures that fit computational constraints while maintaining a good performance on the target platform. We introduce a novel efficient one-shot NAS…

Computer Vision and Pattern Recognition · Computer Science 2020-05-22 Maxim Berman , Leonid Pishchulin , Ning Xu , Matthew B. Blaschko , Gerard Medioni

Open-vocabulary keyword spotting (KWS) refers to the task of detecting words or terms within speech recordings, regardless of whether they were included in the training data. This paper introduces an open-vocabulary keyword spotting model…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-08 Yael Segal-Feldman , Ann R. Bradlow , Matthew Goldrick , Joseph Keshet

Binary Neural Networks (BNNs) have gained extensive attention for their superior inferencing efficiency and compression ratio compared to traditional full-precision networks. However, due to the unique characteristics of BNNs, designing a…

Computer Vision and Pattern Recognition · Computer Science 2024-08-29 Zhihao Lin , Yongtao Wang , Jinhe Zhang , Xiaojie Chu , Haibin Ling

Keyword spotting aims to identify specific keyword audio utterances. In recent years, deep convolutional neural networks have been widely utilized in keyword spotting systems. However, their model architectures are mainly based on off-the…

Machine Learning · Computer Science 2021-06-08 Tong Mo , Bang Liu

Recent work in network quantization has substantially reduced the time and space complexity of neural network inference, enabling their deployment on embedded and mobile devices with limited computational and memory resources. However,…

Computer Vision and Pattern Recognition · Computer Science 2018-12-04 Bichen Wu , Yanghan Wang , Peizhao Zhang , Yuandong Tian , Peter Vajda , Kurt Keutzer

Quantization is widely employed in both cloud and edge systems to reduce the memory occupation, latency, and energy consumption of deep neural networks. In particular, mixed-precision quantization, i.e., the use of different bit-widths for…

Machine Learning · Computer Science 2023-01-26 Matteo Risso , Alessio Burrello , Luca Benini , Enrico Macii , Massimo Poncino , Daniele Jahier Pagliari