English
Related papers

Related papers: Data Augmentation for Robust Keyword Spotting unde…

200 papers

This paper proposes a self-learning method to incrementally train (fine-tune) a personalized Keyword Spotting (KWS) model after the deployment on ultra-low power smart audio sensors. We address the fundamental problem of the absence of…

Sound · Computer Science 2025-03-10 Manuele Rusci , Francesco Paci , Marco Fariselli , Eric Flamand , Tinne Tuytelaars

Custom keyword spotting (KWS) allows detecting user-defined spoken keywords from streaming audio. This is achieved by comparing the embeddings from voice enrollments and input audio. State-of-the-art custom KWS models are typically trained…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-06 Pai Zhu , Quan Wang , Dhruuv Agarwal , Kurt Partridge

We consider the problem of recognizing speech utterances spoken to a device which is generating a known sound waveform; for example, recognizing queries issued to a digital assistant which is generating responses to previous user inputs.…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-03 Nathan Howard , Alex Park , Turaj Zakizadeh Shabestary , Alexander Gruenstein , Rohit Prabhavalkar

We propose using cascaded classifiers for a keyword spotting (KWS) task on narrow-band (NB), 8kHz audio acquired in non-IID environments -- a more challenging task than most state-of-the-art KWS systems face. We present a model that…

Machine Learning · Computer Science 2025-04-28 Ahmad AbdulKader , Kareem Nassar , Mohamed El-Geish , Daniel Galvez , Chetan Patil

Keyword spotting (KWS) has been widely used in various speech control scenarios. The training of KWS is usually based on deep neural networks and requires a large amount of data. Manufacturers often use third-party data to train KWS.…

Sound · Computer Science 2022-11-17 Hanbo Cai , Pengcheng Zhang , Hai Dong , Yan Xiao , Shunhui Ji

Data augmentation is commonly used for generating additional data from the available training data to achieve a robust estimation of the parameters of complex models like the one for speaker verification (SV), especially for under-resourced…

Audio and Speech Processing · Electrical Eng. & Systems 2021-03-29 Achintya Kumar Sarkar , Himangshu Sarma , Priyanka Dwivedi , Zheng-Hua Tan

Background noise reduces speech intelligibility and quality, making speaker verification (SV) in noisy environments a challenging task. To improve the noise robustness of SV systems, additive noise data augmentation method has been commonly…

Audio and Speech Processing · Electrical Eng. & Systems 2023-07-21 Wonbin Kim , Hyun-seo Shin , Ju-ho Kim , Jungwoo Heo , Chan-yeong Lim , Ha-Jin Yu

Keyword Spotting (KWS) models are becoming increasingly integrated into various systems, e.g. voice assistants. To achieve satisfactory performance, these models typically rely on a large amount of labelled data, limiting their applications…

Sound · Computer Science 2023-05-25 Holger Severin Bovbjerg , Zheng-Hua Tan

This paper introduces a speech enhancement solution tailored for true wireless stereo (TWS) earbuds on-device usage. The solution was specifically designed to support conversations in noisy environments, with active noise cancellation (ANC)…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-30 Hanbin Bae , Pavel Andreev , Azat Saginbaev , Nicholas Babaev , Won-Jun Lee , Hosang Sung , Hoon-Young Cho

Open vocabulary keyword spotting is a crucial and challenging task in automatic speech recognition (ASR) that focuses on detecting user-defined keywords within a spoken utterance. Keyword spotting methods commonly map the audio utterance…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-18 Aviv Navon , Aviv Shamsian , Neta Glazer , Gill Hetz , Joseph Keshet

Real-world complex acoustic environments especially the ones with a low signal-to-noise ratio (SNR) will bring tremendous challenges to a keyword spotting (KWS) system. Inspired by the recent advances of neural speech enhancement and…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-14 Shubo Lv , Xiong Wang , Sining Sun , Long Ma , Lei Xie

Open-vocabulary keyword spotting (KWS), which allows users to customize keywords, has attracted increasingly more interest. However, existing methods based on acoustic models and post-processing train the acoustic model with ASR training…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-18 Ao Zhang , Pan Zhou , Kaixun Huang , Yong Zou , Ming Liu , Lei Xie

Acoustic environments affect acoustic characteristics of sound to be recognized by physically interacting with sound wave propagation. Thus, training acoustic models for audio and speech tasks requires regularization on various acoustic…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-08 Hyeonuk Nam , Seong-Hu Kim , Yong-Hwa Park

In this paper, we propose an attention-based end-to-end model for multi-channel keyword spotting (KWS), which is trained to optimize the KWS result directly. As a result, our model outperforms the baseline model with signal pre-processing…

Sound · Computer Science 2018-11-06 Haitong Zhang , Junbo Zhang , Yujun Wang

In this paper, we propose a multilingual query-by-example keyword spotting (KWS) system based on a residual neural network. The model is trained as a classifier on a multilingual keyword dataset extracted from Common Voice sentences and…

Audio and Speech Processing · Electrical Eng. & Systems 2023-04-20 Paul M. Reuter , Christian Rollwage , Bernd T. Meyer

A keyword spotting (KWS) system determines the existence of, usually predefined, keyword in a continuous speech stream. This paper presents a query-by-example on-device KWS system which is user-specific. The proposed system consists of two…

Machine Learning · Computer Science 2020-01-15 Byeonggeun Kim , Mingu Lee , Jinkyu Lee , Yeonseok Kim , Kyuwoong Hwang

Keyword spotting (KWS) is an important technique for speech applications, which enables users to activate devices by speaking a keyword phrase. Although a phoneme classifier can be used for KWS, exploiting a large amount of transcribed data…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-23 Takuya Higuchi , Anmol Gupta , Chandra Dhir

In recent years, automatic speech recognition (ASR) models greatly improved transcription performance both in clean, low noise, acoustic conditions and in reverberant environments. However, all these systems rely on the availability of…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-18 Francesco Nespoli , Daniel Barreda , Patrick A. Naylor

Wake word (WW) spotting is challenging in far-field due to the complexities and variations in acoustic conditions and the environmental interference in signal transmission. A suite of carefully designed and optimized audio front-end (AFE)…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-15 Yixin Gao , Noah D. Stein , Chieh-Chi Kao , Yunliang Cai , Ming Sun , Tao Zhang , Shiv Vitaladevuni

Automatic recognition of disordered speech remains a highly challenging task to date. The underlying neuro-motor conditions, often compounded with co-occurring physical disabilities, lead to the difficulty in collecting large quantities of…

Audio and Speech Processing · Electrical Eng. & Systems 2021-08-03 Zengrui Jin , Mengzhe Geng , Xurong Xie , Jianwei Yu , Shansong Liu , Xunying Liu , Helen Meng