English
Related papers

Related papers: VE-KWS: Visual Modality Enhanced End-to-End Keywor…

200 papers

The performance of keyword spotting (KWS), measured in false alarms and false rejects, degrades significantly under the far field and noisy conditions. In this paper, we propose a multi-look neural network modeling for speech enhancement…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-22 Meng Yu , Xuan Ji , Bo Wu , Dan Su , Dong Yu

Keyword spotting (KWS) is crucial for many speech-driven applications, but robust KWS in noisy environments remains challenging. Conventional systems often rely on single-channel inputs and a cascaded pipeline separating front-end…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-11 Rui Wang , Zhifei Zhang , Yu Gao , Xiaofeng Mou , Yi Xu

In this paper, we propose an attention-based end-to-end model for multi-channel keyword spotting (KWS), which is trained to optimize the KWS result directly. As a result, our model outperforms the baseline model with signal pre-processing…

Sound · Computer Science 2018-11-06 Haitong Zhang , Junbo Zhang , Yujun Wang

Keyword spotting (KWS) is experiencing an upswing due to the pervasiveness of small electronic devices that allow interaction with them via speech. Often, KWS systems are speaker-independent, which means that any person --user or not--…

Sound · Computer Science 2019-06-27 Iván López-Espejo , Zheng-Hua Tan , Jesper Jensen

Open-vocabulary keyword spotting (KWS), which allows users to customize keywords, has attracted increasingly more interest. However, existing methods based on acoustic models and post-processing train the acoustic model with ASR training…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-18 Ao Zhang , Pan Zhou , Kaixun Huang , Yong Zou , Ming Liu , Lei Xie

Robustness against noise is critical for keyword spotting (KWS) in real-world environments. To improve the robustness, a speech enhancement front-end is involved. Instead of treating the speech enhancement as a separated preprocessing…

Sound · Computer Science 2019-06-21 Yue Gu , Zhihao Du , Hui Zhang , Xueliang Zhang

Open-vocabulary keyword spotting (KWS) in continuous speech streams holds significant practical value across a wide range of real-world applications. While increasing attention has been paid to the role of different modalities in KWS, their…

Sound · Computer Science 2025-12-18 Kewei Li , Yinan Zhong , Xiaotao Liang , Tianchi Dai , Shaofei Xue

Accurate on-device keyword spotting (KWS) with low false accept and false reject rate is crucial to customer experience for far-field voice control of conversational agents. It is particularly challenging to maintain low false reject rate…

Computation and Language · Computer Science 2018-08-03 Anirudh Raju , Sankaran Panchapagesan , Xing Liu , Arindam Mandal , Nikko Strom

Keyword spotting (KWS) refers to the task of identifying a set of predefined words in audio streams. With the advances seen recently with deep neural networks, it has become a popular technology to activate and control small devices, such…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-25 Heitor R. Guimarães , Arthur Pimentel , Anderson Avila , Tiago H. Falk

A keyword spotting (KWS) engine that is continuously running on device is exposed to various speech signals that are usually unseen before. It is a challenging problem to build a small-footprint and high-performing KWS model with robustness…

Sound · Computer Science 2024-08-27 Zhenyu Wang , Li Wan , Biqiao Zhang , Yiteng Huang , Shang-Wen Li , Ming Sun , Xin Lei , Zhaojun Yang

Using audio and text embeddings jointly for Keyword Spotting (KWS) has shown high-quality results, but the key challenge of how to semantically align two embeddings for multi-word keywords of different sequence lengths remains largely…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-09 Kumari Nishu , Minsik Cho , Devang Naik

Spoken keyword spotting (KWS) is crucial for identifying keywords within audio inputs and is widely used in applications like Apple Siri and Google Home, particularly on edge devices. Current deep learning-based KWS systems, which are…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-14 Tianyi Peng , Yang Xiao

Noise robustness is a key aspect of successful speech applications. Speech enhancement (SE) has been investigated to improve automatic speech recognition accuracy; however, its effectiveness for keyword spotting (KWS) is still…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-23 Avamarie Brueggeman , Takuya Higuchi , Masood Delfarah , Stephen Shum , Vineet Garg

This paper further explores our previous wake word spotting system ranked 2-nd in Track 1 of the MISP Challenge 2021. First, we investigate a robust unimodal approach based on 3D and 2D convolution and adopt the simple attention module…

Sound · Computer Science 2023-03-07 Haoxu Wang , Ming Cheng , Qiang Fu , Ming Li

Keyword spotting (KWS) is a key component of smart devices, enabling efficient and intuitive audio interaction. However, standard KWS systems deployed on embedded devices often suffer performance degradation under real-world operating…

Spoken keyword spotting (KWS) deals with the identification of keywords in audio streams and has become a fast-growing technology thanks to the paradigm shift introduced by deep learning a few years ago. This has allowed the rapid embedding…

Sound · Computer Science 2021-11-23 Iván López-Espejo , Zheng-Hua Tan , John Hansen , Jesper Jensen

In this paper, we propose a multilingual query-by-example keyword spotting (KWS) system based on a residual neural network. The model is trained as a classifier on a multilingual keyword dataset extracted from Common Voice sentences and…

Audio and Speech Processing · Electrical Eng. & Systems 2023-04-20 Paul M. Reuter , Christian Rollwage , Bernd T. Meyer

The recognition of rare named entities, such as personal names and terminologies, is challenging for automatic speech recognition (ASR) systems, especially when they are not frequently observed in the training data. In this paper, we…

Artificial Intelligence · Computer Science 2024-06-07 Yuang Li , Min Zhang , Chang Su , Yinglu Li , Xiaosong Qiao , Mengxin Ren , Miaomiao Ma , Daimeng Wei , Shimin Tao , Hao Yang

This article presents a method for improving a keyword spotter (KWS) algorithm in noisy environments. Although beamforming (BF) and adaptive noise cancellation (ANC) techniques are robust in some conditions, they may degrade the performance…

Visual keyword spotting (KWS) is the problem of estimating whether a text query occurs in a given recording using only video information. This paper focuses on visual KWS for words unseen during training, a real-world, practical setting…

Computer Vision and Pattern Recognition · Computer Science 2018-07-27 Themos Stafylakis , Georgios Tzimiropoulos
‹ Prev 1 2 3 10 Next ›