English
Related papers

Related papers: Zero-shot keyword spotting for visual speech recog…

200 papers

In this paper, we investigated a speech augmentation based unsupervised learning approach for keyword spotting (KWS) task. KWS is a useful speech application, yet also heavily depends on the labeled data. We designed a CNN-Attention…

Sound · Computer Science 2022-05-31 Jian Luo , Jianzong Wang , Ning Cheng , Haobin Tang , Jing Xiao

Keyword spotting (KWS) is becoming a ubiquitous need with the advancement in artificial intelligence and smart devices. Recent work in this field have focused on several different architectures to achieve good results on datasets with low…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-17 Anwesh Mohanty , Adrian Frischknecht , Christoph Gerum , Oliver Bringmann

In this study, we investigate the application of keyword spotting (KWS) in the domain of Hindi speech recognition, utilizing a dataset comprising 40,000 audio samples. With a sampling rate of 44 kHz and an average duration of 1.9 seconds…

Sound · Computer Science 2026-05-06 Saru Bharti , Pushparaj Mani Pathak

Despite the recent successes of deep neural networks, it remains challenging to achieve high precision keyword spotting task (KWS) on resource-constrained devices. In this study, we propose a novel context-aware and compact architecture for…

Sound · Computer Science 2019-12-12 Xi Chen , Shouyi Yin , Dandan Song , Peng Ouyang , Leibo Liu , Shaojun Wei

Small-Footprint Keyword Spotting (SF-KWS) has gained popularity in today's landscape of smart voice-activated devices, smartphones, and Internet of Things (IoT) applications. This surge is attributed to the advancements in Deep Learning,…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-16 Soumen Garai , Suman Samui

Robustness against noise is critical for keyword spotting (KWS) in real-world environments. To improve the robustness, a speech enhancement front-end is involved. Instead of treating the speech enhancement as a separated preprocessing…

Sound · Computer Science 2019-06-21 Yue Gu , Zhihao Du , Hui Zhang , Xueliang Zhang

This paper proposes a novel user-defined keyword spotting framework that accurately detects audio keywords based on text enrollment. Since audio data possesses additional acoustic information compared to text, there are discrepancies…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-23 Youkyum Kim , Jaemin Jung , Jihwan Park , Byeong-Yeol Kim , Joon Son Chung

Keyword spotting (KWS) is one of the speech recognition tasks most sensitive to the quality of the feature representation. However, the research on KWS has traditionally focused on new model topologies, putting little emphasis on other…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-08 Douglas Baptista de Souza , Khaled Jamal Bakri , Fernanda Ferreira , Juliana Inacio

Recent work considered how images paired with speech can be used as supervision for building speech systems when transcriptions are not available. We ask whether visual grounding can be used for cross-lingual keyword spotting: given a text…

Computation and Language · Computer Science 2018-06-14 Herman Kamper , Michael Roth

Keyword spotting (KWS) is crucial for many speech-driven applications, but robust KWS in noisy environments remains challenging. Conventional systems often rely on single-channel inputs and a cascaded pipeline separating front-end…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-11 Rui Wang , Zhifei Zhang , Yu Gao , Xiaofeng Mou , Yi Xu

The recognition of rare named entities, such as personal names and terminologies, is challenging for automatic speech recognition (ASR) systems, especially when they are not frequently observed in the training data. In this paper, we…

Artificial Intelligence · Computer Science 2024-06-07 Yuang Li , Min Zhang , Chang Su , Yinglu Li , Xiaosong Qiao , Mengxin Ren , Miaomiao Ma , Daimeng Wei , Shimin Tao , Hao Yang

Zero-shot learning (ZSL) aims to recognize instances of unseen classes solely based on the semantic descriptions of the classes. Existing algorithms usually formulate it as a semantic-visual correspondence problem, by learning mappings from…

Computer Vision and Pattern Recognition · Computer Science 2019-11-28 Kai Li , Martin Renqiang Min , Yun Fu

Keyword spotting (KWS) plays a critical role in enabling speech-based user interactions on smart devices. Recent developments in the field of deep learning have led to wide adoption of convolutional neural networks (CNNs) in KWS systems due…

A Multilingual Keyword Spotting (KWS) system detects spokenkeywords over multiple locales. Conventional monolingual KWSapproaches do not scale well to multilingual scenarios because ofhigh development/maintenance costs and lack of resource…

Computation and Language · Computer Science 2023-02-28 Pai Zhu , Hyun Jin Park , Alex Park , Angelo Scorza Scarpati , Ignacio Lopez Moreno

Keyword Spotting (KWS) from speech signals is widely applied to perform fully hands-free speech recognition. The KWS network is designed as a small-footprint model so it can continuously be active. Recent efforts have explored dynamic…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-25 Donghyeon Kim , Kyungdeuk Ko , Jeonggi Kwak , David K. Han , Hanseok Ko

In this paper, we investigate representation learning for low-resource keyword spotting (KWS). The main challenges of KWS are limited labeled data and limited available device resources. To address those challenges, we explore…

Sound · Computer Science 2023-03-21 Fan Cui , Liyong Guo , Quandong Wang , Peng Gao , Yujun Wang

Despite their great performance over the years, handcrafted speech features are not necessarily optimal for any particular speech application. Consequently, with greater or lesser success, optimal filterbank learning has been studied for…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-02 Iván López-Espejo , Zheng-Hua Tan , Jesper Jensen

Spoken keyword spotting (KWS) aims to identify keywords in audio for wide applications, especially on edge devices. Current small-footprint KWS systems focus on efficient model designs. However, their inference performance can decline in…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-21 Yang Xiao , Tianyi Peng , Yanghao Zhou , Rohan Kumar Das

Robust object recognition systems usually rely on powerful feature extraction mechanisms from a large number of real images. However, in many realistic applications, collecting sufficient images for ever-growing new classes is unattainable.…

Computer Vision and Pattern Recognition · Computer Science 2017-05-05 Yang Long , Li Liu , Ling Shao , Fumin Shen , Guiguang Ding , Jungong Han

Zero-shot learning (ZSL) highly depends on a good semantic embedding to connect the seen and unseen classes. Recently, distributed word embeddings (DWE) pre-trained from large text corpus have become a popular choice to draw such a…

Computer Vision and Pattern Recognition · Computer Science 2017-07-19 Ruizhi Qiao , Lingqiao Liu , Chunhua Shen , Anton van den Hengel