English
Related papers

Related papers: Query-by-example on-device keyword spotting

200 papers

In this paper, we propose an attention-based end-to-end model for multi-channel keyword spotting (KWS), which is trained to optimize the KWS result directly. As a result, our model outperforms the baseline model with signal pre-processing…

Sound · Computer Science 2018-11-06 Haitong Zhang , Junbo Zhang , Yujun Wang

In this paper, we propose a sequence-to-sequence model for keyword spotting (KWS). Compared with other end-to-end architectures for KWS, our model simplifies the pipelines of production-quality KWS system and satisfies the requirement of…

Sound · Computer Science 2018-11-02 Haitong Zhang , Junbo Zhang , Yujun Wang

Keyword spotting (KWS) refers to the task of identifying a set of predefined words in audio streams. With the advances seen recently with deep neural networks, it has become a popular technology to activate and control small devices, such…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-25 Heitor R. Guimarães , Arthur Pimentel , Anderson Avila , Tiago H. Falk

Few-shot keyword spotting (KWS) aims to detect unknown keywords with limited training samples. A commonly used approach is the pre-training and fine-tuning framework. While effective in clean conditions, this approach struggles with mixed…

Sound · Computer Science 2024-07-09 Junming Yuan , Ying Shi , LanTian Li , Dong Wang , Askar Hamdulla

This paper addresses the persistent challenge in Keyword Spotting (KWS), a fundamental component in speech technology, regarding the acquisition of substantial labeled data for training. Given the difficulty in obtaining large quantities of…

Sound · Computer Science 2024-09-04 Weinan Dai , Yifeng Jiang , Yuanjing Liu , Jinkun Chen , Xin Sun , Jinglei Tao

Keyword spotting (KWS) has been widely used in various speech control scenarios. The training of KWS is usually based on deep neural networks and requires a large amount of data. Manufacturers often use third-party data to train KWS.…

Sound · Computer Science 2022-11-17 Hanbo Cai , Pengcheng Zhang , Hai Dong , Yan Xiao , Shunhui Ji

The Transformer architecture has been successful across many domains, including natural language processing, computer vision and speech recognition. In keyword spotting, self-attention has primarily been used on top of convolutional or…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-11 Axel Berg , Mark O'Connor , Miguel Tairum Cruz

Keyword spotting (KWS) is essential for voice-driven applications, demanding both accuracy and efficiency. Traditional ASR-based KWS methods, such as greedy and beam search, explore the entire search space without explicitly prioritizing…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-01 Yu Xi , Haoyu Li , Xiaoyu Gu , Yidi Jiang , Kai Yu

We explore Neural Networks (NNs) for keyword spotting (KWS) on IoT devices like smart speakers and wearables. Since we target to execute our NN on a constrained memory and computation footprint, we propose a CNN design that. (i) uses a…

Machine Learning · Computer Science 2021-01-05 Rakesh Dhakshinamurthy

This paper describes the system developed by the NPU team for the 2020 personalized voice trigger challenge. Our submitted system consists of two independently trained subsystems: a small footprint keyword spotting (KWS) system and a…

Sound · Computer Science 2021-03-01 Jingyong Hou , Li Zhang , Yihui Fu , Qing Wang , Zhanheng Yang , Qijie Shao , Lei Xie

Keyword spotting (KWS) is a crucial function enabling the interaction with the many ubiquitous smart devices in our surroundings, either activating them through wake-word or directly as a human-computer interface. For many applications, KWS…

Open vocabulary keyword spotting is a crucial and challenging task in automatic speech recognition (ASR) that focuses on detecting user-defined keywords within a spoken utterance. Keyword spotting methods commonly map the audio utterance…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-18 Aviv Navon , Aviv Shamsian , Neta Glazer , Gill Hetz , Joseph Keshet

This paper introduces the system submitted by the Yidun NISP team to the video keyword wakeup challenge. We propose a mandarin keyword spotting system (KWS) with several novel and effective improvements, including a big backbone (B) model,…

Computation and Language · Computer Science 2021-12-06 Yuting Yang , Binbin Du , Yingxin Zhang , Wenxuan Wang , Yuke Li

Using audio and text embeddings jointly for Keyword Spotting (KWS) has shown high-quality results, but the key challenge of how to semantically align two embeddings for multi-word keywords of different sequence lengths remains largely…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-09 Kumari Nishu , Minsik Cho , Devang Naik

Numerous methods have been proposed to enhance Keyword Spotting (KWS) in adult speech, but children's speech presents unique challenges for KWS systems due to its distinct acoustic and linguistic characteristics. This paper introduces a…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-01 Subham Kutum , Abhijit Sinha , Hemant Kumar Kathania , Sudarsana Reddy Kadiri , Mahesh Chandra Govil

This paper introduces a novel approach for streaming openvocabulary keyword spotting (KWS) with text-based keyword enrollment. For every input frame, the proposed method finds the optimal alignment ending at the frame using connectionist…

Sound · Computer Science 2024-09-27 Sichen Jin , Youngmoon Jung , Seungjin Lee , Jaeyoung Roh , Changwoo Han , Hoonyoung Cho

The recognition of rare named entities, such as personal names and terminologies, is challenging for automatic speech recognition (ASR) systems, especially when they are not frequently observed in the training data. In this paper, we…

Artificial Intelligence · Computer Science 2024-06-07 Yuang Li , Min Zhang , Chang Su , Yinglu Li , Xiaosong Qiao , Mengxin Ren , Miaomiao Ma , Daimeng Wei , Shimin Tao , Hao Yang

We explore a keyword-based spoken language understanding system, in which the intent of the user can directly be derived from the detection of a sequence of keywords in the query. In this paper, we focus on an open-vocabulary keyword…

Computation and Language · Computer Science 2020-02-26 Théodore Bluche , Maël Primet , Thibault Gisselbrecht

Few-shot keyword spotting (FS-KWS) models usually require large-scale annotated datasets to generalize to unseen target keywords. However, existing KWS datasets are limited in scale and gathering keyword-like labeled data is costly…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-06 Seunghan Yang , Byeonggeun Kim , Kyuhong Shim , Simyung Chang

Fixed-point (FXP) inference has proven suitable for embedded devices with limited computational resources, and yet model training is continually performed in floating-point (FLP). FXP training has not been fully explored and the non-trivial…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-08 Sashank Macha , Om Oza , Alex Escott , Francesco Caliva , Robbie Armitano , Santosh Kumar Cheekatmalla , Sree Hari Krishnan Parthasarathi , Yuzong Liu