English
Related papers

Related papers: Text Anchor Based Metric Learning for Small-footpr…

200 papers

A keyword spotting (KWS) engine that is continuously running on device is exposed to various speech signals that are usually unseen before. It is a challenging problem to build a small-footprint and high-performing KWS model with robustness…

Sound · Computer Science 2024-08-27 Zhenyu Wang , Li Wan , Biqiao Zhang , Yiteng Huang , Shang-Wen Li , Ming Sun , Xin Lei , Zhaojun Yang

Keyword spotting (KWS) is experiencing an upswing due to the pervasiveness of small electronic devices that allow interaction with them via speech. Often, KWS systems are speaker-independent, which means that any person --user or not--…

Sound · Computer Science 2019-06-27 Iván López-Espejo , Zheng-Hua Tan , Jesper Jensen

Using audio and text embeddings jointly for Keyword Spotting (KWS) has shown high-quality results, but the key challenge of how to semantically align two embeddings for multi-word keywords of different sequence lengths remains largely…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-09 Kumari Nishu , Minsik Cho , Devang Naik

Deep neural networks provide effective solutions to small-footprint keyword spotting (KWS). However, if training data is limited, it remains challenging to achieve robust and highly accurate KWS in real-world scenarios where unseen sounds…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-14 Menglong Xu , Shengqiang Li , Chengdong Liang , Xiao-Lei Zhang

Keyword Spotting (KWS) plays a vital role in human-computer interaction for smart on-device terminals and service robots. It remains challenging to achieve the trade-off between small footprint and high accuracy for KWS task. In this paper,…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-21 Ximin Li , Xiaodong Wei , Xiaowei Qin

This paper proposes a self-learning method to incrementally train (fine-tune) a personalized Keyword Spotting (KWS) model after the deployment on ultra-low power smart audio sensors. We address the fundamental problem of the absence of…

Sound · Computer Science 2025-03-10 Manuele Rusci , Francesco Paci , Marco Fariselli , Eric Flamand , Tinne Tuytelaars

In recent years, there has been a growing interest in designing small-footprint yet effective Connectionist Temporal Classification based keyword spotting (CTC-KWS) systems. They are typically deployed on low-resource computing platforms,…

Audio and Speech Processing · Electrical Eng. & Systems 2024-12-25 Yu Xi , Haoyu Li , Hao Li , Jiaqi Guo , Xu Li , Wen Ding , Kai Yu

Catastrophic forgetting is a thorny challenge when updating keyword spotting (KWS) models after deployment. To tackle such challenges, we propose a progressive continual learning strategy for small-footprint spoken keyword spotting…

Computation and Language · Computer Science 2022-02-08 Yizheng Huang , Nana Hou , Nancy F. Chen

Despite the recent successes of deep neural networks, it remains challenging to achieve high precision keyword spotting task (KWS) on resource-constrained devices. In this study, we propose a novel context-aware and compact architecture for…

Sound · Computer Science 2019-12-12 Xi Chen , Shouyi Yin , Dandan Song , Peng Ouyang , Leibo Liu , Shaojun Wei

In this paper, we aim to improve the robustness of Keyword Spotting (KWS) systems in noisy environments while keeping a small memory footprint. We propose a new convolutional neural network (CNN) called FCA-Net, which combines mixer…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-30 Yuanxi Lin , Yuriy Evgenyevich Gapanyuk

Continuous Speech Keyword Spotting (CSKS) is the problem of spotting keywords in recorded conversations, when a small number of instances of keywords are available in training data. Unlike the more common Keyword Spotting, where an…

Sound · Computer Science 2019-01-15 Harshita Seth , Pulkit Kumar , Muktabh Mayank Srivastava

For training a few-shot keyword spotting (FS-KWS) model, a large labeled dataset containing massive target keywords has known to be essential to generalize to arbitrary target keywords with only a few enrollment samples. To alleviate the…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-10 Dongjune Lee , Minchan Kim , Sung Hwan Mun , Min Hyun Han , Nam Soo Kim

We develop streaming keyword spotting systems using a recurrent neural network transducer (RNN-T) model: an all-neural, end-to-end trained, sequence-to-sequence model which jointly learns acoustic and language model components. Our models…

Computation and Language · Computer Science 2017-10-27 Yanzhang He , Rohit Prabhavalkar , Kanishka Rao , Wei Li , Anton Bakhtin , Ian McGraw

As advancements in technologies like Internet of Things (IoT), Automatic Speech Recognition (ASR), Speaker Verification (SV), and Text-to-Speech (TTS) lead to increased usage of intelligent voice assistants, the demand for privacy and…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-20 Jianan Pan , Kejie Huang

Speech recognition is a sequence prediction problem. Besides employing various deep learning approaches for framelevel classification, sequence-level discriminative training has been proved to be indispensable to achieve the…

Computation and Language · Computer Science 2018-08-20 Zhehuai Chen , Yanmin Qian , Kai Yu

Noise robustness is a key aspect of successful speech applications. Speech enhancement (SE) has been investigated to improve automatic speech recognition accuracy; however, its effectiveness for keyword spotting (KWS) is still…

Audio and Speech Processing · Electrical Eng. & Systems 2024-02-23 Avamarie Brueggeman , Takuya Higuchi , Masood Delfarah , Stephen Shum , Vineet Garg

Keyword spotting (KWS) has become an indispensable part of many intelligent devices surrounding us, as audio is one of the most efficient ways of interacting with these devices. The accuracy and performance of KWS solutions have been the…

Sound · Computer Science 2021-11-10 Mehmet Gorkem Ulkar , Osman Erman Okman

Conversational agents commonly utilize keyword spotting (KWS) to initiate voice interaction with the user. For user experience and privacy considerations, existing approaches to KWS largely focus on accuracy, which can often come at the…

Audio and Speech Processing · Electrical Eng. & Systems 2022-09-30 Christin Jose , Joseph Wang , Grant P. Strimel , Mohammad Omar Khursheed , Yuriy Mishchenko , Brian Kulis

In this paper, we investigate representation learning for low-resource keyword spotting (KWS). The main challenges of KWS are limited labeled data and limited available device resources. To address those challenges, we explore…

Sound · Computer Science 2023-03-21 Fan Cui , Liyong Guo , Quandong Wang , Peng Gao , Yujun Wang

To achieve high coverage of target boxes, a normal strategy of conventional one-stage anchor-based detectors is to utilize multiple priors at each spatial position, especially in scene text detection tasks. In this work, we present a simple…

Computer Vision and Pattern Recognition · Computer Science 2019-09-24 Linjie Deng , Yanxiang Gong , Xinchen Lu , Yi Lin , Zheng Ma , Mei Xie