English
Related papers

Related papers: Streaming Keyword Spotting Boosted by Cross-layer …

200 papers

Although frame-based models, such as CTC and transducers, have an affinity for streaming automatic speech recognition, their decoding uses no future knowledge, which could lead to incorrect pruning. Conversely, label-based attention…

Audio and Speech Processing · Electrical Eng. & Systems 2023-07-25 Emiru Tsunoo , Hayato Futami , Yosuke Kashiwagi , Siddhant Arora , Shinji Watanabe

Keyword spotting (KWS) aims to discriminate a specific wake-up word from other signals precisely and efficiently for different users. Recent works utilize various deep networks to train KWS models with all users' speech data centralized…

Machine Learning · Computer Science 2022-06-20 Xin-Chun Li , Jin-Lin Tang , Shaoming Song , Bingshuai Li , Yinchuan Li , Yunfeng Shao , Le Gan , De-Chuan Zhan

Semi-supervised change detection (SSCD) utilizes partially labeled data and a large amount of unlabeled data to detect changes. However, the transformer-based SSCD network does not perform as well as the convolution-based SSCD network due…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Yan Xing , Qi'ao Xu , Jingcheng Zeng , Rui Huang , Sihua Gao , Weifeng Xu , Yuxiang Zhang , Wei Fan

Open vocabulary keyword spotting is a crucial and challenging task in automatic speech recognition (ASR) that focuses on detecting user-defined keywords within a spoken utterance. Keyword spotting methods commonly map the audio utterance…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-18 Aviv Navon , Aviv Shamsian , Neta Glazer , Gill Hetz , Joseph Keshet

Despite the recent successes of deep neural networks, it remains challenging to achieve high precision keyword spotting task (KWS) on resource-constrained devices. In this study, we propose a novel context-aware and compact architecture for…

Sound · Computer Science 2019-12-12 Xi Chen , Shouyi Yin , Dandan Song , Peng Ouyang , Leibo Liu , Shaojun Wei

Keyword spotting (KWS) is becoming a ubiquitous need with the advancement in artificial intelligence and smart devices. Recent work in this field have focused on several different architectures to achieve good results on datasets with low…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-17 Anwesh Mohanty , Adrian Frischknecht , Christoph Gerum , Oliver Bringmann

Catastrophic forgetting is a thorny challenge when updating keyword spotting (KWS) models after deployment. To tackle such challenges, we propose a progressive continual learning strategy for small-footprint spoken keyword spotting…

Computation and Language · Computer Science 2022-02-08 Yizheng Huang , Nana Hou , Nancy F. Chen

In this work, we propose a streaming speech recognition framework for Amdo Tibetan, built upon a hybrid CTC/Atten-tion architecture with a context-aware dynamic chunking mechanism. The proposed strategy adaptively adjusts chunk widths based…

Computation and Language · Computer Science 2025-11-13 Chao Wang , Yuqing Cai , Renzeng Duojie , Jin Zhang , Yutong Liu , Nyima Tashi

To retrieve personalized campaigns and creatives while protecting user privacy, digital advertising is shifting from member-based identity to cohort-based identity. Under such identity regime, an accurate and efficient cohort building…

Information Retrieval · Computer Science 2023-04-27 Xinyi Zheng , Weijie Zhao , Xiaoyun Li , Ping Li

Semi-supervised learning has demonstrated promising results in automatic speech recognition (ASR) by self-training using a seed ASR model with pseudo-labels generated for unlabeled data. The effectiveness of this approach largely relies on…

Machine Learning · Computer Science 2021-02-17 Niko Moritz , Takaaki Hori , Jonathan Le Roux

The Conformer model is an excellent architecture for speech recognition modeling that effectively utilizes the hybrid losses of connectionist temporal classification (CTC) and attention to train model parameters. To improve the decoding…

Sound · Computer Science 2022-04-11 Nick J. C. Wang , Zongfeng Quan , Shaojun Wang , Jing Xiao

OpenAI Whisper is a family of robust Automatic Speech Recognition (ASR) models trained on 680,000 hours of audio. However, its encoder-decoder architecture, trained with a sequence-to-sequence objective, lacks native support for streaming…

User-defined keyword spotting on a resource-constrained edge device is challenging. However, keywords are often bounded by a maximum keyword length, which has been largely under-leveraged in prior works. Our analysis of keyword-length…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-17 Kumari Nishu , Minsik Cho , Devang Naik

We propose a novel approach for semi-supervised learning (SSL) designed to overcome distribution shifts between training and real-world data arising in the keyword spotting (KWS) task. Shifts from training data distribution are a key…

Sound · Computer Science 2022-07-15 Sree Hari Krishnan Parthasarathi , Lu Zeng , Christin Jose , Joseph Wang

Transformer encoder with connectionist temporal classification (CTC) framework is widely used for automatic speech recognition (ASR). However, knowledge distillation (KD) for ASR displays a problem of disagreement between teacher-student…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-13 Eungbeom Kim , Hantae Kim , Kyogu Lee

Query spelling correction is an important function of modern search engines since it effectively helps users express their intentions clearly. With the growing popularity of speech search driven by Automated Speech Recognition (ASR)…

Sound · Computer Science 2025-09-05 Junyu Lu , Di Jiang , Mengze Hong , Victor Junqiu Wei , Qintian Guo , Zhiyang Su

Continuous sign language recognition (SLR) deals with unaligned video-text pair and uses the word error rate (WER), i.e., edit distance, as the main evaluation metric. Since it is not differentiable, we usually instead optimize the learning…

Computer Vision and Pattern Recognition · Computer Science 2020-10-13 Junfu Pu , Wengang Zhou , Hezhen Hu , Houqiang Li

Spoken Keyword Spotting (KWS) is the task of distinguishing between the presence and absence of a keyword in audio. The accuracy of a KWS model hinges on its ability to correctly classify examples close to the keyword and non-keyword…

Sound · Computer Science 2026-02-06 Harry Zhang , Kurt Partridge , Pai Zhu , Neng Chen , Hyun Jin Park , Dhruuv Agarwal , Quan Wang

Smart audio devices are gated by an always-on lightweight keyword spotting program to reduce power consumption. It is however challenging to design models that have both high accuracy and low latency for accurate and fast responsiveness.…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-23 Bo Zhang , Wenfeng Li , Qingyuan Li , Weiji Zhuang , Xiangxiang Chu , Yujun Wang

Automatic Speech Recognition (ASR) technology has made significant progress in recent years, providing accurate transcription across various domains. However, some challenges remain, especially in noisy environments and specialized jargon.…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-06 Aviv Shamsian , Aviv Navon , Neta Glazer , Gill Hetz , Joseph Keshet