中文
相关论文

相关论文: MFA-KWS: Effective Keyword Spotting with Multi-hea…

200 篇论文

Keyword Spotting (KWS) from speech signals is widely applied to perform fully hands-free speech recognition. The KWS network is designed as a small-footprint model so it can continuously be active. Recent efforts have explored dynamic…

音频与语音处理 · 电气工程与系统科学 2023-12-25 Donghyeon Kim , Kyungdeuk Ko , Jeonggi Kwak , David K. Han , Hanseok Ko

One of the challenges in developing a high quality custom keyword spotting (KWS) model is the lengthy and expensive process of collecting training data covering a wide range of languages, phrases and speaking styles. We introduce Synth4Kws…

音频与语音处理 · 电气工程与系统科学 2026-02-06 Pai Zhu , Dhruuv Agarwal , Jacob W. Bartel , Kurt Partridge , Hyun Jin Park , Quan Wang

Despite the recent successes of deep neural networks, it remains challenging to achieve high precision keyword spotting task (KWS) on resource-constrained devices. In this study, we propose a novel context-aware and compact architecture for…

声音 · 计算机科学 2019-12-12 Xi Chen , Shouyi Yin , Dandan Song , Peng Ouyang , Leibo Liu , Shaojun Wei

Custom keyword spotting (KWS) allows detecting user-defined spoken keywords from streaming audio. This is achieved by comparing the embeddings from voice enrollments and input audio. State-of-the-art custom KWS models are typically trained…

音频与语音处理 · 电气工程与系统科学 2026-02-06 Pai Zhu , Quan Wang , Dhruuv Agarwal , Kurt Partridge

In this paper, we propose a multilingual query-by-example keyword spotting (KWS) system based on a residual neural network. The model is trained as a classifier on a multilingual keyword dataset extracted from Common Voice sentences and…

音频与语音处理 · 电气工程与系统科学 2023-04-20 Paul M. Reuter , Christian Rollwage , Bernd T. Meyer

Query by String Keyword Spotting (KWS) is here considered as a key technology for indexing large collections of handwritten text images to allow fast textual access to the contents of these collections. Under this perspective, a…

信息检索 · 计算机科学 2021-04-13 E. Vidal , A. H. Toselli , J. Puigcerver

Keyword Spotting (KWS) is a critical aspect of audio-based applications on mobile devices and virtual assistants. Recent developments in Federated Learning (FL) have significantly expanded the ability to train machine learning models by…

机器学习 · 计算机科学 2023-05-10 Enmao Diao , Eric W. Tramel , Jie Ding , Tao Zhang

Keyword Spotting (KWS) is essential in edge computing requiring rapid and energy-efficient responses. Spiking Neural Networks (SNNs) are well-suited for KWS for their efficiency and temporal capacity for speech. To further reduce the…

声音 · 计算机科学 2024-06-19 Zeyang Song , Qianhui Liu , Qu Yang , Yizhou Peng , Haizhou Li

This paper introduces neural architecture search (NAS) for the automatic discovery of end-to-end keyword spotting (KWS) models in limited resource environments. We employ a differentiable NAS approach to optimize the structure of…

声音 · 计算机科学 2021-04-15 David Peter , Wolfgang Roth , Franz Pernkopf

Keyword spotting (KWS) identifies words for voice assistants, but environmental noise frequently reduces accuracy. Standard adaptation fixes this issue and strictly requires original or labeled audio. Test time adaptation (TTA) solves this…

音频与语音处理 · 电气工程与系统科学 2026-03-09 Hanyu Ding , Yang Xiao , Jiaheng Dong , Ting Dang

Despite their great performance over the years, handcrafted speech features are not necessarily optimal for any particular speech application. Consequently, with greater or lesser success, optimal filterbank learning has been studied for…

音频与语音处理 · 电气工程与系统科学 2020-06-02 Iván López-Espejo , Zheng-Hua Tan , Jesper Jensen

Thanks to Deep Neural Networks (DNNs), the accuracy of Keyword Spotting (KWS) has made substantial progress. However, as KWS systems are usually implemented on edge devices, energy efficiency becomes a critical requirement besides…

声音 · 计算机科学 2024-06-21 Shuai Wang , Dehao Zhang , Kexin Shi , Yuchen Wang , Wenjie Wei , Jibin Wu , Malu Zhang

The emergence of Artificial Intelligence (AI) driven Keyword Spotting (KWS) technologies has revolutionized human to machine interaction. Yet, the challenge of end-to-end energy efficiency, memory footprint and system complexity of current…

音频与语音处理 · 电气工程与系统科学 2021-01-28 Jie Lei , Tousif Rahman , Rishad Shafik , Adrian Wheeldon , Alex Yakovlev , Ole-Christoffer Granmo , Fahim Kawsar , Akhil Mathur

Spoken keyword spotting (KWS) is the task of identifying a keyword in an audio stream and is widely used in smart devices at the edge in order to activate voice assistants and perform hands-free tasks. The task is daunting as there is a…

计算与语言 · 计算机科学 2024-05-07 Mahmoud Salhab , Haidar Harmanani

In this work we explore the latency and accuracy of keyword spotting (KWS) models in streaming and non-streaming modes on mobile phones. NN model conversion from non-streaming mode (model receives the whole input sequence and then returns…

音频与语音处理 · 电气工程与系统科学 2020-10-29 Oleg Rybakov , Natasha Kononenko , Niranjan Subrahmanya , Mirko Visontai , Stella Laurenzo

The Tsetlin Machine (TM) has recently attracted attention as a low-power alternative to neural networks due to its simple and interpretable inference mechanisms. However, its performance on speech-related tasks remains limited. This paper…

声音 · 计算机科学 2025-10-29 Baizhou Lin , Yuetong Fang , Renjing Xu , Rishad Shafik , Jagmohan Chauhan

The deep neural networks, such as the Deep-FSMN, have been widely studied for keyword spotting (KWS) applications. However, computational resources for these networks are significantly constrained since they usually run on-call on edge…

计算与语言 · 计算机科学 2022-10-21 Haotong Qin , Xudong Ma , Yifu Ding , Xiaoyang Li , Yang Zhang , Yao Tian , Zejun Ma , Jie Luo , Xianglong Liu

Smart audio devices are gated by an always-on lightweight keyword spotting program to reduce power consumption. It is however challenging to design models that have both high accuracy and low latency for accurate and fast responsiveness.…

音频与语音处理 · 电气工程与系统科学 2021-02-23 Bo Zhang , Wenfeng Li , Qingyuan Li , Weiji Zhuang , Xiangxiang Chu , Yujun Wang

The keyword spotting (KWS) problem requires large amounts of real speech training data to achieve high accuracy across diverse populations. Utilizing large amounts of text-to-speech (TTS) synthesized data can reduce the cost and time…

Recent advances in flexible keyword spotting (KWS) with text enrollment allow users to personalize keywords without uttering them during enrollment. However, there is still room for improvement in target keyword performance. In this work,…

音频与语音处理 · 电气工程与系统科学 2025-05-27 Youngmoon Jung , Jinyoung Lee , Seungjin Lee , Myunghun Jung , Yong-Hyeok Lee , Hoon-Young Cho