English
Related papers

Related papers: MM-KWS: Multi-modal Prompts for Multilingual User-…

200 papers

In this paper, we propose several methods that incorporate vocal tract length (VTL) warped features for spoken keyword spotting (KWS). The first method, VTL-independent KWS, involves training a single deep neural network (DNN) that utilizes…

Sound · Computer Science 2025-01-08 Achintya kr. Sarkar , Priyanka Dwivedi , Zheng-Hua Tan

Real-world complex acoustic environments especially the ones with a low signal-to-noise ratio (SNR) will bring tremendous challenges to a keyword spotting (KWS) system. Inspired by the recent advances of neural speech enhancement and…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-14 Shubo Lv , Xiong Wang , Sining Sun , Long Ma , Lei Xie

A keyword spotting (KWS) engine that is continuously running on device is exposed to various speech signals that are usually unseen before. It is a challenging problem to build a small-footprint and high-performing KWS model with robustness…

Sound · Computer Science 2024-08-27 Zhenyu Wang , Li Wan , Biqiao Zhang , Yiteng Huang , Shang-Wen Li , Ming Sun , Xin Lei , Zhaojun Yang

In recent years, there has been an increasing focus on user convenience, leading to increased interest in text-based keyword enrollment systems for keyword spotting (KWS). Since the system utilizes text input during the enrollment phase and…

Audio and Speech Processing · Electrical Eng. & Systems 2024-12-31 Youngmoon Jung , Seungjin Lee , Joon-Young Yang , Jaeyoung Roh , Chang Woo Han , Hoon-Young Cho

Keyword Spotting (KWS) enables speech-based user interaction on smart devices. Always-on and battery-powered application scenarios for smart devices put constraints on hardware resources and power consumption, while also demanding high…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-05 Simon Mittermaier , Ludwig Kürzinger , Bernd Waschneck , Gerhard Rigoll

Auto-KWS 2021 challenge calls for automated machine learning (AutoML) solutions to automate the process of applying machine learning to a customized keyword spotting task. Compared with other keyword spotting tasks, Auto-KWS challenge has…

Sound · Computer Science 2021-04-02 Jingsong Wang , Yuxuan He , Chunyu Zhao , Qijie Shao , Wei-Wei Tu , Tom Ko , Hung-yi Lee , Lei Xie

Smart audio devices are gated by an always-on lightweight keyword spotting program to reduce power consumption. It is however challenging to design models that have both high accuracy and low latency for accurate and fast responsiveness.…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-23 Bo Zhang , Wenfeng Li , Qingyuan Li , Weiji Zhuang , Xiangxiang Chu , Yujun Wang

In this paper, we propose an attention-based end-to-end model for multi-channel keyword spotting (KWS), which is trained to optimize the KWS result directly. As a result, our model outperforms the baseline model with signal pre-processing…

Sound · Computer Science 2018-11-06 Haitong Zhang , Junbo Zhang , Yujun Wang

Keyword spotting (KWS) is a key component of smart devices, enabling efficient and intuitive audio interaction. However, standard KWS systems deployed on embedded devices often suffer performance degradation under real-world operating…

Small footprint embedded devices require keyword spotters (KWS) with small model size and detection latency for enabling voice assistants. Such a keyword is often referred to as \textit{wake word} as it is used to wake up voice assistant…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-16 Christin Jose , Yuriy Mishchenko , Thibaud Senechal , Anish Shah , Alex Escott , Shiv Vitaladevuni

This literature review surveys the advancements of keyword spotting (KWS) technologies, specifically focusing on Urdu, Pakistan's low-resource language (LRL), which has complex phonetics. Despite the global strides in speech technology,…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-26 Syed Muhammad Aqdas Rizvi

This paper proposes a self-learning method to incrementally train (fine-tune) a personalized Keyword Spotting (KWS) model after the deployment on ultra-low power smart audio sensors. We address the fundamental problem of the absence of…

Sound · Computer Science 2025-03-10 Manuele Rusci , Francesco Paci , Marco Fariselli , Eric Flamand , Tinne Tuytelaars

Conversational agents commonly utilize keyword spotting (KWS) to initiate voice interaction with the user. For user experience and privacy considerations, existing approaches to KWS largely focus on accuracy, which can often come at the…

Audio and Speech Processing · Electrical Eng. & Systems 2022-09-30 Christin Jose , Joseph Wang , Grant P. Strimel , Mohammad Omar Khursheed , Yuriy Mishchenko , Brian Kulis

Spoken Keyword Spotting (KWS) is the task of distinguishing between the presence and absence of a keyword in audio. The accuracy of a KWS model hinges on its ability to correctly classify examples close to the keyword and non-keyword…

Sound · Computer Science 2026-02-06 Harry Zhang , Kurt Partridge , Pai Zhu , Neng Chen , Hyun Jin Park , Dhruuv Agarwal , Quan Wang

Keyword spotting (KWS) and speaker verification (SV) have been studied independently although it is known that acoustic and speaker domains are complementary. In this paper, we propose a multi-task network that performs KWS and SV…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-10 Myunghun Jung , Youngmoon Jung , Jahyun Goo , Hoirin Kim

Despite their great performance over the years, handcrafted speech features are not necessarily optimal for any particular speech application. Consequently, with greater or lesser success, optimal filterbank learning has been studied for…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-02 Iván López-Espejo , Zheng-Hua Tan , Jesper Jensen

Identifying user-defined keywords is crucial for personalizing interactions with smart devices. Previous approaches of user-defined keyword spotting (UDKWS) have relied on short-term spectral features such as mel frequency cepstral…

Sound · Computer Science 2024-05-24 Kesavaraj V , Anuprabha M , Anil Kumar Vuppala

In this paper, we propose a deep convolutional neural network-based acoustic word embedding system on code-switching query by example spoken term detection. Different from previous configurations, we combine audio data in two languages for…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-26 Murong Ma , Haiwei Wu , Xuyang Wang , Lin Yang , Junjie Wang , Ming Li

In order to maximize detection precision rate as well as the recall rate, this paper proposes an in-vehicle multi-source fusion scheme in Keyword Spotting (KWS) System for vehicle applications. Vehicle information, as a new source for the…

Machine Learning · Computer Science 2019-02-19 Yue Tan , Kan Zheng , Lei Lei

For text enrollment-based open-vocabulary keyword spotting (KWS), acoustic and text embeddings are typically compared at either the phoneme or utterance level. To facilitate this, we optimize acoustic and text encoders using deep metric…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-26 Youngmoon Jung , Yong-Hyeok Lee , Myunghun Jung , Jaeyoung Roh , Chang Woo Han , Hoon-Young Cho