English
Related papers

Related papers: VE-KWS: Visual Modality Enhanced End-to-End Keywor…

200 papers

Keyword spotting and in particular Wake-Up-Word (WUW) detection is a very important task for voice assistants. A very common issue of voice assistants is that they get easily activated by background noise like music, TV or background speech…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-01 David Bonet , Guillermo Cámbara , Fernando López , Pablo Gómez , Carlos Segura , Jordi Luque

Keyword Spotting (KWS) systems with small footprint models deployed on edge devices face significant accuracy and robustness challenges due to domain shifts caused by varying noise and recording conditions. To address this, we propose a…

Sound · Computer Science 2026-01-23 Prakash Dhungana , Sayed Ahmad Salehi

Keyword spotting (KWS) is essential for voice-driven applications, demanding both accuracy and efficiency. Traditional ASR-based KWS methods, such as greedy and beam search, explore the entire search space without explicitly prioritizing…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-01 Yu Xi , Haoyu Li , Xiaoyu Gu , Yidi Jiang , Kai Yu

While speech interaction finds widespread utility within the Extended Reality (XR) domain, conventional vocal speech keyword spotting systems continue to grapple with formidable challenges, including suboptimal performance in noisy…

Human-Computer Interaction · Computer Science 2024-01-29 Zhuojiang Cai , Yuhan Ma , Feng Lu

Keyword Spotting plays a critical role in enabling hands-free interaction for battery-powered edge devices. Few-Shot Keyword Spotting (FS-KWS) addresses the scalability and adaptability challenges of traditional systems by enabling…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-09 Alican Gok , Oguzhan Buyuksolak , Osman Erman Okman , Murat Saraclar

Keyword Spotting (KWS) enables speech-based user interaction on smart devices. Always-on and battery-powered application scenarios for smart devices put constraints on hardware resources and power consumption, while also demanding high…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-05 Simon Mittermaier , Ludwig Kürzinger , Bernd Waschneck , Gerhard Rigoll

This paper addresses the persistent challenge in Keyword Spotting (KWS), a fundamental component in speech technology, regarding the acquisition of substantial labeled data for training. Given the difficulty in obtaining large quantities of…

Sound · Computer Science 2024-09-04 Weinan Dai , Yifeng Jiang , Yuanjing Liu , Jinkun Chen , Xin Sun , Jinglei Tao

Spoken keyword spotting (KWS) aims to identify keywords in audio for wide applications, especially on edge devices. Current small-footprint KWS systems focus on efficient model designs. However, their inference performance can decline in…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-21 Yang Xiao , Tianyi Peng , Yanghao Zhou , Rohan Kumar Das

Keyword spotting (KWS) is a core human-machine-interaction front-end task for most modern intelligent assistants. Recently, a unified (UniKW-AT) framework has been proposed that adds additional capabilities in the form of audio tagging (AT)…

Sound · Computer Science 2023-03-06 Heinrich Dinkel , Yongqing Wang , Zhiyong Yan , Junbo Zhang , Yujun Wang

Open-vocabulary keyword spotting (KWS) refers to the task of detecting words or terms within speech recordings, regardless of whether they were included in the training data. This paper introduces an open-vocabulary keyword spotting model…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-08 Yael Segal-Feldman , Ann R. Bradlow , Matthew Goldrick , Joseph Keshet

Keyword Spotting (KWS) is an essential component in a smart device for alerting the system when a user prompts it with a command. As these devices are typically constrained by computational and energy resources, the KWS model should be…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-24 Donghyeon Kim , Kyungdeuk Ko , David K. Han , Hanseok Ko

This paper introduces the system submitted by the Yidun NISP team to the video keyword wakeup challenge. We propose a mandarin keyword spotting system (KWS) with several novel and effective improvements, including a big backbone (B) model,…

Computation and Language · Computer Science 2021-12-06 Yuting Yang , Binbin Du , Yingxin Zhang , Wenxuan Wang , Yuke Li

In this paper, we propose an attention-based end-to-end neural approach for small-footprint keyword spotting (KWS), which aims to simplify the pipelines of building a production-quality KWS system. Our model consists of an encoder and an…

Sound · Computer Science 2018-03-30 Changhao Shan , Junbo Zhang , Yujun Wang , Lei Xie

The goal of this work is to automatically determine whether and when a word of interest is spoken by a talking face, with or without the audio. We propose a zero-shot method suitable for in the wild videos. Our key contributions are: (1) a…

Computer Vision and Pattern Recognition · Computer Science 2020-09-07 Liliane Momeni , Triantafyllos Afouras , Themos Stafylakis , Samuel Albanie , Andrew Zisserman

In this paper, we propose a sequence-to-sequence model for keyword spotting (KWS). Compared with other end-to-end architectures for KWS, our model simplifies the pipelines of production-quality KWS system and satisfies the requirement of…

Sound · Computer Science 2018-11-02 Haitong Zhang , Junbo Zhang , Yujun Wang

User-defined keyword spotting (KWS) without resorting to domain-specific pre-labeled training data is of fundamental importance in building adaptable and personalized voice interfaces. However, such systems are still faced with arduous…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-07 Lo-Ya Li , Tien-Hong Lo , Jeih-Weih Hung , Shih-Chieh Huang , Berlin Chen

User-defined keyword spotting (KWS) is crucial for personalized voice interaction, yet existing methods face several challenges: (1) insufficient discriminability among confusable words, (2) performance inconsistency across speakers with…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-22 Zhiqi Ai , Han Cheng , Shiyi Mu , Xinnuo Li , Yongjin Zhou , Shugong Xu

In recent years, neural network-based Wake Word Spotting achieves good performance on clean audio samples but struggles in noisy environments. Audio-Visual Wake Word Spotting (AVWWS) receives lots of attention because visual lip movement…

Sound · Computer Science 2024-03-05 Haoxu Wang , Ming Cheng , Qiang Fu , Ming Li

Real-world complex acoustic environments especially the ones with a low signal-to-noise ratio (SNR) will bring tremendous challenges to a keyword spotting (KWS) system. Inspired by the recent advances of neural speech enhancement and…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-14 Shubo Lv , Xiong Wang , Sining Sun , Long Ma , Lei Xie

With the increasing prevalence of voice-activated devices and applications, keyword spotting (KWS) models enable users to interact with technology hands-free, enhancing convenience and accessibility in various contexts. Deploying KWS models…

Audio and Speech Processing · Electrical Eng. & Systems 2025-04-29 Jonathan Svirsky , Uri Shaham , Ofir Lindenbaum