English
Related papers

Related papers: DONUT: CTC-based Query-by-Example Keyword Spotting

200 papers

A personalized KeyWord Spotting (KWS) pipeline typically requires the training of a Deep Learning model on a large set of user-defined speech utterances, preventing fast customization directly applied on-device. To fill this gap, this paper…

Machine Learning · Computer Science 2023-06-06 Manuele Rusci , Tinne Tuytelaars

We use dynamic time warping (DTW) as supervision for training a convolutional neural network (CNN) based keyword spotting system using a small set of spoken isolated keywords. The aim is to allow rapid deployment of a keyword spotting…

Computation and Language · Computer Science 2018-06-26 Raghav Menon , Herman Kamper , John Quinn , Thomas Niesler

The goal in word spotting is to retrieve parts of document images which are relevant with respect to a certain user-defined query. The recent past has seen attribute-based Convolutional Neural Networks take over this field of research. As…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Eugen Rusakov , Sebastian Sudholt , Fabian Wolf , Gernot A. Fink

In this paper, we propose two novel and practical deep-learning-based algorithms to solve the wireless channel type (WCT) recognition problem. Specifically, the WCT recognition problem is recast as a classification problem in deep learning…

Signal Processing · Electrical Eng. & Systems 2021-02-05 Shu Sun , Xiaofeng Li , Sungho Moon

Customized keyword spotting (KWS) has great potential to be deployed on edge devices to achieve hands-free user experience. However, in real applications, false alarm (FA) would be a serious problem for spotting dozens or even hundreds of…

Sound · Computer Science 2022-07-05 Zhanheng Yang , Sining Sun , Jin Li , Xiaoming Zhang , Xiong Wang , Long Ma , Lei Xie

Keyword spotting (KWS) based on deep neural networks (DNNs) has achieved massive success in voice control scenarios. However, training of such DNN-based KWS systems often requires significant data and hardware resources. Manufacturers often…

Sound · Computer Science 2022-12-21 Hanbo Cai , Pengcheng Zhang , Hai Dong , Yan Xiao , Shunhui Ji

We address the problem of detecting speech directed to a device that does not contain a specific wake-word. Specifically, we focus on audio coming from a touch-based invocation. Mitigating virtual assistants (VAs) activation due to…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-31 Vineet Garg , Ognjen Rudovic , Pranay Dighe , Ahmed H. Abdelaziz , Erik Marchi , Saurabh Adya , Chandra Dhir , Ahmed Tewfik

Continuous Speech Keyword Spotting (CSKWS) is a task to detect predefined keywords in a continuous speech. In this paper, we regard CSKWS as a one-dimensional object detection task and propose a novel anchor-free detector, named AF-KWS, to…

Audio and Speech Processing · Electrical Eng. & Systems 2022-08-10 Zhiyuan Zhao , Chuanxin Tang , Chengdong Yao , Chong Luo

Recognizing a particular command or a keyword, keyword spotting has been widely used in many voice interfaces such as Amazon's Alexa and Google Home. In order to recognize a set of keywords, most of the recent deep learning based approaches…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-14 Archit Parnami , Minwoo Lee

Smart audio devices are gated by an always-on lightweight keyword spotting program to reduce power consumption. It is however challenging to design models that have both high accuracy and low latency for accurate and fast responsiveness.…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-23 Bo Zhang , Wenfeng Li , Qingyuan Li , Weiji Zhuang , Xiangxiang Chu , Yujun Wang

This paper introduces a novel approach for streaming openvocabulary keyword spotting (KWS) with text-based keyword enrollment. For every input frame, the proposed method finds the optimal alignment ending at the frame using connectionist…

Sound · Computer Science 2024-09-27 Sichen Jin , Youngmoon Jung , Seungjin Lee , Jaeyoung Roh , Changwoo Han , Hoonyoung Cho

Active learning (AL) is designed to construct a high-quality labeled dataset by iteratively selecting the most informative samples. Such sampling heavily relies on data representation, while recently pre-training is popular for robust…

Machine Learning · Computer Science 2024-07-23 Beichen Zhang , Liang Li , Zheng-Jun Zha , Jiebo Luo , Qingming Huang

In this paper, we propose DS-KWS, a two-stage framework for robust user-defined keyword spotting. It combines a CTC-based method with a streaming phoneme search module to locate candidate segments, followed by a QbyT-based method with a…

Sound · Computer Science 2025-10-14 Zhiqi Ai , Han Cheng , Yuxin Wang , Shiyi Mu , Shugong Xu , Yongjin Zhou

Open-vocabulary keyword spotting (KWS), which allows users to customize keywords, has attracted increasingly more interest. However, existing methods based on acoustic models and post-processing train the acoustic model with ASR training…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-18 Ao Zhang , Pan Zhou , Kaixun Huang , Yong Zou , Ming Liu , Lei Xie

Deep neural networks provide effective solutions to small-footprint keyword spotting (KWS). However, if training data is limited, it remains challenging to achieve robust and highly accurate KWS in real-world scenarios where unseen sounds…

Audio and Speech Processing · Electrical Eng. & Systems 2021-07-14 Menglong Xu , Shengqiang Li , Chengdong Liang , Xiao-Lei Zhang

Predicting user behaviour on a website is a difficult task, which requires the integration of multiple sources of information, such as geo-location, user profile or web surfing history. In this paper we tackle the problem of predicting the…

Computation and Language · Computer Science 2018-12-19 Mihai Cristian Pîrvu , Alexandra Anghel , Ciprian Borodescu , Alexandru Constantin

Retrieving spoken content with spoken queries, or query-by- example spoken term detection (STD), is attractive because it makes possible the matching of signals directly on the acoustic level without transcribing them into text. Here, we…

Computation and Language · Computer Science 2018-04-30 Chia-Wei Ao , Hung-yi Lee

To build a satisfying chatbot that has the ability of managing a goal-oriented multi-turn dialogue, accurate modeling of human conversation is crucial. In this paper we concentrate on the task of response selection for multi-turn…

Computation and Language · Computer Science 2018-02-19 Guozhen An , Mehrnoosh Shafiee , Davood Shamsi

Connectionist Temporal Classification (CTC), a non-autoregressive training criterion, is widely used in online keyword spotting (KWS). However, existing CTC-based KWS decoding strategies either rely on Automatic Speech Recognition (ASR),…

Audio and Speech Processing · Electrical Eng. & Systems 2024-12-25 Yu Xi , Haoyu Li , Xiaoyu Gu , Hao Li , Yidi Jiang , Kai Yu

Designing an efficient keyword spotting (KWS) system that delivers exceptional performance on resource-constrained edge devices has long been a subject of significant attention. Existing KWS search algorithms typically follow a…

Audio and Speech Processing · Electrical Eng. & Systems 2024-03-21 Yu Xi , Hao Li , Baochen Yang , Haoyu Li , Hainan Xu , Kai Yu