English
Related papers

Related papers: Matching Latent Encoding for Audio-Text based Keyw…

200 papers

In this paper we present a data-driven, integrated approach to speaker verification, which maps a test utterance and a few reference utterances directly to a single score for verification and jointly optimizes the system's components using…

Machine Learning · Computer Science 2015-09-29 Georg Heigold , Ignacio Moreno , Samy Bengio , Noam Shazeer

Deep Neural Network--Hidden Markov Model (DNN-HMM) based methods have been successfully used for many always-on keyword spotting algorithms that detect a wake word to trigger a device. The DNN predicts the state probabilities of a given…

Sound · Computer Science 2021-03-01 Ashish Shrivastava , Arnav Kundu , Chandra Dhir , Devang Naik , Oncel Tuzel

The currently most prominent algorithm to train keyword spotting (KWS) models with deep neural networks (DNNs) requires strong supervision i.e., precise knowledge of the spoken keyword location in time. Thus, most KWS approaches treat the…

Sound · Computer Science 2023-05-31 Heinrich Dinkel , Weiji Zhuang , Zhiyong Yan , Yongqing Wang , Junbo Zhang , Yujun Wang

In this paper, we propose several methods that incorporate vocal tract length (VTL) warped features for spoken keyword spotting (KWS). The first method, VTL-independent KWS, involves training a single deep neural network (DNN) that utilizes…

Sound · Computer Science 2025-01-08 Achintya kr. Sarkar , Priyanka Dwivedi , Zheng-Hua Tan

Keyword spotting (KWS) plays an essential role in enabling speech-based user interaction on smart devices, and conventional KWS (C-KWS) approaches have concentrated on detecting user-agnostic pre-defined keywords. However, in practice, most…

Sound · Computer Science 2022-06-29 Seunghan Yang , Byeonggeun Kim , Inseop Chung , Simyung Chang

We propose an architecture to jointly learn word and label embeddings for slot filling in spoken language understanding. The proposed approach encodes labels using a combination of word embeddings and straightforward word-label association…

Computation and Language · Computer Science 2019-10-17 Jiewen Wu , Luis Fernando D'Haro , Nancy F. Chen , Pavitra Krishnaswamy , Rafael E. Banchs

We explore the application of end-to-end stateless temporal modeling to small-footprint keyword spotting as opposed to recurrent networks that model long-term temporal dependencies using internal states. We propose a model inspired by the…

Machine Learning · Computer Science 2019-02-19 Alice Coucke , Mohammed Chlieh , Thibault Gisselbrecht , David Leroy , Mathieu Poumeyrol , Thibaut Lavril

Text classification is a challenging problem which aims to identify the category of texts. In the process of training, word embeddings occupy a large part of parameters. Under the limitation of limited computing resources, it indirectly…

Machine Learning · Computer Science 2022-06-03 Hao Ren , Hong Lu

Despite the great success of word embedding, sentence embedding remains a not-well-solved problem. In this paper, we present a supervised learning framework to exploit sentence embedding for the medical question answering task. The learning…

Computation and Language · Computer Science 2018-11-16 Yu Hao , Xien Liu , Ji Wu , Ping Lv

This paper investigates the impact of word-based RNN language models (RNN-LMs) on the performance of end-to-end automatic speech recognition (ASR). In our prior work, we have proposed a multi-level LM, in which character-based and…

Computation and Language · Computer Science 2018-08-09 Takaaki Hori , Jaejin Cho , Shinji Watanabe

In recent years, there has been a growing interest in designing small-footprint yet effective Connectionist Temporal Classification based keyword spotting (CTC-KWS) systems. They are typically deployed on low-resource computing platforms,…

Audio and Speech Processing · Electrical Eng. & Systems 2024-12-25 Yu Xi , Haoyu Li , Hao Li , Jiaqi Guo , Xu Li , Wen Ding , Kai Yu

Large size models are implemented in recently ASR system to deal with complex speech recognition problems. The num- ber of parameters in these models makes them hard to deploy, especially on some resource-short devices such as car tablet.…

Machine Learning · Computer Science 2018-07-10 Sihao Xue , Zhenyi Ying , Fan Mo , Min Wang , Jue Sun

In this paper, we study zero-shot learning in audio classification via semantic embeddings extracted from textual labels and sentence descriptions of sound classes. Our goal is to obtain a classifier that is capable of recognizing audio…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-12 Huang Xie , Tuomas Virtanen

Keyword spotting is an important research field because it plays a key role in device wake-up and user interaction on smart devices. However, it is challenging to minimize errors while operating efficiently in devices with limited resources…

Sound · Computer Science 2023-07-06 Byeonggeun Kim , Simyung Chang , Jinkyu Lee , Dooyong Sung

In embedding-matching acoustic-to-word (A2W) ASR, every word in the vocabulary is represented by a fixed-dimension embedding vector that can be added or removed independently of the rest of the system. The approach is potentially an elegant…

Audio and Speech Processing · Electrical Eng. & Systems 2023-02-21 Hao Yen , Woojay Jeon

We propose a practical approach based on federated learning to solve out-of-domain issues with continuously running embedded speech-based models such as wake word detectors. We conduct an extensive empirical study of the federated averaging…

Audio and Speech Processing · Electrical Eng. & Systems 2019-02-19 David Leroy , Alice Coucke , Thibaut Lavril , Thibault Gisselbrecht , Joseph Dureau

Keyword Spotting (KWS) provides the start signal of ASR problem, and thus it is essential to ensure a high recall rate. However, its real-time property requires low computation complexity. This contradiction inspires people to find a…

Computation and Language · Computer Science 2018-11-07 Yixiao Qu , Sihao Xue , Zhenyi Ying , Hang Zhou , Jue Sun

Scene text spotting is essential in various computer vision applications, enabling extracting and interpreting textual information from images. However, existing methods often neglect the spatial semantics of word images, leading to…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Hao Wang , Huabing Zhou , Yanduo Zhang , Tao Lu , Jiayi Ma

This paper introduces the system submitted by the Yidun NISP team to the video keyword wakeup challenge. We propose a mandarin keyword spotting system (KWS) with several novel and effective improvements, including a big backbone (B) model,…

Computation and Language · Computer Science 2021-12-06 Yuting Yang , Binbin Du , Yingxin Zhang , Wenxuan Wang , Yuke Li

Word embedding, which encodes words into vectors, is an important starting point in natural language processing and commonly used in many text-based machine learning tasks. However, in most current word embedding approaches, the similarity…

Computation and Language · Computer Science 2018-12-27 Denis Sedov , Zhirong Yang