English
Related papers

Related papers: Relational Proxy Loss for Audio-Text based Keyword…

200 papers

End-to-end (E2E) systems have achieved competitive results compared to conventional hybrid hidden Markov model (HMM)-deep neural network based automatic speech recognition (ASR) systems. Such E2E systems are attractive due to the lack of…

Computation and Language · Computer Science 2018-02-14 Kartik Audhkhasi , Andrew Rosenberg , Abhinav Sethy , Bhuvana Ramabhadran , Brian Kingsbury

Existing metric learning losses can be categorized into two classes: pair-based and proxy-based losses. The former class can leverage fine-grained semantic relations between data points, but slows convergence in general due to its high…

Computer Vision and Pattern Recognition · Computer Science 2020-04-01 Sungyeon Kim , Dongwon Kim , Minsu Cho , Suha Kwak

Accurate on-device keyword spotting (KWS) with low false accept and false reject rate is crucial to customer experience for far-field voice control of conversational agents. It is particularly challenging to maintain low false reject rate…

Computation and Language · Computer Science 2018-08-03 Anirudh Raju , Sankaran Panchapagesan , Xing Liu , Arindam Mandal , Nikko Strom

Keyword spotting (KWS) and speaker verification (SV) are two important tasks in speech applications. Research shows that the state-of-art KWS and SV models are trained independently using different datasets since they expect to learn…

Sound · Computer Science 2022-04-01 Li Wang , Rongzhi Gu , Weiji Zhuang , Peng Gao , Yujun Wang , Yuexian Zou

Keyword spotting (KWS) and speaker verification (SV) have been studied independently although it is known that acoustic and speaker domains are complementary. In this paper, we propose a multi-task network that performs KWS and SV…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-10 Myunghun Jung , Youngmoon Jung , Jahyun Goo , Hoirin Kim

Keyword spotting (KWS) has been widely used in various speech control scenarios. The training of KWS is usually based on deep neural networks and requires a large amount of data. Manufacturers often use third-party data to train KWS.…

Sound · Computer Science 2022-11-17 Hanbo Cai , Pengcheng Zhang , Hai Dong , Yan Xiao , Shunhui Ji

As advancements in technologies like Internet of Things (IoT), Automatic Speech Recognition (ASR), Speaker Verification (SV), and Text-to-Speech (TTS) lead to increased usage of intelligent voice assistants, the demand for privacy and…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-20 Jianan Pan , Kejie Huang

The keyword spotting (KWS) problem requires large amounts of real speech training data to achieve high accuracy across diverse populations. Utilizing large amounts of text-to-speech (TTS) synthesized data can reduce the cost and time…

In this paper, we investigate representation learning for low-resource keyword spotting (KWS). The main challenges of KWS are limited labeled data and limited available device resources. To address those challenges, we explore…

Sound · Computer Science 2023-03-21 Fan Cui , Liyong Guo , Quandong Wang , Peng Gao , Yujun Wang

Acoustic word embeddings --- fixed-dimensional vector representations of arbitrary-length words --- have attracted increasing interest in query-by-example spoken term detection. Recently, on the fact that the orthography of text labels…

Audio and Speech Processing · Electrical Eng. & Systems 2019-10-02 Myunghun Jung , Hyungjun Lim , Jahyun Goo , Youngmoon Jung , Hoirin Kim

Keyword spotting (KWS) plays a critical role in enabling speech-based user interactions on smart devices. Recent developments in the field of deep learning have led to wide adoption of convolutional neural networks (CNNs) in KWS systems due…

Keyword Spotting (KWS) enables speech-based user interaction on smart devices. Always-on and battery-powered application scenarios for smart devices put constraints on hardware resources and power consumption, while also demanding high…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-05 Simon Mittermaier , Ludwig Kürzinger , Bernd Waschneck , Gerhard Rigoll

End-to-end acoustic-to-word speech recognition models have recently gained popularity because they are easy to train, scale well to large amounts of training data, and do not require a lexicon. In addition, word models may also be easier to…

Computation and Language · Computer Science 2019-02-20 Shruti Palaskar , Vikas Raunak , Florian Metze

Existing keyword spotting (KWS) systems primarily rely on predefined keyword phrases. However, the ability to recognize customized keywords is crucial for tailoring interactions with intelligent devices. In this paper, we present a novel…

Computation and Language · Computer Science 2024-11-26 Zhenyu Wang , Shuyu Kong , Li Wan , Biqiao Zhang , Yiteng Huang , Mumin Jin , Ming Sun , Xin Lei , Zhaojun Yang

In this paper we explore the possibility of maximizing the information represented in spectrograms by making the spectrogram basis functions trainable. We experiment with two different tasks, namely keyword spotting (KWS) and automatic…

Sound · Computer Science 2022-04-26 Kwan Yee Heung , Kin Wai Cheuk , Dorien Herremans

We propose a new method of generating meaningful embeddings for speech, changes to four commonly used meta learning approaches to enable them to perform keyword spotting in continuous signals and an approach of combining their outcomes into…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-26 Florian Lux , Ngoc Thang Vu

Keyword spotting (KWS) is becoming a ubiquitous need with the advancement in artificial intelligence and smart devices. Recent work in this field have focused on several different architectures to achieve good results on datasets with low…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-17 Anwesh Mohanty , Adrian Frischknecht , Christoph Gerum , Oliver Bringmann

End-to-end (E2E) spoken language understanding (SLU) systems can infer the semantics of a spoken utterance directly from an audio signal. However, training an E2E system remains a challenge, largely due to the scarcity of paired…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-16 Bhuvan Agrawal , Markus Müller , Martin Radfar , Samridhi Choudhary , Athanasios Mouchtaris , Siegfried Kunzmann

Recent advancements in scene text spotting have focused on end-to-end methodologies that heavily rely on precise location annotations, which are often costly and labor-intensive to procure. In this study, we introduce an innovative approach…

Computer Vision and Pattern Recognition · Computer Science 2025-04-23 Jing Li , Bo Wang

Keyword Spotting (KWS) remains challenging to achieve the trade-off between small footprint and high accuracy. Recently proposed metric learning approaches improved the generalizability of models for the KWS task, and 1D-CNN based KWS…

Sound · Computer Science 2021-08-13 Li Wang , Rongzhi Gu , Nuo Chen , Yuexian Zou