中文
相关论文

相关论文: Zero-Shot KWS for Children's Speech using Layer-Wi…

200 篇论文

Using audio and text embeddings jointly for Keyword Spotting (KWS) has shown high-quality results, but the key challenge of how to semantically align two embeddings for multi-word keywords of different sequence lengths remains largely…

音频与语音处理 · 电气工程与系统科学 2023-06-09 Kumari Nishu , Minsik Cho , Devang Naik

Continuous Speech Keyword Spotting (CSKWS) is a task to detect predefined keywords in a continuous speech. In this paper, we regard CSKWS as a one-dimensional object detection task and propose a novel anchor-free detector, named AF-KWS, to…

音频与语音处理 · 电气工程与系统科学 2022-08-10 Zhiyuan Zhao , Chuanxin Tang , Chengdong Yao , Chong Luo

This paper introduces the system submitted by the Yidun NISP team to the video keyword wakeup challenge. We propose a mandarin keyword spotting system (KWS) with several novel and effective improvements, including a big backbone (B) model,…

计算与语言 · 计算机科学 2021-12-06 Yuting Yang , Binbin Du , Yingxin Zhang , Wenxuan Wang , Yuke Li

Spoken keyword spotting (KWS) is the task of identifying a keyword in an audio stream and is widely used in smart devices at the edge in order to activate voice assistants and perform hands-free tasks. The task is daunting as there is a…

计算与语言 · 计算机科学 2024-05-07 Mahmoud Salhab , Haidar Harmanani

While recent zero-shot multi-speaker text-to-speech (TTS) models achieve impressive results, they typically rely on extensive transcribed speech datasets from numerous speakers and intricate training pipelines. Meanwhile, self-supervised…

音频与语音处理 · 电气工程与系统科学 2025-02-04 Karl El Hajal , Ajinkya Kulkarni , Enno Hermann , Mathew Magimai. -Doss

The keyword spotting (KWS) problem requires large amounts of real speech training data to achieve high accuracy across diverse populations. Utilizing large amounts of text-to-speech (TTS) synthesized data can reduce the cost and time…

Despite advancements in ASR, child speech recognition remains challenging due to acoustic variability and limited annotated data. While fine-tuning adult ASR models on child speech is common, comparisons with flat-start training remain…

Keyword spotting (KWS) and speaker verification (SV) have been studied independently although it is known that acoustic and speaker domains are complementary. In this paper, we propose a multi-task network that performs KWS and SV…

音频与语音处理 · 电气工程与系统科学 2020-08-10 Myunghun Jung , Youngmoon Jung , Jahyun Goo , Hoirin Kim

This paper introduces the system submitted by the DKU-SMIIP team for the Auto-KWS 2021 Challenge. Our implementation consists of a two-stage keyword spotting system based on query-by-example spoken term detection and a speaker verification…

音频与语音处理 · 电气工程与系统科学 2021-04-13 Yechen Wang , Yan Jia , Murong Ma , Zexin Cai , Ming Li

Wav2Prompt is proposed which allows straightforward integration between spoken input and a text-based large language model (LLM). Wav2Prompt uses a simple training process with only the same data used to train an automatic speech…

音频与语音处理 · 电气工程与系统科学 2024-06-05 Keqi Deng , Guangzhi Sun , Philip C. Woodland

An accurate assessment of L2 English pronunciation is crucial for language learning, as it provides personalized feedback and ensures a fair evaluation of individual progress. However, automated scoring remains challenging due to the…

音频与语音处理 · 电气工程与系统科学 2026-01-26 Aditya Kamlesh Parikh , Cristian Tejedor-Garcia , Catia Cucchiarini , Helmer Strik

The IEEE Spoken Language Technology Workshop (SLT) 2021 Alpha-mini Speech Challenge (ASC) is intended to improve research on keyword spotting (KWS) and sound source location (SSL) on humanoid robots. Many publications report significant…

This paper introduces an automated framework WSW2.0 for analyzing vocal interactions in preschool classrooms, enhancing both accuracy and scalability through the integration of wav2vec2-based speaker classification and Whisper (large-v2 and…

音频与语音处理 · 电气工程与系统科学 2025-10-27 Anchen Sun , Tiantian Feng , Gabriela Gutierrez , Juan J Londono , Anfeng Xu , Batya Elbaum , Shrikanth Narayanan , Lynn K Perry , Daniel S Messinger

In this study, we investigate the application of keyword spotting (KWS) in the domain of Hindi speech recognition, utilizing a dataset comprising 40,000 audio samples. With a sampling rate of 44 kHz and an average duration of 1.9 seconds…

声音 · 计算机科学 2026-05-06 Saru Bharti , Pushparaj Mani Pathak

Within the audio research community and the industry, keyword spotting (KWS) and audio tagging (AT) are seen as two distinct tasks and research fields. However, from a technical point of view, both of these tasks are identical: they predict…

声音 · 计算机科学 2022-09-26 Heinrich Dinkel , Yongqing Wang , Zhiyong Yan , Junbo Zhang , Yujun Wang

Deep neural networks provide effective solutions to small-footprint keyword spotting (KWS). However, if training data is limited, it remains challenging to achieve robust and highly accurate KWS in real-world scenarios where unseen sounds…

音频与语音处理 · 电气工程与系统科学 2021-07-14 Menglong Xu , Shengqiang Li , Chengdong Liang , Xiao-Lei Zhang

Keyword spotting (KWS) and speaker verification (SV) are two important tasks in speech applications. Research shows that the state-of-art KWS and SV models are trained independently using different datasets since they expect to learn…

声音 · 计算机科学 2022-04-01 Li Wang , Rongzhi Gu , Weiji Zhuang , Peng Gao , Yujun Wang , Yuexian Zou

Token-based text-to-speech (TTS) models have emerged as a promising avenue for generating natural and realistic speech, yet they grapple with low pronunciation accuracy, speaking style and timbre inconsistency, and a substantial need for…

声音 · 计算机科学 2024-03-12 Chunhui Wang , Chang Zeng , Bowen Zhang , Ziyang Ma , Yefan Zhu , Zifeng Cai , Jian Zhao , Zhonglin Jiang , Yong Chen

Keyword spotting (KWS) is becoming a ubiquitous need with the advancement in artificial intelligence and smart devices. Recent work in this field have focused on several different architectures to achieve good results on datasets with low…

音频与语音处理 · 电气工程与系统科学 2021-09-17 Anwesh Mohanty , Adrian Frischknecht , Christoph Gerum , Oliver Bringmann

In recent years, there has been a growing interest in designing small-footprint yet effective Connectionist Temporal Classification based keyword spotting (CTC-KWS) systems. They are typically deployed on low-resource computing platforms,…

音频与语音处理 · 电气工程与系统科学 2024-12-25 Yu Xi , Haoyu Li , Hao Li , Jiaqi Guo , Xu Li , Wen Ding , Kai Yu