English
Related papers

Related papers: Dual Data Scaling for Robust Two-Stage User-Define…

200 papers

Continuous Speech Keyword Spotting (CSKS) is the problem of spotting keywords in recorded conversations, when a small number of instances of keywords are available in training data. Unlike the more common Keyword Spotting, where an…

Sound · Computer Science 2019-01-15 Harshita Seth , Pulkit Kumar , Muktabh Mayank Srivastava

Most research in synthetic speech detection (SSD) focuses on improving performance on standard noise-free datasets. However, in actual situations, noise interference is usually present, causing significant performance degradation in SSD…

Sound · Computer Science 2024-04-17 Cunhang Fan , Mingming Ding , Jianhua Tao , Ruibo Fu , Jiangyan Yi , Zhengqi Wen , Zhao Lv

Using a vision-inspired keyword spotting framework, we propose an architecture with input-dependent dynamic depth capable of processing streaming audio. Specifically, we extend a conformer encoder with trainable binary gates that allow us…

Sound · Computer Science 2024-04-02 Alexandre Bittar , Paul Dixon , Mohammad Samragh , Kumari Nishu , Devang Naik

We propose a novel language-universal approach to end-to-end automatic spoken keyword recognition (SKR) leveraging upon (i) a self-supervised pre-trained model, and (ii) a set of universal speech attributes (manner and place of…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-05 Hao Yen , Pin-Jui Ku , Sabato Marco Siniscalchi , Chin-Hui Lee

Keyword spotting is the task of detecting a keyword in streaming audio. Conventional keyword spotting targets predefined keywords classification, but there is growing attention in few-shot (query-by-example) keyword spotting, e.g., N-way…

Sound · Computer Science 2022-06-29 Byeonggeun Kim , Seunghan Yang , Inseop Chung , Simyung Chang

The emergence of Artificial Intelligence (AI) driven Keyword Spotting (KWS) technologies has revolutionized human to machine interaction. Yet, the challenge of end-to-end energy efficiency, memory footprint and system complexity of current…

Audio and Speech Processing · Electrical Eng. & Systems 2021-01-28 Jie Lei , Tousif Rahman , Rishad Shafik , Adrian Wheeldon , Alex Yakovlev , Ole-Christoffer Granmo , Fahim Kawsar , Akhil Mathur

Fixed-point (FXP) inference has proven suitable for embedded devices with limited computational resources, and yet model training is continually performed in floating-point (FLP). FXP training has not been fully explored and the non-trivial…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-08 Sashank Macha , Om Oza , Alex Escott , Francesco Caliva , Robbie Armitano , Santosh Kumar Cheekatmalla , Sree Hari Krishnan Parthasarathi , Yuzong Liu

Keyword Spotting (KWS) plays a vital role in human-computer interaction for smart on-device terminals and service robots. It remains challenging to achieve the trade-off between small footprint and high accuracy for KWS task. In this paper,…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-21 Ximin Li , Xiaodong Wei , Xiaowei Qin

In this paper, we propose an unsupervised kNN-based approach for word segmentation in speech utterances. Our method relies on self-supervised pre-trained speech representations, and compares each audio segment of a given utterance to its K…

Sound · Computer Science 2022-04-28 Tzeviya Sylvia Fuchs , Yedid Hoshen , Joseph Keshet

In this paper, we investigate representation learning for low-resource keyword spotting (KWS). The main challenges of KWS are limited labeled data and limited available device resources. To address those challenges, we explore…

Sound · Computer Science 2023-03-21 Fan Cui , Liyong Guo , Quandong Wang , Peng Gao , Yujun Wang

We propose a max-pooling based loss function for training Long Short-Term Memory (LSTM) networks for small-footprint keyword spotting (KWS), with low CPU, memory, and latency requirements. The max-pooling loss training can be further guided…

Cloud computing is emerging as a revolutionary computing paradigm which pro-vides a flexible and economic strategy for data management and resource sharing. Security and privacy become major concerns in the cloud scenario, for which…

Information Retrieval · Computer Science 2017-09-01 Ruihui Zhao , Mizuho Iwaihara

In this paper, we propose a novel end-to-end user-defined keyword spotting method that utilizes linguistically corresponding patterns between speech and text sequences. Unlike previous approaches requiring speech keyword enrollment, our…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-04 Hyeon-Kyeong Shin , Hyewon Han , Doyeon Kim , Soo-Whan Chung , Hong-Goo Kang

This paper proposes a dual-stage, low complexity, and reconfigurable technique to enhance the speech contaminated by various types of noise sources. Driven by input data and audio contents, the proposed dual-stage speech enhancement…

Audio and Speech Processing · Electrical Eng. & Systems 2021-05-18 Jun Yang , Nico Brailovsky

Recent work on unsupervised speech segmentation has used self-supervised models with phone and word segmentation modules that are trained jointly. This paper instead revisits an older approach to word segmentation: bottom-up phone-like unit…

Computation and Language · Computer Science 2023-01-10 Herman Kamper

We introduce an unsupervised approach for correcting highly imperfect speech transcriptions based on a decision-level fusion of stemming and two-way phoneme pruning. Transcripts are acquired from videos by extracting audio using Ffmpeg…

Computation and Language · Computer Science 2021-07-28 Sunakshi Mehra , Seba Susan

As an important part of speech recognition technology, automatic speech keyword recognition has been intensively studied in recent years. Such technology becomes especially pivotal under situations with limited infrastructures and…

Machine Learning · Computer Science 2019-07-11 Ruisen Luo , Tianran Sun , Chen Wang , Miao Du , Zuodong Tang , Kai Zhou , Xiaofeng Gong , Xiaomei Yang

With the rapid growth of dynamic vision sensor (DVS) data, constructing a low-energy, efficient data retrieval system has become an urgent task. Hash learning is one of the most important retrieval technologies which can keep the distance…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Zihao Mei , Jianhao Li , Bolin Zhang , Chong Wang , Lijun Guo , Guoqi Li , Jiangbo Qian

Deep neural networks have recently become a popular solution to keyword spotting systems, which enable the control of smart devices via voice. In this paper, we apply neural architecture search to search for convolutional neural network…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-27 Tong Mo , Yakun Yu , Mohammad Salameh , Di Niu , Shangling Jui

Deep Neural Network--Hidden Markov Model (DNN-HMM) based methods have been successfully used for many always-on keyword spotting algorithms that detect a wake word to trigger a device. The DNN predicts the state probabilities of a given…

Sound · Computer Science 2021-03-01 Ashish Shrivastava , Arnav Kundu , Chandra Dhir , Devang Naik , Oncel Tuzel