English
Related papers

Related papers: Device-Directed Speech Detection: Regularization v…

200 papers

The current trend in automatic speech recognition is to leverage large amounts of labeled data to train supervised neural network models. Unfortunately, obtaining data for a wide range of domains to train robust models can be costly.…

Computation and Language · Computer Science 2018-06-14 Wei-Ning Hsu , Hao Tang , James Glass

This paper studies the problem of pre-training for small models, which is essential for many mobile devices. Current state-of-the-art methods on this problem transfer the representational knowledge of a large network (as a Teacher) into a…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Mingsheng Li , Lin Zhang , Mingzhen Zhu , Zilong Huang , Gang Yu , Jiayuan Fan , Tao Chen

For training a few-shot keyword spotting (FS-KWS) model, a large labeled dataset containing massive target keywords has known to be essential to generalize to arbitrary target keywords with only a few enrollment samples. To alleviate the…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-10 Dongjune Lee , Minchan Kim , Sung Hwan Mun , Min Hyun Han , Nam Soo Kim

The optimization of a wavelet-based algorithm to improve speech intelligibility along with the full data set and results are reported. The discrete-time speech signal is split into frequency sub-bands via a multi-level discrete wavelet…

Sound · Computer Science 2022-07-25 Tianqu Kang , Anh-Dung Dinh , Binghong Wang , Tianyuan Du , Yijia Chen , Kevin Chau

Model architectures such as wav2vec 2.0 and HuBERT have been proposed to learn speech representations from audio waveforms in a self-supervised manner. When they are combined with downstream tasks such as keyword spotting and speaker…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-22 Mine Kerpicci , Van Nguyen , Shuhua Zhang , Erik Visser

Dysarthria is a speech disorder that hinders communication due to difficulties in articulating words. Detection of dysarthria is important for several reasons as it can be used to develop a treatment plan and help improve a person's quality…

Automatic recognition of disordered speech remains a highly challenging task to date due to data scarcity. This paper presents a reinforcement learning (RL) based on-the-fly data augmentation approach for training state-of-the-art PyChain…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-15 Zengrui Jin , Xurong Xie , Tianzi Wang , Mengzhe Geng , Jiajun Deng , Guinan Li , Shujie Hu , Xunying Liu

Deep learning methods show promising results for overlapping cervical cell instance segmentation. However, in order to train a model with good generalization ability, voluminous pixel-level annotations are demanded which is quite expensive…

Computer Vision and Pattern Recognition · Computer Science 2020-07-22 Yanning Zhou , Hao Chen , Huangjing Lin , Pheng-Ann Heng

Label noise is emerging as a pressing issue in sound event classification. This arises as we move towards larger datasets that are difficult to annotate manually, but it is even more severe if datasets are collected automatically from…

Sound · Computer Science 2019-10-29 Eduardo Fonseca , Frederic Font , Xavier Serra

Hand-crafting high quality prompts to optimize the performance of language models is a complicated and labor-intensive process. Furthermore, when migrating to newer, smaller, or weaker models (possibly due to latency or cost gains), prompts…

Voice interfaces integral to the human-computer interaction systems can benefit from speech emotion recognition (SER) to customize responses based on user emotions. Since humans convey emotions through multi-modal audio-visual cues,…

Machine Learning · Computer Science 2025-07-02 Varsha Pendyala , Pedro Morgado , William Sethares

As unlabeled data carry rich task-relevant information, they are proven useful for few-shot learning of language model. The question is how to effectively make use of such data. In this work, we revisit the self-training technique for…

Computation and Language · Computer Science 2021-10-05 Yiming Chen , Yan Zhang , Chen Zhang , Grandee Lee , Ran Cheng , Haizhou Li

ASR systems struggle with non-normative speech due to high acoustic variability and data scarcity. We propose a data-efficient method using phoneme-level uncertainty to guide fine-tuning for personalization. Instead of computationally…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-17 Niclas Pokel , Pehuén Moure , Roman Böhringer , Yingqiang Gao

Speech recognition has of late become a practical technology for real world applications. Aiming at speech-driven text retrieval, which facilitates retrieving information with spoken queries, we propose a method to integrate speech…

Computation and Language · Computer Science 2007-05-23 Atsushi Fujii , Katunobu Itou , Tetsuya Ishikawa

State-of-the-art machine learning models require access to significant amount of annotated data in order to achieve the desired level of performance. While unlabelled data can be largely available and even abundant, annotation process can…

Machine Learning · Computer Science 2020-10-15 Rahaf Aljundi , Nikolay Chumerin , Daniel Olmeda Reino

Despite recent advances in end-to-end speech recognition methods, the output tends to be biased to the training data's vocabulary, resulting in inaccurate recognition of proper nouns and other unknown terms. To address this issue, we…

Computation and Language · Computer Science 2025-06-03 Yu Nakagome , Michael Hentschel

This paper investigates the industrial setting of real-time classification of early media exchanged during the initialization phase of voice calls. We explore the application of state-of-the-art audio tagging models and highlight some…

Sound · Computer Science 2025-07-28 Kemal Altwlkany , Hadžem Hadžić , Amar Kurić , Emanuel Lacic

Large self-supervised models are effective feature extractors, but their application is challenging under on-device budget constraints and biased dataset collection, especially in keyword spotting. To address this, we proposed a knowledge…

Computation and Language · Computer Science 2023-07-07 Gene-Ping Yang , Yue Gu , Qingming Tang , Dongsu Du , Yuzong Liu

Incremental language learning with pseudo-data can alleviate catastrophic forgetting in neural networks. However, to obtain better performance, former methods have higher demands for pseudo-data of the previous tasks. The performance…

Computation and Language · Computer Science 2021-10-19 Han Wang , Ruiliu Fu , Chengzhang Li , Xuejun Zhang , Jun Zhou , Yonghong Yan

Real-world data often exhibit long-tailed distributions with numerous noisy labels, substantially degrading the performance of deep models. While prior research has made progress in addressing this combined challenge, it overlooks the…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Mengke Li , Haiquan Ling , Yiqun Zhang , Yang Lu , Hui Huang