English
Related papers

Related papers: Regularizing Learnable Feature Extraction for Auto…

200 papers

Parameter-efficient fine-tuning (PEFT) for personalizing automatic speech recognition (ASR) has recently shown promise for adapting general population models to atypical speech. However, these approaches assume a priori knowledge of the…

Machine Learning · Computer Science 2024-07-04 Max Müller-Eberstein , Dianna Yee , Karren Yang , Gautam Varma Mantena , Colin Lea

While fine-tuning is a de facto standard method for training deep neural networks, it still suffers from overfitting when using small target datasets. Previous methods improve fine-tuning performance by maintaining knowledge of the source…

Machine Learning · Computer Science 2024-03-18 Shin'ya Yamaguchi , Sekitoshi Kanai , Kazuki Adachi , Daiki Chijiwa

It is challenging to improve automatic speech recognition (ASR) performance in noisy conditions with a single-channel speech enhancement (SE) front-end. This is generally attributed to the processing distortions caused by the nonlinear…

Audio and Speech Processing · Electrical Eng. & Systems 2024-04-24 Tsubasa Ochiai , Kazuma Iwamoto , Marc Delcroix , Rintaro Ikeshita , Hiroshi Sato , Shoko Araki , Shigeru Katagiri

Automatic Speech Recognition (ASR) models have achieved remarkable accuracy in general settings, yet their performance often degrades in domain-specific applications due to data mismatch and linguistic variability. This challenge is…

Autoregressive (AR) modeling is invaluable in signal processing, in particular in speech and audio fields. Attempts in the literature can be found that regularize or constrain either the time-domain signal values or the AR coefficients,…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-06 Ondřej Mokrý , Pavel Rajmic

Automatic speech recognition (ASR) systems often falter while processing stuttering-related disfluencies -- such as involuntary blocks and word repetitions -- yielding inaccurate transcripts. A critical barrier to progress is the scarcity…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-03 Dena Mujtaba , Nihar R. Mahapatra , Megan Arney , J. Scott Yaruss , Caryn Herring , Jia Bin

Joint training of speech enhancement model (SE) and speech recognition model (ASR) is a common solution for robust ASR in noisy environments. SE focuses on improving the auditory quality of speech, but the enhanced feature distribution is…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-04 Tianrui Wang , Weibin Zhu , Yingying Gao , Junlan Feng , Shilei Zhang

We study the segmental recurrent neural network for end-to-end acoustic modelling. This model connects the segmental conditional random field (CRF) with a recurrent neural network (RNN) used for feature extraction. Compared to most previous…

Computation and Language · Computer Science 2016-06-21 Liang Lu , Lingpeng Kong , Chris Dyer , Noah A. Smith , Steve Renals

It has been shown that the intelligibility of noisy speech can be improved by speech enhancement algorithms. However, speech enhancement has not been established as an effective frontend for robust automatic speech recognition (ASR) in…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-22 Yufeng Yang , Ashutosh Pandey , DeLiang Wang

The great success of transformer-based models in natural language processing (NLP) has led to various attempts at adapting these architectures to other domains such as vision and audio. Recent work has shown that transformers can outperform…

Sound · Computer Science 2023-01-26 Khaled Koutini , Jan Schlüter , Hamid Eghbal-zadeh , Gerhard Widmer

Automatic recognition of disordered speech remains a highly challenging task to date due to data scarcity. This paper presents a reinforcement learning (RL) based on-the-fly data augmentation approach for training state-of-the-art PyChain…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-15 Zengrui Jin , Xurong Xie , Tianzi Wang , Mengzhe Geng , Jiajun Deng , Guinan Li , Shujie Hu , Xunying Liu

In speech evaluation, an Automatic Speech Recognition (ASR) model often computes time boundaries and phoneme posteriors for input features. However, limited data for ASR training hinders expansion of speech evaluation to low-resource…

Computation and Language · Computer Science 2026-03-27 Jeremy H. M. Wong , Nancy F. Chen

Self-supervised learning representations (SSLR) have resulted in robust features for downstream tasks in many fields. Recently, several SSLRs have shown promising results on automatic speech recognition (ASR) benchmark corpora. However,…

Sound · Computer Science 2022-07-01 Szu-Jui Chen , Jiamin Xie , John H. L. Hansen

Noise-robust automatic speech recognition (ASR) has been commonly addressed by applying speech enhancement (SE) at the waveform level before recognition. However, speech-level enhancement does not always translate into consistent…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-09 Da-Hee Yang , Joon-Hyuk Chang

Automatic speech recognition (ASR) systems typically use handcrafted feature extraction pipelines. To avoid their inherent information loss and to achieve more consistent modeling from speech to transcribed text, neural raw waveform feature…

Audio and Speech Processing · Electrical Eng. & Systems 2023-08-09 Peter Vieting , Ralf Schlüter , Hermann Ney

Unification of automatic speech recognition (ASR) systems reduces development and maintenance costs, but training a single model to perform well in both offline and low-latency streaming settings remains challenging. We present a Unified…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-22 Andrei Andrusenko , Vladimir Bataev , Lilit Grigoryan , Nune Tadevosyan , Vitaly Lavrukhin , Boris Ginsburg

In this work, we introduce a simple yet efficient post-processing model for automatic speech recognition (ASR). Our model has Transformer-based encoder-decoder architecture which "translates" ASR model output into grammatically and…

Computation and Language · Computer Science 2019-10-24 Oleksii Hrinchuk , Mariya Popova , Boris Ginsburg

The performance of child speech recognition is generally less satisfactory compared to adult speech due to limited amount of training data. Significant performance degradation is expected when applying an automatic speech recognition (ASR)…

Audio and Speech Processing · Electrical Eng. & Systems 2022-05-26 Wei Liu , Jingyu Li , Tan Lee

Traditional topic identification solutions from audio rely on an automatic speech recognition system (ASR) to produce transcripts used as input to a text-based model. These approaches work well in high-resource scenarios, where there are…

Audio and Speech Processing · Electrical Eng. & Systems 2023-07-24 Dejan Porjazovski , Tamás Grósz , Mikko Kurimo

Recently, the enactment of privacy regulations has promoted the rise of the machine unlearning paradigm. Existing studies of machine unlearning mainly focus on sample-wise unlearning, such that a learnt model will not expose user's privacy…

Machine Learning · Computer Science 2022-04-19 Tao Guo , Song Guo , Jiewei Zhang , Wenchao Xu , Junxiao Wang