English
Related papers

Related papers: Improved Robustness to Disfluencies in RNN-Transdu…

200 papers

Performance of spoken language understanding (SLU) can be degraded with automatic speech recognition (ASR) errors. We propose a novel approach to improve SLU robustness by randomly corrupting clean training text with an ASR error simulator,…

Computation and Language · Computer Science 2022-11-09 Yik-Cheung Tam , Jiacheng Xu , Jiakai Zou , Zecheng Wang , Tinglong Liao , Shuhan Yuan

In the past few years, it has been shown that deep learning systems are highly vulnerable under attacks with adversarial examples. Neural-network-based automatic speech recognition (ASR) systems are no exception. Targeted and untargeted…

Audio and Speech Processing · Electrical Eng. & Systems 2024-11-07 Matías Pizarro , Dorothea Kolossa , Asja Fischer

Artificial neural networks (ANN) have become the mainstream acoustic modeling technique for large vocabulary automatic speech recognition (ASR). A conventional ANN features a multi-layer architecture that requires massive amounts of…

Neural and Evolutionary Computing · Computer Science 2019-11-20 Jibin Wu , Emre Yilmaz , Malu Zhang , Haizhou Li , Kay Chen Tan

An accurate objective speech intelligibility prediction algorithms is of great interest for many applications such as speech enhancement for hearing aids. Most algorithms measures the signal-to-noise ratios or correlations between the…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-07 Zehai Tu , Ning Ma , Jon Barker

Form about four decades human beings have been dreaming of an intelligent machine which can master the natural speech. In its simplest form, this machine should consist of two subsystems, namely automatic speech recognition (ASR) and speech…

Sound · Computer Science 2013-05-08 Urmila Shrawankar , V. M. Thakare

Traditional automatic speech recognition~(ASR) systems usually focus on individual utterances, without considering long-form speech with useful historical information, which is more practical in real scenarios. Simply attending longer…

Sound · Computer Science 2022-11-18 Xun Gong , Yu Wu , Jinyu Li , Shujie Liu , Rui Zhao , Xie Chen , Yanmin Qian

A typical fluency scoring system generally relies on an automatic speech recognition (ASR) system to obtain time stamps in input speech for either the subsequent calculation of fluency-related features or directly modeling speech fluency…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-14 Wei Liu , Kaiqi Fu , Xiaohai Tian , Shuju Shi , Wei Li , Zejun Ma , Tan Lee

Encoder-decoder based sequence-to-sequence models have demonstrated state-of-the-art results in end-to-end automatic speech recognition (ASR). Recently, the transformer architecture, which uses self-attention to model temporal context…

Sound · Computer Science 2020-07-02 Niko Moritz , Takaaki Hori , Jonathan Le Roux

A stream attention framework has been applied to the posterior probabilities of the deep neural network (DNN) to improve the far-field automatic speech recognition (ASR) performance in the multi-microphone configuration. The stream…

Sound · Computer Science 2017-12-01 Xiaofei Wang , Yonghong Yan , Hynek Hermansky

Self-attentive neural syntactic parsers using contextualized word embeddings (e.g. ELMo or BERT) currently produce state-of-the-art results in joint parsing and disfluency detection in speech transcripts. Since the contextualized word…

Computation and Language · Computer Science 2020-04-30 Paria Jamshid Lou , Mark Johnson

Transducer is one of the mainstream frameworks for streaming speech recognition. There is a performance gap between the streaming and non-streaming transducer models due to limited context. To reduce this gap, an effective way is to ensure…

Computation and Language · Computer Science 2023-06-28 Haitao Tang , Yu Fu , Lei Sun , Jiabin Xue , Dan Liu , Yongchao Li , Zhiqiang Ma , Minghui Wu , Jia Pan , Genshun Wan , Ming'en Zhao

The automated classification of stuttered speech has significant implications for timely assessments providing assistance to speech language pathologists. Despite notable advancements in the field, the cases in which multiple disfluencies…

Sound · Computer Science 2025-02-27 Huma Ameer , Seemab Latif , Mehwish Fatima

Diffusion and flow-based non-autoregressive (NAR) models have shown strong promise in large language modeling, however, their potential for automatic speech recognition (ASR) remains largely unexplored. We propose Drax, a discrete flow…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-07 Aviv Navon , Aviv Shamsian , Neta Glazer , Yael Segal-Feldman , Gill Hetz , Joseph Keshet , Ethan Fetaya

In this work, we introduce a simple yet efficient post-processing model for automatic speech recognition (ASR). Our model has Transformer-based encoder-decoder architecture which "translates" ASR model output into grammatically and…

Computation and Language · Computer Science 2019-10-24 Oleksii Hrinchuk , Mariya Popova , Boris Ginsburg

We enhance the vanilla adversarial training method for unsupervised Automatic Speech Recognition (ASR) by a diffusion-GAN. Our model (1) injects instance noises of various intensities to the generator's output and unlabeled reference text…

Computation and Language · Computer Science 2023-03-27 Xianchao Wu

Speech transcription, emotion recognition, and language identification are usually considered to be three different tasks. Each one requires a different model with a different architecture and training process. We propose using a recurrent…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-29 Zvi Kons , Hagai Aronowitz , Edmilson Morais , Matheus Damasceno , Hong-Kwang Kuo , Samuel Thomas , George Saon

Text encodings from automatic speech recognition (ASR) transcripts and audio representations have shown promise in speech emotion recognition (SER) ever since. Yet, it is challenging to explain the effect of each information stream on the…

Consumer speech recognition systems do not work as well for many people with speech diferences, such as stuttering, relative to the rest of the general population. However, what is not clear is the degree to which these systems do not work,…

Human-Computer Interaction · Computer Science 2023-02-28 Colin Lea , Zifang Huang , Lauren Tooley , Jaya Narain , Dianna Yee , Panayiotis Georgiou , Tien Dung Tran , Jeffrey P. Bigham , Leah Findlater

Automatic Speech Recognition (ASR) systems exhibit the best performance on speech that is similar to that on which it was trained. As such, underrepresented varieties including regional dialects, minority-speakers, and low-resource…

Computation and Language · Computer Science 2023-05-15 Emma O'Neill , Julie Carson-Berndsen

A deep learning approach has been widely applied in sequence modeling problems. In terms of automatic speech recognition (ASR), its performance has significantly been improved by increasing large speech corpus and deeper neural network.…

Computation and Language · Computer Science 2016-12-28 Zewang Zhang , Zheng Sun , Jiaqi Liu , Jingwen Chen , Zhao Huo , Xiao Zhang