English
Related papers

Related papers: Evaluating Automatic Speech Recognition in an Incr…

200 papers

We introduce a method to identify speakers by computing with high-dimensional random vectors. Its strengths are simplicity and speed. With only 1.02k active parameters and a 128-minute pass through the training data we achieve Top-1 and…

Sound · Computer Science 2022-08-30 Ping-Chen Huang , Denis Kleyko , Jan M. Rabaey , Bruno A. Olshausen , Pentti Kanerva

Evaluating automatic speech recognition (ASR) systems is a classical but difficult and still open problem, which often boils down to focusing only on the word error rate (WER). However, this metric suffers from many limitations and does not…

Computation and Language · Computer Science 2026-05-01 Thibault Bañeras-Roux , Mickaël Rouvier , Jane Wottawa , Richard Dufour

For a speech-enhancement algorithm, it is highly desirable to simultaneously improve perceptual quality and recognition rate. Thanks to computational costs and model complexities, it is challenging to train a model that effectively…

Machine Learning · Computer Science 2018-02-19 Rasool Fakoor , Xiaodong He , Ivan Tashev , Shuayb Zarar

Self-supervised learning (SSL) approaches such as wav2vec 2.0 and HuBERT models have shown promising results in various downstream tasks in the speech community. In particular, speech representations learned by SSL models have been shown to…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-11 Eesung Kim , Jae-Jin Jeon , Hyeji Seo , Hoon Kim

For various speech-related tasks, confidence scores from a speech recogniser are a useful measure to assess the quality of transcriptions. In traditional hidden Markov model-based automatic speech recognition (ASR) systems, confidence…

Audio and Speech Processing · Electrical Eng. & Systems 2020-10-27 Qiujia Li , David Qiu , Yu Zhang , Bo Li , Yanzhang He , Philip C. Woodland , Liangliang Cao , Trevor Strohman

Streaming end-to-end speech recognition models have been widely applied to mobile devices and show significant improvement in efficiency. These models are typically trained on the server using transcribed speech data. However, the server…

Fast contextual adaptation has shown to be effective in improving Automatic Speech Recognition (ASR) of rare words and when combined with an on-device personalized training, it can yield an even better recognition result. However, the…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-08 Tsendsuren Munkhdalai , Khe Chai Sim , Angad Chandorkar , Fan Gao , Mason Chua , Trevor Strohman , Françoise Beaufays

Recent advances in unsupervised speech representation learning discover new approaches and provide new state-of-the-art for diverse types of speech processing tasks. This paper presents an investigation of using wav2vec 2.0 deep speech…

Since their inception, encoder-decoder models have successfully been applied to a wide array of problems in computational linguistics. The most recent successes are predominantly due to the use of different variations of attention…

Computation and Language · Computer Science 2019-06-11 Dennis Ulmer , Dieuwke Hupkes , Elia Bruni

Approaching Speech-to-Text and Automatic Speech Recognition problems in low-resource languages is notoriously challenging due to the scarcity of validated datasets and the diversity of dialects. Arabic, Russian, and Portuguese exemplify…

Computation and Language · Computer Science 2025-01-03 Or Haim Anidjar , Revital Marbel , Roi Yozevitch

While the use of deep neural networks has significantly boosted speaker recognition performance, it is still challenging to separate speakers in poor acoustic environments. Here speech enhancement methods have traditionally allowed improved…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-28 Yanpei Shi , Qiang Huang , Thomas Hain

In this paper, we propose an incremental learning method for end-to-end Automatic Speech Recognition (ASR) which enables an ASR system to perform well on new tasks while maintaining the performance on its originally learned ones. To…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-17 Li Fu , Xiaoxiao Li , Libo Zi , Zhengchen Zhang , Youzheng Wu , Xiaodong He , Bowen Zhou

Achieving super-human performance in recognizing human speech has been a goal for several decades, as researchers have worked on increasingly challenging tasks. In the 1990's it was discovered, that conversational speech between two humans…

Computer Vision and Pattern Recognition · Computer Science 2021-07-28 Thai-Son Nguyen , Sebastian Stueker , Alex Waibel

Large language models (LLMs) have become proficient at solving a wide variety of tasks, including those involving multi-modal inputs. In particular, instantiating an LLM (such as LLaMA) with a speech encoder and training it on paired data…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-13 Desh Raj , Gil Keren , Junteng Jia , Jay Mahadeokar , Ozlem Kalinli

The demand for fast and accurate incremental speech recognition increases as the applications of automatic speech recognition (ASR) proliferate. Incremental speech recognizers output chunks of partially recognized words while the user is…

Computation and Language · Computer Science 2020-08-18 Yuan Shangguan , Kate Knister , Yanzhang He , Ian McGraw , Francoise Beaufays

End-to-end models for robust automatic speech recognition (ASR) have not been sufficiently well-explored in prior work. With end-to-end models, one could choose to preprocess the input speech using speech enhancement techniques and train…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-15 Archiki Prasad , Preethi Jyothi , Rajbabu Velmurugan

Multilingual end-to-end automatic speech recognition models are attractive due to its simplicity in training and deployment. Recent work on large-scale training of such models has shown promising results compared to monolingual models.…

Computation and Language · Computer Science 2022-10-13 Ke Hu , Bo Li , Tara N. Sainath

Spoken language understanding (SLU) tasks are usually solved by first transcribing an utterance with automatic speech recognition (ASR) and then feeding the output to a text-based model. Recent advances in self-supervised representation…

Audio and Speech Processing · Electrical Eng. & Systems 2021-12-01 Lasse Borgholt , Jakob Drachmann Havtorn , Mostafa Abdou , Joakim Edin , Lars Maaløe , Anders Søgaard , Christian Igel

MOS (Mean Opinion Score) is a subjective method used for the evaluation of a system's quality. Telecommunications (for voice and video), and speech synthesis systems (for generated speech) are a few of the many applications of the method.…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-26 Bálint Gyires-Tóth , Csaba Zainkó

The increasing demand for learning English as a second language has led to a growing interest in methods for automatically assessing spoken language proficiency. Most approaches use hand-crafted features, but their efficacy relies on their…

Computation and Language · Computer Science 2022-10-25 Stefano Bannò , Marco Matassoni