English
Related papers

Related papers: DNN adaptation by automatic quality estimation of …

200 papers

Automatic recognition of disordered speech remains a highly challenging task to date due to data scarcity. This paper presents a reinforcement learning (RL) based on-the-fly data augmentation approach for training state-of-the-art PyChain…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-15 Zengrui Jin , Xurong Xie , Tianzi Wang , Mengzhe Geng , Jiajun Deng , Guinan Li , Shujie Hu , Xunying Liu

We propose a general framework to compute the word error rate (WER) of ASR systems that process recordings containing multiple speakers at their input and that produce multiple output word sequences (MIMO). Such ASR systems are typically…

Audio and Speech Processing · Electrical Eng. & Systems 2023-07-24 Thilo von Neumann , Christoph Boeddeker , Keisuke Kinoshita , Marc Delcroix , Reinhold Haeb-Umbach

Despite the success of sequence-to-sequence approaches in automatic speech recognition (ASR) systems, the models still suffer from several problems, mainly due to the mismatch between the training and inference conditions. In the…

Computation and Language · Computer Science 2018-03-01 Andros Tjandra , Sakriani Sakti , Satoshi Nakamura

The prediction of valence from speech is an important, but challenging problem. The externalization of valence in speech has speaker-dependent cues, which contribute to performances that are often significantly lower than the prediction of…

Sound · Computer Science 2023-05-15 Kusha Sridhar , Carlos Busso

Unseen data can degrade performance of deep neural net acoustic models. To cope with unseen data, adaptation techniques are deployed. For unlabeled unseen data, one must generate some hypothesis given an existing model, which is used as the…

Computation and Language · Computer Science 2018-02-21 Vikramjit Mitra , Horacio Franco

\textbf{Objectives}: We aimed to investigate how errors from automatic speech recognition (ASR) systems affect dementia classification accuracy, specifically in the ``Cookie Theft'' picture description task. We aimed to assess whether…

Computation and Language · Computer Science 2024-01-12 Changye Li , Weizhe Xu , Trevor Cohen , Serguei Pakhomov

Automatic Speech Recognition (ASR) systems suffer considerably when source speech is corrupted with noise or room impulse responses (RIR). Typically, speech enhancement is applied in both mismatched and matched scenario training and…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-26 Shashi Kumar , Shakti P. Rath , Abhishek Pandey

In automatic speech recognition (ASR), model pruning is a widely adopted technique that reduces model size and latency to deploy neural network models on edge devices with resource constraints. However, multiple models with different…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-09 Zhaofeng Wu , Ding Zhao , Qiao Liang , Jiahui Yu , Anmol Gulati , Ruoming Pang

As Automatic Speech Recognition (ASR) is increasingly deployed in clinical dialogue, standard evaluations still rely heavily on Word Error Rate (WER). This paper challenges that standard, investigating whether WER or other common metrics…

Computation and Language · Computer Science 2026-01-21 Zachary Ellis , Jared Joselowitz , Yash Deo , Yajie He , Anna Kalygina , Aisling Higham , Mana Rahimzadeh , Yan Jia , Ibrahim Habli , Ernest Lim

Speech-driven visual speech synthesis involves mapping features extracted from acoustic speech to the corresponding lip animation controls for a face model. This mapping can take many forms, but a powerful approach is to use deep neural…

Audio and Speech Processing · Electrical Eng. & Systems 2019-05-17 Ahmed Hussen Abdelaziz , Barry-John Theobald , Justin Binder , Gabriele Fanelli , Paul Dixon , Nicholas Apostoloff , Thibaut Weise , Sachin Kajareker

We propose ARiSE, an auto-regressive algorithm for multi-channel speech enhancement. ARiSE improves existing deep neural network (DNN) based frame-online multi-channel speech enhancement models by introducing auto-regressive connections,…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-09 Pengjie Shen , Xueliang Zhang , Zhong-Qiu Wang

Measuring automatic speech recognition (ASR) system quality is critical for creating user-satisfying voice-driven applications. Word Error Rate (WER) has been traditionally used to evaluate ASR system quality; however, it sometimes…

Computation and Language · Computer Science 2022-07-07 Suyoun Kim , Duc Le , Weiyi Zheng , Tarun Singh , Abhinav Arora , Xiaoyu Zhai , Christian Fuegen , Ozlem Kalinli , Michael L. Seltzer

Nowadays, the main problem of deep learning techniques used in the development of automatic speech recognition (ASR) models is the lack of transcribed data. The goal of this research is to propose a new data augmentation method to improve…

Computation and Language · Computer Science 2022-04-04 Rodolfo Zevallos

The Word Error Rate (WER) is the common measure of accuracy for Automatic Speech Recognition (ASR). Transcripts are usually pre-processed by substituting specific characters to account for non-semantic differences. As a result of this…

Computation and Language · Computer Science 2024-09-20 Korbinian Kuhn , Verena Kersken , Gottfried Zimmermann

Quality Estimation (QE) of Machine Translation (MT) is a task to estimate the quality scores for given translation outputs from an unknown MT system. However, QE scores for low-resource languages are usually intractable and hard to collect.…

Computation and Language · Computer Science 2021-05-18 Ting-Wei Wu , Yung-An Hsieh , Yi-Chieh Liu

This paper presents a novel optimization framework for automatic speech recognition (ASR) with the aim of reducing hallucinations produced by an ASR model. The proposed framework optimizes the ASR model to maximize an expected factual…

Audio and Speech Processing · Electrical Eng. & Systems 2023-02-27 Naoyuki Kanda , Takuya Yoshioka , Yang Liu

The advent of Large Language Models (LLM) has reformed the Automatic Speech Recognition (ASR). Prompting LLM with audio embeddings to generate transcriptions becomes the new state-of-the-art ASR. Despite LLMs being trained with an extensive…

Computation and Language · Computer Science 2024-12-11 Yingyi Ma , Zhe Liu , Ozlem Kalinli

Large Language Models (LLMs) have shown remarkable performance across a wide range of natural language processing tasks. Quality Estimation (QE) for Machine Translation (MT), which assesses the quality of a source-target pair without…

Computation and Language · Computer Science 2025-08-12 Archchana Sindhujan , Shenbin Qian , Chan Chi Chun Matthew , Constantin Orasan , Diptesh Kanojia

Nowadays, speech is becoming a more common, if not standard, interface to technology. This can be seen in the trend of technology changes over the years. Increasingly, voice is used to control programs, appliances and personal devices…

Human-Computer Interaction · Computer Science 2019-09-10 Abraham Glasser

Recently, there has been a growing interest in utilizing machine learning for accurate classification of power quality events (PQEs). However, most of these studies are performed assuming an ideal situation, while in reality, we can have…

Machine Learning · Computer Science 2024-02-26 Ahmad Mohammad Saber , Amr Youssef , Davor Svetinovic , Hatem Zeineldin , Deepa Kundur , Ehab El-Saadany