English
Related papers

Related papers: DITTO: Data-efficient and Fair Targeted Subset Sel…

200 papers

Accents, as variations from standard pronunciation, pose significant challenges for speech recognition systems. Although joint automatic speech recognition (ASR) and accent recognition (AR) training has been proven effective in handling…

Sound · Computer Science 2023-11-20 Qijie Shao , Pengcheng Guo , Jinghao Yan , Pengfei Hu , Lei Xie

Typical ASR systems segment the input audio into utterances using purely acoustic information, which may not resemble the sentence-like units that are expected by conventional machine translation (MT) systems for Spoken Language…

Computation and Language · Computer Science 2021-04-19 David Wan , Chris Kedzie , Faisal Ladhak , Elsbeth Turcan , Petra Galuščáková , Elena Zotkina , Zhengping Jiang , Peter Bell , Kathleen McKeown

Code-switching automatic speech recognition (CS-ASR) presents unique challenges due to language confusion introduced by spontaneous intra-sentence switching and accent bias that blurs the phonetic boundaries. Although the constituent…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-18 Hexin Liu , Haoyang Zhang , Qiquan Zhang , Xiangyu Zhang , Dongyuan Shi , Eng Siong Chng , Haizhou Li

Automatic Speech Recognition (ASR) systems have attained unprecedented performance with large speech models pre-trained based on self-supervised speech representation learning. However, these pre-trained speech models suffer from…

Computation and Language · Computer Science 2023-05-29 Eunseop Yoon , Hee Suk Yoon , John Harvill , Mark Hasegawa-Johnson , Chang D. Yoo

In the past few years, it has been shown that deep learning systems are highly vulnerable under attacks with adversarial examples. Neural-network-based automatic speech recognition (ASR) systems are no exception. Targeted and untargeted…

Audio and Speech Processing · Electrical Eng. & Systems 2024-11-07 Matías Pizarro , Dorothea Kolossa , Asja Fischer

We propose a simple method for automatic speech recognition (ASR) by fine-tuning BERT, which is a language model (LM) trained on large-scale unlabeled text data and can generate rich contextual representations. Our assumption is that given…

Sound · Computer Science 2021-02-02 Wen-Chin Huang , Chia-Hua Wu , Shang-Bao Luo , Kuan-Yu Chen , Hsin-Min Wang , Tomoki Toda

Accurately classifying accents and assessing accentedness in non-native speakers are both challenging tasks due to the complexity and diversity of accent and dialect variations. In this study, embeddings from advanced pre-trained language…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-18 Shahram Ghorbani , John H. L. Hansen

Edge-based automatic speech recognition (ASR) technologies are increasingly prevalent in the development of intelligent and personalized assistants. However, resource-constrained ASR models face significant challenges in adaptivity,…

Computation and Language · Computer Science 2024-12-24 Amir Nassereldine , Dancheng Liu , Chenhui Xu , Ruiyang Qin , Yiyu Shi , Jinjun Xiong

Selecting in-domain data from a large pool of diverse and out-of-domain data is a non-trivial problem. In most cases simply using all of the available data will lead to sub-optimal and in some cases even worse performance compared to…

Computation and Language · Computer Science 2019-07-03 Mortaza , Doulaty , Thomas Hain

Modern ASR systems are typically trained on large-scale pseudo-labeled, in-the-wild data spanning multiple domains. While such heterogeneous data benefit generalist models designed for broad deployment, they pose challenges for specialist…

Automatic Speech Recognition (ASR) systems exhibit the best performance on speech that is similar to that on which it was trained. As such, underrepresented varieties including regional dialects, minority-speakers, and low-resource…

Computation and Language · Computer Science 2023-05-15 Emma O'Neill , Julie Carson-Berndsen

Fine-tuning pretrained ASR models for specific domains is challenging when labeled data is scarce. But unlabeled audio and labeled data from related domains are often available. We propose an incremental semi-supervised learning pipeline…

This paper presents a method for selecting appropriate synthetic speech samples from a given large text-to-speech (TTS) dataset as supplementary training data for an automatic speech recognition (ASR) model. We trained a neural network,…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-05 Shuo Liu , Leda Sarı , Chunyang Wu , Gil Keren , Yuan Shangguan , Jay Mahadeokar , Ozlem Kalinli

Automatic Speech Recognition (ASR) has shown remarkable progress, yet it still faces challenges in real-world distant scenarios across various array topologies each with multiple recording devices. The focal point of the CHiME-7 Distant ASR…

Sound · Computer Science 2023-12-18 Bingshen Mu , Pengcheng Guo , Dake Guo , Pan Zhou , Wei Chen , Lei Xie

Building ASR systems robust to foreign-accented speech is an important challenge in today's globalized world. A prior study explored the way to enhance the performance of phonetic token-based ASR on accented speech by reproducing the…

Sound · Computer Science 2026-01-28 Kentaro Onda , Satoru Fukayama , Daisuke Saito , Nobuaki Minematsu

Dysarthric speech recognition faces challenges from severity variations and disparities relative to normal speech. Conventional approaches individually fine-tune ASR models pre-trained on normal speech per patient to prevent feature…

Sound · Computer Science 2025-08-27 Qing Xiao , Yingshan Peng , PeiPei Zhang

Self-supervised learning (SSL) has been able to leverage unlabeled data to boost the performance of automatic speech recognition (ASR) models when we have access to only a small amount of transcribed speech data. However, this raises the…

Audio and Speech Processing · Electrical Eng. & Systems 2022-12-06 Reem Gody , David Harwath

We previously proposed contextual spelling correction (CSC) to correct the output of end-to-end (E2E) automatic speech recognition (ASR) models with contextual information such as name, place, etc. Although CSC has achieved reasonable…

Sound · Computer Science 2023-02-23 Xiaoqiang Wang , Yanqing Liu , Jinyu Li , Sheng Zhao

Automatic speech recognition systems based on deep learning are mainly trained under empirical risk minimization (ERM). Since ERM utilizes the averaged performance on the data samples regardless of a group such as healthy or dysarthric…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-28 Eungbeom Kim , Yunkee Chae , Jaeheon Sim , Kyogu Lee

The performance of voice-controlled systems is usually influenced by accented speech. To make these systems more robust, the frontend accent recognition (AR) technologies have received increased attention in recent years. As accent is a…

Audio and Speech Processing · Electrical Eng. & Systems 2021-05-06 Zhan Zhang , Xi Chen , Yuehai Wang , Jianyi Yang