English
Related papers

Related papers: Exploring SSL Discrete Tokens for Multilingual ASR

200 papers

Recent years have witnessed a boom in self-supervised learning (SSL) in various areas including speech processing. Speech based SSL models present promising performance in a range of speech related tasks. However, the training of SSL models…

Audio and Speech Processing · Electrical Eng. & Systems 2023-02-21 Xie Chen , Ziyang Ma , Changli Tang , Yujin Wang , Zhisheng Zheng

While speech large language models (SpeechLLMs) have advanced standard automatic speech recognition (ASR), contextual biasing for named entities and rare words remains challenging, especially at scale. To address this, we propose BR-ASR: a…

Sound · Computer Science 2025-05-27 Xun Gong , Anqi Lv , Zhiming Wang , Huijia Zhu , Yanmin Qian

Automatic Speech Recognition (ASR) models have achieved remarkable accuracy in general settings, yet their performance often degrades in domain-specific applications due to data mismatch and linguistic variability. This challenge is…

High quality Automatic Speech Recognition (ASR) is a prerequisite for speech-based applications and research. While state-of-the-art ASR software is freely available, the language dependent acoustic models are lacking for languages other…

Computation and Language · Computer Science 2018-07-30 Benjamin Milde , Arne Köhn

Discrete audio tokens are compact representations that aim to preserve perceptual quality, phonetic content, and speaker characteristics while enabling efficient storage and inference, as well as competitive performance across diverse…

While current state-of-the-art Automatic Speech Recognition (ASR) systems achieve high accuracy on typical speech, they suffer from significant performance degradation on disordered speech and other atypical speech patterns. Personalization…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-21 Katrin Tomanek , Françoise Beaufays , Julie Cattiau , Angad Chandorkar , Khe Chai Sim

The performance of automatic speech recognition (ASR) systems has advanced substantially in recent years, particularly for languages for which a large amount of transcribed speech is available. Unfortunately, for low-resource languages,…

Computation and Language · Computer Science 2023-05-22 Martijn Bartelds , Nay San , Bradley McDonnell , Dan Jurafsky , Martijn Wieling

This paper presents a novel donor data selection method to enhance low-resource automatic speech recognition (ASR). While ASR performs well in high-resource languages, its accuracy declines in low-resource settings due to limited training…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-30 Shunsuke Mitsumori , Sara Kashiwagi , Keitaro Tanaka , Shigeo Morishima

In Speech Emotion Recognition (SER), textual data is often used alongside audio signals to address their inherent variability. However, the reliance on human annotated text in most research hinders the development of practical SER systems.…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-30 Yuanchao Li , Zeyu Zhao , Ondrej Klejch , Peter Bell , Catherine Lai

Automatic speech recognition (ASR) for conversational code-switching speech remains challenging due to the scarcity of realistic, high-quality labeled speech data. This paper explores multilingual text-to-speech (TTS) models as an effective…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-06 Yue Heng Yeo , Yuchen Hu , Shreyas Gopal , Yizhou Peng , Hexin Liu , Eng Siong Chng

Using neural network based acoustic frontends for improving robustness of streaming automatic speech recognition (ASR) systems is challenging because of the causality constraints and the resulting distortion that the frontend processing…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-27 Arun Narayanan , James Walker , Sankaran Panchapagesan , Nathan Howard , Yuma Koizumi

A typical fluency scoring system generally relies on an automatic speech recognition (ASR) system to obtain time stamps in input speech for either the subsequent calculation of fluency-related features or directly modeling speech fluency…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-14 Wei Liu , Kaiqi Fu , Xiaohai Tian , Shuju Shi , Wei Li , Zejun Ma , Tan Lee

In the past few years, it has been shown that deep learning systems are highly vulnerable under attacks with adversarial examples. Neural-network-based automatic speech recognition (ASR) systems are no exception. Targeted and untargeted…

Audio and Speech Processing · Electrical Eng. & Systems 2024-11-07 Matías Pizarro , Dorothea Kolossa , Asja Fischer

Current automatic speech recognition (ASR) models are designed to be used across many languages and tasks without substantial changes. However, this broad language coverage hides performance gaps within languages, for example, across…

Computation and Language · Computer Science 2024-10-04 Giuseppe Attanasio , Beatrice Savoldi , Dennis Fucci , Dirk Hovy

With 4.5 million hours of English speech from 10 different sources across 120 countries and models of up to 10 billion parameters, we explore the frontiers of scale for automatic speech recognition. We propose data selection techniques to…

Computation and Language · Computer Science 2021-11-30 Alex Xiao , Weiyi Zheng , Gil Keren , Duc Le , Frank Zhang , Christian Fuegen , Ozlem Kalinli , Yatharth Saraf , Abdelrahman Mohamed

Voice assistive technologies have given rise to far-reaching privacy and security concerns. In this paper we investigate whether modular automatic speech recognition (ASR) can improve privacy in voice assistive systems by combining…

Computation and Language · Computer Science 2021-04-05 Ranya Aloufi , Hamed Haddadi , David Boyle

Accented automatic speech recognition (ASR) often degrades due to the limited availability of accented training data. Prior work has explored accent modeling in low-resource settings, but existing approaches typically require minutes to…

This study presents a model of automatic speech recognition (ASR) designed to diagnose pronunciation issues in children with speech sound disorders (SSDs) to replace manual transcriptions in clinical procedures. Since ASR models trained for…

Computation and Language · Computer Science 2024-03-14 Taekyung Ahn , Yeonjung Hong , Younggon Im , Do Hyung Kim , Dayoung Kang , Joo Won Jeong , Jae Won Kim , Min Jung Kim , Ah-ra Cho , Dae-Hyun Jang , Hosung Nam

Self-supervised learning (SSL) models have achieved impressive results across many speech tasks, yet child automatic speech recognition (ASR) remains challenging due to limited data and pretraining domain mismatch. Fine-tuning SSL models on…

Computation and Language · Computer Science 2026-01-29 Zilai Wang , Natarajan Balaji Shankar , Kaiyuan Zhang , Zihan Wang , Abeer Alwan

Automatic recognition of disordered and elderly speech remains a highly challenging task to date due to the difficulty in collecting such data in large quantities. This paper explores a series of approaches to integrate domain adapted SSL…

Sound · Computer Science 2023-06-23 Shujie Hu , Xurong Xie , Zengrui Jin , Mengzhe Geng , Yi Wang , Mingyu Cui , Jiajun Deng , Xunying Liu , Helen Meng
‹ Prev 1 8 9 10 Next ›