English
Related papers

Related papers: Toward domain-invariant speech recognition via lar…

200 papers

In the domain of air traffic control (ATC) systems, efforts to train a practical automatic speech recognition (ASR) model always faces the problem of small training samples since the collection and annotation of speech samples are expert-…

Sound · Computer Science 2021-02-17 Yi Lin , Qin Li , Bo Yang , Zhen Yan , Huachun Tan , Zhengmao Chen

Articulatory features are inherently invariant to acoustic signal distortion and have been successfully incorporated into automatic speech recognition (ASR) systems for normal speech. Their practical application to disordered speech…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-22 Shujie Hu , Shansong Liu , Xurong Xie , Mengzhe Geng , Tianzi Wang , Shoukang Hu , Mingyu Cui , Xunying Liu , Helen Meng

The transcription quality of automatic speech recognition (ASR) systems degrades significantly when transcribing audios coming from unseen domains. We propose an unsupervised error correction method for unsupervised ASR domain adaption,…

Sound · Computer Science 2022-09-27 Long Mai , Julie Carson-Berndsen

Despite rapid advances in speech recognition, current models remain brittle to superficial perturbations to their inputs. Small amounts of noise can destroy the performance of an otherwise state-of-the-art model. To harden models against…

Audio and Speech Processing · Electrical Eng. & Systems 2018-07-19 Davis Liang , Zhiheng Huang , Zachary C. Lipton

Studies have shown that in noisy acoustic environments, providing binaural signals to the user of an assistive listening device may improve speech intelligibility and spatial awareness. This paper presents a binaural speech enhancement…

Audio and Speech Processing · Electrical Eng. & Systems 2024-03-11 Vikas Tokala , Eric Grinstein , Mike Brookes , Simon Doclo , Jesper Jensen , Patrick A. Naylor

In a hybrid speech model, both voiced and unvoiced components can coexist in a segment. Often, the voiced speech is regarded as the deterministic component, and the unvoiced speech and additive noise are the stochastic components.…

Audio and Speech Processing · Electrical Eng. & Systems 2021-05-05 Alfredo Esquivel Jaramillo , Jesper Kjær Nielsen , Mads Græsbøll Christensen

Due to the ability of deep neural nets to learn rich representations, recent advances in unsupervised domain adaptation have focused on learning domain-invariant features that achieve a small error on the source domain. The hope is that the…

Machine Learning · Computer Science 2019-05-31 Han Zhao , Remi Tachet des Combes , Kun Zhang , Geoffrey J. Gordon

In recent years, Large Language Models (LLMs) have garnered significant attention from the research community due to their exceptional performance and generalization capabilities. In this paper, we introduce a novel method for…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-21 Egor Lakomkin , Chunyang Wu , Yassir Fathullah , Ozlem Kalinli , Michael L. Seltzer , Christian Fuegen

In this paper, we investigate the use of adversarial learning for unsupervised adaptation to unseen recording conditions, more specifically, single microphone far-field speech. We adapt neural networks based acoustic models trained with…

Audio and Speech Processing · Electrical Eng. & Systems 2018-07-31 Pavel Denisov , Ngoc Thang Vu , Marc Ferras Font

Speaker-independent speech recognition systems trained with data from many users are generally robust against speaker variability and work well for a large population of speakers. However, these systems do not always generalize well for…

Audio and Speech Processing · Electrical Eng. & Systems 2019-09-17 Khe Chai Sim , Petr Zadrazil , Françoise Beaufays

We present a novel approach to multilingual audio-visual speech recognition tasks by introducing a single model on a multilingual dataset. Motivated by a human cognitive system where humans can intuitively distinguish different languages…

Multimedia · Computer Science 2023-10-24 Joanna Hong , Se Jin Park , Yong Man Ro

Audio-Language Models (ALM) aim to be general-purpose audio models by providing zero-shot capabilities at test time. The zero-shot performance of ALM improves by using suitable text prompts for each domain. The text prompts are usually…

Sound · Computer Science 2024-07-23 Soham Deshmukh , Rita Singh , Bhiksha Raj

This technical report describes the methods and results of a three-week sprint to produce deployable speech recognition models for 31 under-served languages of the Common Voice project. We outline the preprocessing steps, hyperparameter…

Computation and Language · Computer Science 2021-05-12 Francis M. Tyers , Josh Meyer

Training a semi-supervised end-to-end speech recognition system using noisy student training has significantly improved performance. However, this approach requires a substantial amount of paired speech-text and unlabeled speech, which is…

Computation and Language · Computer Science 2024-08-01 Chia-Yu Li , Ngoc Thang Vu

Large-scale training corpora have significantly improved the performance of ASR models. Unfortunately, due to the relative scarcity of data, Chinese accents and dialects remain a challenge for most ASR models. Recent advancements in…

Computation and Language · Computer Science 2025-06-17 Tianyi Xu , Hongjie Chen , Wang Qing , Lv Hang , Jian Kang , Li Jie , Zhennan Lin , Yongxiang Li , Xie Lei

Domain adaptive pretraining, i.e. the continued unsupervised pretraining of a language model on domain-specific text, improves the modelling of text for downstream tasks within the domain. Numerous real-world applications are based on…

Computation and Language · Computer Science 2021-09-15 Rasmus Kær Jørgensen , Mareike Hartmann , Xiang Dai , Desmond Elliott

Self-supervised learning (SSL) to learn high-level speech representations has been a popular approach to building Automatic Speech Recognition (ASR) systems in low-resource settings. However, the common assumption made in literature is that…

Computation and Language · Computer Science 2023-05-19 Ashish Seth , Lodagala V S V Durga Prasad , Sreyan Ghosh , S. Umesh

Self-supervised learned (SSL) speech pre-trained models perform well across various speech processing tasks. Distilled versions of SSL models have been developed to match the needs of on-device speech applications. Though having similar…

Recent advances in audio-language models have demonstrated remarkable success on short, segment-level speech tasks. However, real-world applications such as meeting transcription, spoken document understanding, and conversational analysis…

Recent work has shown the importance of adaptation of broad-coverage contextualised embedding models on the domain of the target task of interest. Current self-supervised adaptation methods are simplistic, as the training signal comes from…

Computation and Language · Computer Science 2020-10-06 Thuy-Trang Vu , Dinh Phung , Gholamreza Haffari