English
Related papers

Related papers: ShrinkML: End-to-End ASR Model Compression Using R…

200 papers

Recently, end-to-end (E2E) speech recognition has become popular, since it can integrate the acoustic, pronunciation and language models into a single neural network, which outperforms conventional models. Among E2E approaches,…

Sound · Computer Science 2021-07-08 Zhifu Gao , Yiwu Yao , Shiliang Zhang , Jun Yang , Ming Lei , Ian McLoughlin

Automatic Speech Recognition (ASR) models have achieved remarkable accuracy in general settings, yet their performance often degrades in domain-specific applications due to data mismatch and linguistic variability. This challenge is…

The rapid advancement of large-language models (LLMs) has driven extensive research into parameter compression after training has been completed, yet compression during the training phase remains largely unexplored. In this work, we…

Machine Learning · Computer Science 2025-11-19 Jun Wu , Jiangtao Wen , Yuxing Han

Quantifying the confidence (or conversely the uncertainty) of a prediction is a highly desirable trait of an automatic system, as it improves the robustness and usefulness in downstream tasks. In this paper we investigate confidence…

Audio and Speech Processing · Electrical Eng. & Systems 2021-01-15 Dan Oneata , Alexandru Caranica , Adriana Stan , Horia Cucu

Automatic speech recognition (ASR) systems degrade significantly under noisy conditions. Recently, speech enhancement (SE) is introduced as front-end to reduce noise for ASR, but it also suppresses some important speech information, i.e.,…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-30 Yuchen Hu , Nana Hou , Chen Chen , Eng Siong Chng

The combination of Large Language Models (LLM) and Automatic Speech Recognition (ASR), when deployed on edge devices (called edge ASR-LLM), can serve as a powerful personalized assistant to enable audio-based interaction for users. Compared…

Automatic recognition of disordered speech remains a highly challenging task to date due to data scarcity. This paper presents a reinforcement learning (RL) based on-the-fly data augmentation approach for training state-of-the-art PyChain…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-15 Zengrui Jin , Xurong Xie , Tianzi Wang , Mengzhe Geng , Jiajun Deng , Guinan Li , Shujie Hu , Xunying Liu

Automatic Speech Recognition (ASR) has reached impressive accuracy for high-resource languages, yet its utility in linguistic fieldwork remains limited. Recordings collected in fieldwork contexts present unique challenges, including…

Computation and Language · Computer Science 2025-06-25 Siyu Liang , Gina-Anne Levow

In hybrid automatic speech recognition (ASR) systems, the vocabulary size is unambiguous, typically determined by the number of phones, bi-phones, or tri-phones present in the language. In contrast, end-to-end ASR systems derive their…

Computation and Language · Computer Science 2026-05-15 Sunil Kumar Kopparapu

It is an effective way that improves the performance of the existing Automatic Speech Recognition (ASR) systems by retraining with more and more new training data in the target domain. Recently, Deep Neural Network (DNN) has become a…

Sound · Computer Science 2019-04-18 Jiabin Xue , Jiqing Han , Tieran Zheng , Jiaxing Guo , Boyong Wu

This article concerns comparative studies on the Automatic Speech Recognition (ASR) model incorporated with the Large Language Model (LLM) used for medical interviews. The proposed solution is tested on polish language benchmarks and…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-04 Marcin Pietroń , Szymon Piórkowski , Kamil Faber , Dominik Żurek , Michał Karwatowski , Jerzy Duda , Hubert Zieliński , Piotr Lipnicki , Mikołaj Leszczuk

Modern automatic speech recognition (ASR) model is required to accurately transcribe diverse speech signals (from different domains, languages, accents, etc) given the specific contextual information in various application scenarios.…

Large reasoning models (LRMs) achieve remarkable performance via long reasoning chains, but often incur excessive computational overhead due to redundant reasoning, especially on simple tasks. In this work, we systematically quantify the…

Artificial Intelligence · Computer Science 2025-05-26 Xiaoyun Zhang , Jingqing Ruan , Xing Ma , Yawen Zhu , Haodong Zhao , Hao Li , Jiansong Chen , Ke Zeng , Xunliang Cai

Enabling a high-degree-of-freedom robot to learn specific skills is a challenging task due to the complexity of robotic dynamics. Reinforcement learning (RL) has emerged as a promising solution; however, addressing such problems requires…

Robotics · Computer Science 2025-05-06 Changxin Huang , Junyang Liang , Yanbin Chang , Jingzhao Xu , Jianqiang Li

End-to-end (E2E) automatic speech recognition (ASR) systems lack the distinct language model (LM) component that characterizes traditional speech systems. While this simplifies the model architecture, it complicates the task of…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-26 Cal Peyser , Sepand Mavandadi , Tara N. Sainath , James Apfel , Ruoming Pang , Shankar Kumar

Large language models (LLMs) have demonstrated impressive capabilities in a wide range of downstream natural language processing tasks. Nevertheless, their considerable sizes and memory demands hinder practical deployment, underscoring the…

Computation and Language · Computer Science 2026-03-17 Haolei Bai , Siyong Jian , Tuo Liang , Yu Yin , Huan Wang

AutoML platforms have numerous options for the algorithms to try for each step of the analysis, i.e., different possible algorithms for imputation, transformations, feature selection, and modelling. Finding the optimal combination of…

Machine Learning · Computer Science 2024-01-19 Giorgos Borboudakis , Paulos Charonyktakis , Konstantinos Paraschakis , Ioannis Tsamardinos

Automatic speech recognition (ASR) tasks are resolved by end-to-end deep learning models, which benefits us by less preparation of raw data, and easier transformation between languages. We propose a novel end-to-end deep learning model…

Audio and Speech Processing · Electrical Eng. & Systems 2018-10-31 Xinpei Zhou , Jiwei Li , Xi Zhou

Bootstrapping speech recognition on limited data resources has been an area of active research for long. The recent transition to all-neural models and end-to-end (E2E) training brought along particular challenges as these models are known…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-21 Manuel Giollo , Deniz Gunceler , Yulan Liu , Daniel Willett

End-to-end automatic speech recognition (ASR) systems frequently misrecognize domain-specific phrases like named entities, which can cause catastrophic failures in downstream tasks. A new family of named entity correction methods based on…

Computation and Language · Computer Science 2026-02-16 Junjie An , Jingguang Tian , Tianyi Wang , Yu Gao , Xiaofeng Mou , Yi Xu