English
Related papers

Related papers: VAIS ASR: Building a conversational speech recogni…

200 papers

Automatic speech recognition (ASR) is a core component of human--computer interaction and an increasingly important front-end for LLM-based assistants and agents. However, most current ASR systems still follow a single-pass paradigm, which…

Artificial Intelligence · Computer Science 2026-05-29 Zixuan Jiang , Yanqiao Zhu , Peng Wang , Qinyuan Chen , Xinjian Zhao , Xipeng Qiu , Wupeng Wang , Zhifu Gao , Xiangang Li , Kai Yu , Xie Chen

Recent dialogue systems rely on turn-based spoken interactions, requiring accurate Automatic Speech Recognition (ASR). Errors in ASR can significantly impact downstream dialogue tasks. To address this, using dialogue context from user and…

Computation and Language · Computer Science 2024-08-13 Wonjun Lee , San Kim , Gary Geunbae Lee

Speech applications dealing with conversations require not only recognizing the spoken words, but also determining who spoke when. The task of assigning words to speakers is typically addressed by merging the outputs of two separate…

Computation and Language · Computer Science 2019-07-12 Laurent El Shafey , Hagen Soltau , Izhak Shafran

We describe Microsoft's conversational speech recognition system, in which we combine recent developments in neural-network-based acoustic and language modeling to advance the state of the art on the Switchboard recognition task. Inspired…

Computation and Language · Computer Science 2022-02-24 W. Xiong , J. Droppo , X. Huang , F. Seide , M. Seltzer , A. Stolcke , D. Yu , G. Zweig

This paper presents Seewo's systems for both tracks of the Multilingual Conversational Speech Language Model Challenge (MLC-SLM), addressing automatic speech recognition (ASR) and speaker diarization with ASR (SD-ASR). We introduce a…

Computation and Language · Computer Science 2025-06-19 Bo Li , Chengben Xu , Wufeng Zhang

Modern Automatic Speech Recognition (ASR) systems can achieve high performance in terms of recognition accuracy. However, a perfectly accurate transcript still can be challenging to read due to grammatical errors, disfluency, and other…

Computation and Language · Computer Science 2020-04-10 Junwei Liao , Sefik Emre Eskimez , Liyang Lu , Yu Shi , Ming Gong , Linjun Shou , Hong Qu , Michael Zeng

Pre-trained transformer-based models have significantly advanced automatic speech recognition (ASR), yet they remain sensitive to accent and dialectal variations, resulting in elevated word error rates (WER) in linguistically diverse…

Computation and Language · Computer Science 2025-10-13 Mohammad Hossein Sameti , Sepehr Harfi Moridani , Ali Zarean , Hossein Sameti

Contextual automatic speech recognition (ASR) systems allow for recognizing out-of-vocabulary (OOV) words, such as named entities or rare words. However, it remains challenging due to limited training data and ambiguous or inconsistent…

Computation and Language · Computer Science 2025-09-03 Changsong Liu , Yizhou Peng , Eng Siong Chng

Enhancing automatic speech recognition (ASR) performance by leveraging additional multimodal information has shown promising results in previous studies. However, most of these works have primarily focused on utilizing visual cues derived…

Audio and Speech Processing · Electrical Eng. & Systems 2023-12-19 Ziyi Ni , Minglun Han , Feilong Chen , Linghui Meng , Jing Shi , Pin Lv , Bo Xu

Speech recognition is a fascinating process that offers the opportunity to interact and command the machine in the field of human-computer interactions. Speech recognition is a language-dependent system constructed directly based on the…

Computation and Language · Computer Science 2021-09-28 M. F. Mridha , Abu Quwsar Ohi , Md. Abdul Hamid , Muhammad Mostafa Monowar

Automatic Speech Recognition (ASR) is increasingly used in applications involving child speech, such as language learning and literacy acquisition. However, the effectiveness of such applications is limited by high ASR error rates. The…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-23 Gus Lathouwers , Lingyun Gao , Catia Cucchiarini , Helmer Strik

As speech recognition model sizes and training data requirements grow, it is increasingly common for systems to only be available via APIs from online service providers rather than having direct access to models themselves. In this scenario…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-11 Rao Ma , Mengjie Qian , Mark J. F. Gales , Kate M. Knill

The performance of automatic speech recognition systems(ASR) degrades in the presence of noisy speech. This paper demonstrates that using electroencephalography (EEG) can help automatic speech recognition systems overcome performance loss…

Machine Learning · Computer Science 2019-03-05 Gautam Krishna , Co Tran , Jianguo Yu , Ahmed H Tewfik

The image-based multimodal automatic speech recognition (ASR) model enhances speech recognition performance by incorporating audio-related image. However, some works suggest that introducing image information to model does not help…

Sound · Computer Science 2024-10-08 Jiliang Hu , Zuchao Li , Ping Wang , Haojun Ai , Lefei Zhang , Hai Zhao

On-device Virtual Assistants (VAs) powered by Automatic Speech Recognition (ASR) require effective knowledge integration for the challenging entity-rich query recognition. In this paper, we conduct an empirical study of modeling strategies…

Computation and Language · Computer Science 2023-11-03 Youyuan Zhang , Sashank Gondala , Thiago Fraga-Silva , Christophe Van Gysel

This paper describes the NTNU ASR system participating in the Interspeech 2020 Non-Native Children's Speech ASR Challenge supported by the SIG-CHILD group of ISCA. This ASR shared task is made much more challenging due to the coexisting…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-04 Tien-Hong Lo , Fu-An Chao , Shi-Yan Weng , Berlin Chen

General-purpose automatic speech recognition (ASR) systems do not always perform well in goal-oriented dialogue. Existing ASR correction methods rely on prior user data or named entities. We extend correction to tasks that have no prior…

Computation and Language · Computer Science 2025-01-13 Yuya Asano , Sabit Hassan , Paras Sharma , Anthony Sicilia , Katherine Atwell , Diane Litman , Malihe Alikhani

From the existing research it has been observed that many techniques and methodologies are available for performing every step of Automatic Speech Recognition (ASR) system, but the performance (Minimization of Word Error Recognition-WER and…

Computation and Language · Computer Science 2013-03-25 Urmila Shrawankar , Vilas Thakare

Automatic speech recognition (ASR) systems promise to deliver objective interpretation of human speech. Practice and recent evidence suggests that the state-of-the-art (SotA) ASRs struggle with the large variation in speech due to e.g.,…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-02 Siyuan Feng , Olya Kudina , Bence Mark Halpern , Odette Scharenborg

Automatic Speech Recognition (ASR) systems have become ubiquitous in everyday applications, yet significant disparities in performance across diverse demographic groups persist. In this work, we introduce the ASR-FAIRBENCH leaderboard which…

Sound · Computer Science 2025-05-20 Anand Rai , Satyam Rahangdale , Utkarsh Anand , Animesh Mukherjee