English
Related papers

Related papers: Enhancing multilingual speech recognition in air t…

200 papers

It has been shown that the intelligibility of noisy speech can be improved by speech enhancement algorithms. However, speech enhancement has not been established as an effective frontend for robust automatic speech recognition (ASR) in…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-22 Yufeng Yang , Ashutosh Pandey , DeLiang Wang

End-to-end automatic speech recognition (E2E ASR) systems have significantly improved speech recognition through training on extensive datasets. Despite these advancements, they still struggle to accurately recognize domain specific words,…

Computation and Language · Computer Science 2024-07-26 Jiwon Suh , Injae Na , Woohwan Jung

Speaker-Attributed Automatic Speech Recognition (SAA) enhances traditional ASR systems by incorporating relative speaker identity tags directly into the transcript (e.g., [Speaker 1]:, [Speaker 2]:). In this work, we extend the capabilities…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-14 Hagai Aronowitz , Zvi Kons , Avihu Dekel , George Saon , Ron Hoory

Automatic speech recognition (ASR) allows transcribing the communications between air traffic controllers (ATCOs) and aircraft pilots. The transcriptions are used later to extract ATC named entities, e.g., aircraft callsigns. One common…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-18 Juan Zuluaga-Gomez , Seyyed Saeed Sarfjoo , Amrutha Prasad , Iuliia Nigmatulina , Petr Motlicek , Karel Ondrej , Oliver Ohneiser , Hartmut Helmke

Recent advancements in deep learning have significantly enhanced multilingual automatic speech recognition (ASR) due to the development of advanced model architectures and available large-scale multilingual datasets. Despite that,…

Computation and Language · Computer Science 2025-06-30 Jiahong Li , Yiwen Shao , Jianheng Zhuo , Chenda Li , Liliang Tang , Dong Yu , Yanmin Qian

We present a frontend for improving robustness of automatic speech recognition (ASR), that jointly implements three modules within a single model: acoustic echo cancellation, speech enhancement, and speech separation. This is achieved by…

Audio and Speech Processing · Electrical Eng. & Systems 2021-11-22 Tom O'Malley , Arun Narayanan , Quan Wang , Alex Park , James Walker , Nathan Howard

Automatic speech recognition (ASR) systems degrade significantly under noisy conditions. Recently, speech enhancement (SE) is introduced as front-end to reduce noise for ASR, but it also suppresses some important speech information, i.e.,…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-30 Yuchen Hu , Nana Hou , Chen Chen , Eng Siong Chng

To let the state-of-the-art end-to-end ASR model enjoy data efficiency, as well as much more unpaired text data by multi-modal training, one needs to address two problems: 1) the synchronicity of feature sampling rates between speech and…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-02 Yuhang Yang , Haihua Xu , Hao Huang , Eng Siong Chng , Sheng Li

Automatic Speech Recognition (ASR) for air traffic control is generally trained by pooling Air Traffic Controller (ATCO) and pilot data into one set. This is motivated by the fact that pilot's voice communications are more scarce than…

Computation and Language · Computer Science 2022-12-15 Amrutha Prasad , Juan Zuluaga-Gomez , Petr Motlicek , Saeed Sarfjoo , Iuliia Nigmatulina , Oliver Ohneiser , Hartmut Helmke

This article concerns comparative studies on the Automatic Speech Recognition (ASR) model incorporated with the Large Language Model (LLM) used for medical interviews. The proposed solution is tested on polish language benchmarks and…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-04 Marcin Pietroń , Szymon Piórkowski , Kamil Faber , Dominik Żurek , Michał Karwatowski , Jerzy Duda , Hubert Zieliński , Piotr Lipnicki , Mikołaj Leszczuk

Recent years have witnessed remarkable progress in automatic speech recognition (ASR), driven by advances in model architectures and large-scale training data. However, two important aspects remain underexplored. First, Word Error Rate…

Computation and Language · Computer Science 2026-04-15 Peng Wang , Yanqiao Zhu , Zixuan Jiang , Qinyuan Chen , Xingjian Zhao , Xipeng Qiu , Wupeng Wang , Zhifu Gao , Xiangang Li , Kai Yu , Xie Chen

Pure acoustic neural models, particularly the LSTM-RNN model, have shown great potential in language identification (LID). However, the phonetic information has been largely overlooked by most of existing neural LID models, although this…

Computation and Language · Computer Science 2017-05-24 Zhiyuan Tang , Dong Wang , Yixiang Chen , Ying Shi , Lantian Li

Automatic speech recognition (ASR) has shown rapid advances in recent years but still degrades significantly in far-field and noisy environments. The recent development of self-supervised learning (SSL) technology can improve the ASR…

Sound · Computer Science 2022-05-05 Changfeng Gao , Gaofeng Cheng , Pengyuan Zhang

In the FAME! project, we aim to develop an automatic speech recognition (ASR) system for Frisian-Dutch code-switching (CS) speech extracted from the archives of a local broadcaster with the ultimate goal of building a spoken document…

Computation and Language · Computer Science 2018-10-24 Emre Yılmaz , Mitchell McLaren , Henk van den Heuvel , David A. van Leeuwen

Speech recognition is the technology that enables machines to interpret and process human speech, converting spoken language into text or commands. This technology is essential for applications such as virtual assistants, transcription…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-09 Xinyu Wang , Haotian Jiang , Haolin Huang , Yu Fang , Mengjie Xu , Qian Wang

Automatic speech Recognition (ASR) is a fundamental and important task in the field of speech and natural language processing. It is an inherent building block in many applications such as voice assistant, speech translation, etc. Despite…

Computation and Language · Computer Science 2024-12-05 Victor Junqiu Wei , Weicheng Wang , Di Jiang , Yuanfeng Song , Lu Wang

Automatic Speech Recognition (ASR) is a technology that converts spoken words into text, facilitating interaction between humans and machines. One of the most common applications of ASR is Speech-To-Text (STT) technology, which simplifies…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-02 Jaeyoung Huh , Sangjoon Park , Jeong Eun Lee , Jong Chul Ye

Automatic speech recognition (ASR) still covers only a small fraction of the world's languages, mainly due to supervised data scarcity. In-context learning (ICL) with large language models (LLMs) addresses this problem, but prior work…

Computation and Language · Computer Science 2026-04-21 Zhaolin Li , Jan Niehues

Adapting pre-trained text Large Language Models (LLMs) into Speech Language Models (Speech LMs) via continual pretraining on speech data is promising, but often degrades the original text capabilities. We propose Multimodal Depth Upscaling,…

Computation and Language · Computer Science 2026-04-02 Kazuki Yano , Jun Suzuki , Shinji Watanabe

Cued Speech (CS) is an innovative visual communication system that integrates lip-reading with hand coding, designed to enhance effective communication for individuals with hearing impairments. Automatic CS Recognition (ACSR) refers to the…

Audio and Speech Processing · Electrical Eng. & Systems 2025-03-31 Guanjie Huang , Danny Hin Kwok Tsang , Li Liu