English
Related papers

Related papers: AISHELL-5: The First Open-Source In-Car Multi-Chan…

200 papers

This paper describes our RoyalFlush system for the track of multi-speaker automatic speech recognition (ASR) in the M2MeT challenge. We adopted the serialized output training (SOT) based multi-speakers ASR system with large-scale simulation…

Sound · Computer Science 2022-02-25 Shuaishuai Ye , Peiyao Wang , Shunfei Chen , Xinhui Hu , Xinkang Xu

Multi-talker overlapped speech poses a significant challenge for speech recognition and diarization. Recent research indicated that these two tasks are inter-dependent and complementary, motivating us to explore a unified modeling method to…

Sound · Computer Science 2023-05-26 Lingwei Meng , Jiawen Kang , Mingyu Cui , Haibin Wu , Xixin Wu , Helen Meng

Recent methods in speech and language technology pretrain very LARGE models which are fine-tuned for specific tasks. However, the benefits of such LARGE models are often limited to a few resource rich languages of the world. In this work,…

This paper presents the TEA-ASLP's system submitted to the MLC-SLM 2025 Challenge, addressing multilingual conversational automatic speech recognition (ASR) in Task I and speech diarization ASR in Task II. For Task I, we enhance Ideal-LLM…

Sound · Computer Science 2025-07-25 Hongfei Xue , Kaixun Huang , Zhikai Zhou , Shen Huang , Shidong Shang

One of the major challenges for developing automatic speech recognition (ASR) for low-resource languages is the limited access to labeled data with domain-specific variations. In this study, we propose a pseudo-labeling approach to develop…

Transcribing and understanding multi-speaker conversations requires speech recognition, speaker attribution, and timestamp localization. While speech LLMs excel at single-speaker tasks, multi-speaker scenarios remain challenging due to…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-06 Zhennan Lin , Shuai Wang , Zhaokai Sun , Pengyuan Xie , Chuan Xie , Jie Liu , Qiang Zhang , Lei Xie

Automatic Speech Recognition (ASR) aims to convert human speech content into corresponding text. In conversational scenarios, effectively utilizing context can enhance its accuracy. Large Language Models' (LLMs) exceptional long-context…

Sound · Computer Science 2026-01-19 Bingshen Mu , Hexin Liu , Hongfei Xue , Kun Wei , Lei Xie

This paper describes the SPAPL system for the INTERSPEECH 2021 Challenge: Shared Task on Automatic Speech Recognition for Non-Native Children's Speech in German. ~ 5 hours of transcribed data and ~ 60 hours of untranscribed data are…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-21 Jinhan Wang , Yunzheng Zhu , Ruchao Fan , Wei Chu , Abeer Alwan

Transformer based end-to-end modelling approaches with multiple stream inputs have been achieved great success in various automatic speech recognition (ASR) tasks. An important issue associated with such approaches is that the intermediate…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-11 Jin Li , Rongfeng Su , Xurong Xie , Nan Yan , Lan Wang

In this work, we investigated the teacher-student training paradigm to train a fully learnable multi-channel acoustic model for far-field automatic speech recognition (ASR). Using a large offline teacher model trained on beamformed audio,…

Sound · Computer Science 2020-05-05 Sanna Wager , Aparna Khare , Minhua Wu , Kenichi Kumatani , Shiva Sundaram

Pre-trained transformer-based models have significantly advanced automatic speech recognition (ASR), yet they remain sensitive to accent and dialectal variations, resulting in elevated word error rates (WER) in linguistically diverse…

Computation and Language · Computer Science 2025-10-13 Mohammad Hossein Sameti , Sepehr Harfi Moridani , Ali Zarean , Hossein Sameti

One of the central skills that language learners need to practice is speaking the language. Currently, students in school do not get enough speaking opportunities and lack conversational practice. Recent advances in speech technology and…

Computation and Language · Computer Science 2024-06-06 Janick Michot , Manuela Hürlimann , Jan Deriu , Luzia Sauer , Katsiaryna Mlynchyk , Mark Cieliebak

We present a frontend for improving robustness of automatic speech recognition (ASR), that jointly implements three modules within a single model: acoustic echo cancellation, speech enhancement, and speech separation. This is achieved by…

Audio and Speech Processing · Electrical Eng. & Systems 2021-11-22 Tom O'Malley , Arun Narayanan , Quan Wang , Alex Park , James Walker , Nathan Howard

Automatic Speech Recognition (ASR) systems can be trained to achieve remarkable performance given large amounts of manually transcribed speech, but large labeled data sets can be difficult or expensive to acquire for all languages of…

Computation and Language · Computer Science 2022-03-22 Hanan Aldarmaki , Asad Ullah , Nazar Zaki

Automatic speech recognition (ASR) has made remarkable progress but heavily relies on large-scale labeled data, which is scarce for low-resource languages like Vietnamese. While existing systems such as Whisper, USM, and MMS achieve…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-30 Jianheng Zhuo , Yifan Yang , Yiwen Shao , Yong Xu , Dong Yu , Kai Yu , Xie Chen

ASR systems have become increasingly widespread in recent years. However, their textual outputs often require post-processing tasks before they can be practically utilized. To address this issue, we draw inspiration from the multifaceted…

Computation and Language · Computer Science 2023-09-22 Lei Zhang , Zhengkun Tian , Xiang Chen , Jiaming Sun , Hongyu Xiang , Ke Ding , Guanglu Wan

Large Language Models (LLMs) have demonstrated unparalleled effectiveness in various NLP tasks, and integrating LLMs with automatic speech recognition (ASR) is becoming a mainstream paradigm. Building upon this momentum, our research delves…

Self-supervised speech pre-training methods have developed rapidly in recent years, which show to be very effective for many near-field single-channel speech tasks. However, far-field multichannel speech processing is suffering from the…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-09 Qiushi Zhu , Jie Zhang , Yu Gu , Yuchen Hu , Lirong Dai

Accurate far-field speech datasets are critical for tasks such as automatic speech recognition (ASR), dereverberation, speech enhancement, and source separation. However, current datasets are limited by the trade-off between acoustic…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-28 Sarabeth S. Mullins , Georg Götz , Eric Bezzam , Steven Zheng , Daniel Gert Nielsen

Neural speech separation has made remarkable progress and its integration with automatic speech recognition (ASR) is an important direction towards realizing multi-speaker ASR. This work provides an insightful investigation of speech…