中文
相关论文

相关论文: Minimum Bayes Risk Training for End-to-End Speaker…

200 篇论文

Previous studies have confirmed that by augmenting acoustic features with the place/manner of articulatory features, the speech enhancement (SE) process can be guided to consider the broad phonetic properties of the input speech when…

声音 · 计算机科学 2023-06-21 Yen-Ju Lu , Chia-Yu Chang , Cheng Yu , Ching-Feng Liu , Jeih-weih Hung , Shinji Watanabe , Yu Tsao

In this paper, we propose a novel approach for the transcription of speech conversations with natural speaker overlap, from single channel speech recordings. The proposed model is a combination of a speaker diarization system and a hybrid…

音频与语音处理 · 电气工程与系统科学 2022-08-30 Srikanth Raj Chetupalli , Sriram Ganapathy

This paper presents the TEA-ASLP's system submitted to the MLC-SLM 2025 Challenge, addressing multilingual conversational automatic speech recognition (ASR) in Task I and speech diarization ASR in Task II. For Task I, we enhance Ideal-LLM…

声音 · 计算机科学 2025-07-25 Hongfei Xue , Kaixun Huang , Zhikai Zhou , Shen Huang , Shidong Shang

It is important to transcribe and archive speech data of endangered languages for preserving heritages of verbal culture and automatic speech recognition (ASR) is a powerful tool to facilitate this process. However, since endangered…

音频与语音处理 · 电气工程与系统科学 2020-08-03 Kohei Matsuura , Masato Mimura , Shinsuke Sakai , Tatsuya Kawahara

As more and more information-rich data like video become available, utilizing multi-modal auxiliary information to enhance audio tasks has sparked widespread research interest. The recent surge in research on LLM-based audio models provides…

音频与语音处理 · 电气工程与系统科学 2024-11-12 Guanrou Yang , Ziyang Ma , Fan Yu , Zhifu Gao , Shiliang Zhang , Xie Chen

End-to-end (E2E) automatic speech recognition (ASR) models have recently demonstrated superior performance over the traditional hybrid ASR models. Training an E2E ASR model requires a large amount of data which is not only expensive but may…

机器学习 · 计算机科学 2021-06-16 Amin Fazel , Wei Yang , Yulan Liu , Roberto Barra-Chicote , Yixiong Meng , Roland Maas , Jasha Droppo

Attention-based encoder-decoder model has achieved impressive results for both automatic speech recognition (ASR) and text-to-speech (TTS) tasks. This approach takes advantage of the memorization capacity of neural networks to learn the…

计算与语言 · 计算机科学 2020-03-17 Chengyi Wang , Yu Wu , Yujiao Du , Jinyu Li , Shujie Liu , Liang Lu , Shuo Ren , Guoli Ye , Sheng Zhao , Ming Zhou

Non-autoregressive end-to-end ASR framework might be potentially appropriate for code-switching recognition task thanks to its inherent property that present output token being independent of historical ones. However, it still…

音频与语音处理 · 电气工程与系统科学 2021-10-08 Yizhou Peng , Jicheng Zhang , Haihua Xu , Hao Huang , Eng Siong Chng

Error Span Detection (ESD) extends automatic machine translation (MT) evaluation by localizing translation errors and labeling their severity. Current generative ESD methods typically use Maximum a Posteriori (MAP) decoding, assuming that…

Automatic speech recognition (ASR) has become increasingly ubiquitous on modern edge devices. Past work developed streaming End-to-End (E2E) all-neural speech recognizers that can run compactly on edge devices. However, E2E ASR models are…

In the last decade of automatic speech recognition (ASR) research, the introduction of deep learning brought considerable reductions in word error rate of more than 50% relative, compared to modeling without deep learning. In the wake of…

音频与语音处理 · 电气工程与系统科学 2023-03-07 Rohit Prabhavalkar , Takaaki Hori , Tara N. Sainath , Ralf Schlüter , Shinji Watanabe

Recently, the end-to-end approach has been successfully applied to multi-speaker speech separation and recognition in both single-channel and multichannel conditions. However, severe performance degradation is still observed in the…

In this paper, we propose a three-stage training methodology to improve the speech recognition accuracy of low-resource languages. We explore and propose an effective combination of techniques such as transfer learning, encoder freezing,…

音频与语音处理 · 电气工程与系统科学 2021-11-22 Jiyeon Kim , Mehul Kumar , Dhananjaya Gowda , Abhinav Garg , Chanwoo Kim

In this paper, we propose to use pre-trained features from end-to-end ASR models to solve speech sentiment analysis as a down-stream task. We show that end-to-end ASR features, which integrate both acoustic and text information from speech,…

计算与语言 · 计算机科学 2020-03-06 Zhiyun Lu , Liangliang Cao , Yu Zhang , Chung-Cheng Chiu , James Fan

End-to-end (E2E) automatic speech recognition models like Recurrent Neural Networks Transducer (RNN-T) are becoming a popular choice for streaming ASR applications like voice assistants. While E2E models are very effective at learning…

计算与语言 · 计算机科学 2022-01-12 Chhavi Choudhury , Ankur Gandhe , Xiaohan Ding , Ivan Bulyko

A P300 ERP-based Brain-Computer Interface (BCI) speller is an assistive communication tool. It searches for the P300 event-related potential (ERP) elicited by target stimuli, distinguishing it from the neural responses to non-target stimuli…

机器学习 · 计算机科学 2026-02-19 Shumeng Chen , Jane E. Huggins , Tianwen Ma

This paper proposes AS-ASR, a lightweight aphasia-specific speech recognition framework based on Whisper-tiny, tailored for low-resource deployment on edge devices. Our approach introduces a hybrid training strategy that systematically…

音频与语音处理 · 电气工程与系统科学 2026-02-03 Chen Bao , Chuanbing Huo , Qinyu Chen , Chang Gao

Building an accurate automatic speech recognition (ASR) system requires a large dataset that contains many hours of labeled speech samples produced by a diverse set of speakers. The lack of such open free datasets is one of the main issues…

计算与语言 · 计算机科学 2018-11-05 Jason Li , Ravi Gadde , Boris Ginsburg , Vitaly Lavrukhin

We revisit self-training in the context of end-to-end speech recognition. We demonstrate that training with pseudo-labels can substantially improve the accuracy of a baseline model. Key to our approach are a strong baseline acoustic and…

计算与语言 · 计算机科学 2020-05-08 Jacob Kahn , Ann Lee , Awni Hannun

It has been shown that the intelligibility of noisy speech can be improved by speech enhancement (SE) algorithms. However, monaural SE has not been established as an effective frontend for automatic speech recognition (ASR) in noisy…

声音 · 计算机科学 2024-03-12 Yufeng Yang , Ashutosh Pandey , DeLiang Wang