中文
相关论文

相关论文: Investigation of Practical Aspects of Single Chann…

200 篇论文

This paper introduces a practical approach for leveraging a real-time deep learning model to alternate between speech enhancement and joint speech enhancement and separation depending on whether the input mixture contains one or two active…

音频与语音处理 · 电气工程与系统科学 2023-10-17 Kashyap Patel , Anton Kovalyov , Issa Panahi

The information loss or distortion caused by single-channel speech enhancement (SE) harms the performance of automatic speech recognition (ASR). Observation addition (OA) is an effective post-processing method to improve ASR performance by…

Recently, the end-to-end training approach for multi-channel ASR has shown its effectiveness, which usually consists of a beamforming front-end and a recognition back-end. However, the end-to-end training becomes more difficult due to the…

音频与语音处理 · 电气工程与系统科学 2022-10-11 Keyu An , Ji Xiao , Zhijian Ou

Recent advancement in deep learning encouraged developing large automatic speech recognition (ASR) models that achieve promising results while ignoring computational and memory constraints. However, deploying such models on low resource…

计算机视觉与模式识别 · 计算机科学 2025-05-29 Abdul Hannan , Alessio Brutti , Shah Nawaz , Mubashir Noman

Automatic speech recognition (ASR) systems degrade significantly under noisy conditions. Recently, speech enhancement (SE) is introduced as front-end to reduce noise for ASR, but it also suppresses some important speech information, i.e.,…

音频与语音处理 · 电气工程与系统科学 2023-05-30 Yuchen Hu , Nana Hou , Chen Chen , Eng Siong Chng

Automatic speech recognition (ASR) technologies have been significantly advanced in the past few decades. However, recognition of overlapped speech remains a highly challenging task to date. To this end, multi-channel microphone array data…

音频与语音处理 · 电气工程与系统科学 2021-08-31 Jianwei Yu , Shi-Xiong Zhang , Bo Wu , Shansong Liu , Shoukang Hu , Mengzhe Geng , Xunying Liu , Helen Meng , Dong Yu

Streaming end-to-end speech recognition models have been widely applied to mobile devices and show significant improvement in efficiency. These models are typically trained on the server using transcribed speech data. However, the server…

This study investigates the performance of personalized automatic speech recognition (ASR) for recognizing disordered speech using small amounts of per-speaker adaptation data. We trained personalized models for 195 individuals with…

音频与语音处理 · 电气工程与系统科学 2021-10-12 Jimmy Tobin , Katrin Tomanek

We study training a single acoustic model for multiple languages with the aim of improving automatic speech recognition (ASR) performance on low-resource languages, and over-all simplifying deployment of ASR systems that support diverse…

音频与语音处理 · 电气工程与系统科学 2020-07-09 Vineel Pratap , Anuroop Sriram , Paden Tomasello , Awni Hannun , Vitaliy Liptchinsky , Gabriel Synnaeve , Ronan Collobert

Recent work has shown that it is possible to train a single model to perform joint acoustic echo cancellation (AEC), speech enhancement, and voice separation, thereby serving as a unified frontend for robust automatic speech recognition…

音频与语音处理 · 电气工程与系统科学 2022-09-15 Tom O'Malley , Arun Narayanan , Quan Wang

Self-supervised learning (SSL) models have achieved considerable improvements in automatic speech recognition (ASR). In addition, ASR performance could be further improved if the model is dedicated to audio content information learning…

音频与语音处理 · 电气工程与系统科学 2022-12-08 Genshun Wan , Tan Liu , Hang Chen , Jia Pan , Cong Liu , Zhongfu Ye

Accurate recognition of cocktail party speech containing overlapping speakers, noise and reverberation remains a highly challenging task to date. Motivated by the invariance of visual modality to acoustic signal corruption, an audio-visual…

音频与语音处理 · 电气工程与系统科学 2023-07-07 Guinan Li , Jiajun Deng , Mengzhe Geng , Zengrui Jin , Tianzi Wang , Shujie Hu , Mingyu Cui , Helen Meng , Xunying Liu

Sequence-to-sequence models, such as attention-based models in automatic speech recognition (ASR), are typically trained to optimize the cross-entropy criterion which corresponds to improving the log-likelihood of the data. However, system…

计算与语言 · 计算机科学 2017-12-06 Rohit Prabhavalkar , Tara N. Sainath , Yonghui Wu , Patrick Nguyen , Zhifeng Chen , Chung-Cheng Chiu , Anjuli Kannan

We present an approach to reduce the performance disparity between geographic regions without degrading performance on the overall user population for ASR. A popular approach is to fine-tune the model with data from regions where the ASR…

音频与语音处理 · 电气工程与系统科学 2024-02-09 Viet Anh Trinh , Pegah Ghahremani , Brian King , Jasha Droppo , Andreas Stolcke , Roland Maas

Self-supervised pretraining for Automated Speech Recognition (ASR) has shown varied degrees of success. In this paper, we propose to jointly learn representations during pretraining from two different modalities: speech and text. The…

计算与语言 · 计算机科学 2021-08-30 Zhehuai Chen , Yu Zhang , Andrew Rosenberg , Bhuvana Ramabhadran , Gary Wang , Pedro Moreno

We present an end-to-end multichannel speaker-attributed automatic speech recognition (MC-SA-ASR) system that combines a Conformer-based encoder with multi-frame crosschannel attention and a speaker-attributed Transformer-based decoder. To…

计算与语言 · 计算机科学 2023-10-17 Can Cui , Imran Ahamad Sheikh , Mostafa Sadeghi , Emmanuel Vincent

In the field of multi-channel, multi-speaker Automatic Speech Recognition (ASR), the task of discerning and accurately transcribing a target speaker's speech within background noise remains a formidable challenge. Traditional approaches…

音频与语音处理 · 电气工程与系统科学 2024-06-19 Yiwen Shao , Shi-Xiong Zhang , Yong Xu , Meng Yu , Dong Yu , Daniel Povey , Sanjeev Khudanpur

Using neural network based acoustic frontends for improving robustness of streaming automatic speech recognition (ASR) systems is challenging because of the causality constraints and the resulting distortion that the frontend processing…

音频与语音处理 · 电气工程与系统科学 2022-04-27 Arun Narayanan , James Walker , Sankaran Panchapagesan , Nathan Howard , Yuma Koizumi

One solution to automatic speech recognition (ASR) of overlapping speakers is to separate speech and then perform ASR on the separated signals. Commonly, the separator produces artefacts which often degrade ASR performance. Addressing this…

End-to-end approaches for automatic speech recognition (ASR) benefit from directly modeling the probability of the word sequence given the input audio stream in a single neural network. However, compared to conventional ASR systems, these…

音频与语音处理 · 电气工程与系统科学 2020-02-19 Ankur Gandhe , Ariya Rastrow