中文
相关论文

相关论文: Pushing the Limits of Non-Autoregressive Speech Re…

200 篇论文

Direct acoustics-to-word (A2W) models in the end-to-end paradigm have received increasing attention compared to conventional sub-word based automatic speech recognition models using phones, characters, or context-dependent hidden Markov…

计算与语言 · 计算机科学 2017-12-11 Kartik Audhkhasi , Brian Kingsbury , Bhuvana Ramabhadran , George Saon , Michael Picheny

Speech technology is a field that encompasses various techniques and tools used to enable machines to interact with speech, such as automatic speech recognition (ASR), spoken dialog systems, and others, allowing a device to capture spoken…

音频与语音处理 · 电气工程与系统科学 2024-03-14 Amanda Phaladi , Thipe Modipa

To improve the performance of state-of-the-art automatic speech recognition systems it is common practice to include external knowledge sources such as language models or prior corrections. This is usually done via log-linear model…

计算与语言 · 计算机科学 2021-10-19 Felix Meyer , Wilfried Michel , Mohammad Zeineldeen , Ralf Schlüter , Hermann Ney

In this work, we propose ParaNet, a non-autoregressive seq2seq model that converts text to spectrogram. It is fully convolutional and brings 46.7 times speed-up over the lightweight Deep Voice 3 at synthesis, while obtaining reasonably good…

计算与语言 · 计算机科学 2020-07-01 Kainan Peng , Wei Ping , Zhao Song , Kexin Zhao

In the recent literature, "end-to-end" speech systems often refer to letter-based acoustic models trained in a sequence-to-sequence manner, either via a recurrent model or via a structured output learning approach (such as CTC). In contrast…

计算与语言 · 计算机科学 2019-02-19 Vitaliy Liptchinsky , Gabriel Synnaeve , Ronan Collobert

We present the Open ASR Leaderboard, a reproducible benchmarking platform with community contributions from academia and industry. It compares 86 open-source and proprietary systems across 12 datasets, with English short- and long-form and…

We propose CONF-TSASR, a non-autoregressive end-to-end time-frequency domain architecture for single-channel target-speaker automatic speech recognition (TS-ASR). The model consists of a TitaNet based speaker embedding module, a Conformer…

声音 · 计算机科学 2023-08-11 Yang Zhang , Krishna C. Puvvada , Vitaly Lavrukhin , Boris Ginsburg

In this paper, we propose MixSpeech, a simple yet effective data augmentation method based on mixup for automatic speech recognition (ASR). MixSpeech trains an ASR model by taking a weighted combination of two different speech features…

计算与语言 · 计算机科学 2021-02-26 Linghui Meng , Jin Xu , Xu Tan , Jindong Wang , Tao Qin , Bo Xu

Recent developments using End-to-End Deep Learning models have been shown to have near or better performance than state of the art Recurrent Neural Networks (RNNs) on Automatic Speech Recognition tasks. These models tend to be lighter…

音频与语音处理 · 电气工程与系统科学 2023-01-27 Will Rieger

For real-world deployment of automatic speech recognition (ASR), the system is desired to be capable of fast inference while relieving the requirement of computational resources. The recently proposed end-to-end ASR system based on…

音频与语音处理 · 电气工程与系统科学 2021-02-17 Yosuke Higuchi , Hirofumi Inaguma , Shinji Watanabe , Tetsuji Ogawa , Tetsunori Kobayashi

Non-autoregressive (NAR) transformer models have achieved significantly inference speedup but at the cost of inferior accuracy compared to autoregressive (AR) models in automatic speech recognition (ASR). Most of the NAR transformers take a…

声音 · 计算机科学 2021-04-19 Xingchen Song , Zhiyong Wu , Yiheng Huang , Chao Weng , Dan Su , Helen Meng

Speaker adaptation techniques provide a powerful solution to customise automatic speech recognition (ASR) systems for individual users. Practical application of unsupervised model-based speaker adaptation techniques to data intensive…

音频与语音处理 · 电气工程与系统科学 2023-02-16 Jiajun Deng , Xurong Xie , Tianzi Wang , Mingyu Cui , Boyang Xue , Zengrui Jin , Guinan Li , Shujie Hu , Xunying Liu

The success of the multilingual automatic speech recognition systems empowered many voice-driven applications. However, measuring the performance of such systems remains a major challenge, due to its dependency on manually transcribed…

计算与语言 · 计算机科学 2023-04-04 Shammur Absar Chowdhury , Ahmed Ali

Contextual ASR or hotword customization holds substantial practical value. Despite the impressive performance of current end-to-end (E2E) automatic speech recognition (ASR) systems, they often face challenges in accurately recognizing rare…

音频与语音处理 · 电气工程与系统科学 2024-11-12 Guanrou Yang , Ziyang Ma , Zhifu Gao , Shiliang Zhang , Xie Chen

Automatic speech recognition research focuses on training and evaluating on static datasets. Yet, as speech models are increasingly deployed on personal devices, such models encounter user-specific distributional shifts. To simulate this…

音频与语音处理 · 电气工程与系统科学 2023-05-26 Anuj Diwan , Ching-Feng Yeh , Wei-Ning Hsu , Paden Tomasello , Eunsol Choi , David Harwath , Abdelrahman Mohamed

There are several domains that own corresponding widely used feature extractors, such as ResNet, BERT, and GPT-x. These models are usually pre-trained on large amounts of unlabeled data by self-supervision and can be effectively applied to…

计算与语言 · 计算机科学 2021-01-19 Cheng Yi , Jianzhong Wang , Ning Cheng , Shiyu Zhou , Bo Xu

Attention-based encoder-decoder, e.g. transformer and its variants, generates the output sequence in an autoregressive (AR) manner. Despite its superior performance, AR model is computationally inefficient as its generation requires as many…

音频与语音处理 · 电气工程与系统科学 2024-09-27 Keyu An , Zerui Li , Zhifu Gao , Shiliang Zhang

End-to-end (E2E) systems have shown comparable performance to hybrid systems for automatic speech recognition (ASR). Word timings, as a by-product of ASR, are essential in many applications, especially for subtitling and computer-aided…

音频与语音处理 · 电气工程与系统科学 2023-06-14 Xianzhao Chen , Yist Y. Lin , Kang Wang , Yi He , Zejun Ma

This paper is a study of performance-efficiency trade-offs in pre-trained models for automatic speech recognition (ASR). We focus on wav2vec 2.0, and formalize several architecture designs that influence both the model performance and its…

计算与语言 · 计算机科学 2021-09-15 Felix Wu , Kwangyoun Kim , Jing Pan , Kyu Han , Kilian Q. Weinberger , Yoav Artzi

In real-time speech recognition applications, the latency is an important issue. We have developed a character-level incremental speech recognition (ISR) system that responds quickly even during the speech, where the hypotheses are…

计算与语言 · 计算机科学 2016-06-29 Kyuyeon Hwang , Wonyong Sung