中文
相关论文

相关论文: Beyond Universal Transformer: block reusing with a…

200 篇论文

In recent years, the evolution of end-to-end (E2E) automatic speech recognition (ASR) models has been remarkable, largely due to advances in deep learning architectures like transformer. On top of E2E systems, researchers have achieved…

音频与语音处理 · 电气工程与系统科学 2024-06-12 Shiyi Han , Zhihong Lei , Mingbin Xu , Xingyu Na , Zhen Huang

In this paper we investigate continuous speech recognition using electroencephalography (EEG) features using recently introduced end-to-end transformer based automatic speech recognition (ASR) model. Our results demonstrate that transformer…

音频与语音处理 · 电气工程与系统科学 2020-05-06 Gautam Krishna , Co Tran , Mason Carnahan , Ahmed H Tewfik

Transformer models have been used in automatic speech recognition (ASR) successfully and yields state-of-the-art results. However, its performance is still affected by speaker mismatch between training and test data. Further finetuning a…

音频与语音处理 · 电气工程与系统科学 2021-10-19 Yingzhu Zhao , Chongjia Ni , Cheung-Chi Leung , Shafiq Joty , Eng Siong Chng , Bin Ma

The end-to-end (E2E) automatic speech recognition (ASR) systems are often required to operate in reverberant conditions, where the long-term sub-band envelopes of the speech are temporally smeared. In this paper, we develop a feature…

音频与语音处理 · 电气工程与系统科学 2022-02-21 Rohit Kumar , Anurenjan Purushothaman , Anirudh Sreeram , Sriram Ganapathy

Recently, self-supervised pretraining has achieved impressive results in end-to-end (E2E) automatic speech recognition (ASR). However, the dominant sequence-to-sequence (S2S) E2E model is still hard to fully utilize the self-supervised…

音频与语音处理 · 电气工程与系统科学 2021-12-15 Keqi Deng , Songjun Cao , Yike Zhang , Long Ma

End-to-end (E2E) systems have played a more and more important role in automatic speech recognition (ASR) and achieved great performance. However, E2E systems recognize output word sequences directly with the input acoustic feature, which…

音频与语音处理 · 电气工程与系统科学 2020-08-04 Qi Liu , Zhehuai Chen , Hao Li , Mingkun Huang , Yizhou Lu , Kai Yu

In the last decade of automatic speech recognition (ASR) research, the introduction of deep learning brought considerable reductions in word error rate of more than 50% relative, compared to modeling without deep learning. In the wake of…

音频与语音处理 · 电气工程与系统科学 2023-03-07 Rohit Prabhavalkar , Takaaki Hori , Tara N. Sainath , Ralf Schlüter , Shinji Watanabe

Automatic speech recognition (ASR) systems typically rely on an external endpointer (EP) model to identify speech boundaries. In this work, we propose a method to jointly train the ASR and EP tasks in a single end-to-end (E2E) multitask…

声音 · 计算机科学 2023-02-16 Shaan Bijwadia , Shuo-yiin Chang , Bo Li , Tara Sainath , Chao Zhang , Yanzhang He

Sequence-to-sequence (S2S) modeling is becoming a popular paradigm for automatic speech recognition (ASR) because of its ability to jointly optimize all the conventional ASR components in an end-to-end (E2E) fashion. This report…

音频与语音处理 · 电气工程与系统科学 2019-04-30 Aswin Shanmugam Subramanian , Xiaofei Wang , Shinji Watanabe , Toru Taniguchi , Dung Tran , Yuya Fujita

This study addresses robust automatic speech recognition (ASR) by introducing a Conformer-based acoustic model. The proposed model builds on the wide residual bi-directional long short-term memory network (WRBN) with utterance-wise dropout…

声音 · 计算机科学 2022-10-21 Yufeng Yang , Peidong Wang , DeLiang Wang

In this work, we propose a new automatic speech recognition (ASR) system based on feature learning and an end-to-end training procedure for air traffic control (ATC) systems. The proposed model integrates the feature learning block,…

声音 · 计算机科学 2021-11-05 Peng Fan , Dongyue Guo , Yi Lin , Bo Yang , Jianwei Zhang

This paper presents our recent effort on end-to-end speaker-attributed automatic speech recognition, which jointly performs speaker counting, speech recognition and speaker identification for monaural multi-talker audio. Firstly, we…

音频与语音处理 · 电气工程与系统科学 2021-04-07 Naoyuki Kanda , Guoli Ye , Yashesh Gaur , Xiaofei Wang , Zhong Meng , Zhuo Chen , Takuya Yoshioka

We propose an adapter based multi-domain Transformer based language model (LM) for Transformer ASR. The model consists of a big size common LM and small size adapters. The model can perform multi-domain adaptation with only the small size…

In recent years, Transformer networks have shown remarkable performance in speech recognition tasks. However, their deployment poses challenges due to high computational and storage resource requirements. To address this issue, a…

声音 · 计算机科学 2024-05-01 Jianzong Wang , Ziqi Liang , Xulong Zhang , Ning Cheng , Jing Xiao

Joint optimization of multi-channel front-end and automatic speech recognition (ASR) has attracted much interest. While promising results have been reported for various tasks, past studies on its meeting transcription application were…

音频与语音处理 · 电气工程与系统科学 2020-11-30 Xiaofei Wang , Naoyuki Kanda , Yashesh Gaur , Zhuo Chen , Zhong Meng , Takuya Yoshioka

End-to-end models for robust automatic speech recognition (ASR) have not been sufficiently well-explored in prior work. With end-to-end models, one could choose to preprocess the input speech using speech enhancement techniques and train…

音频与语音处理 · 电气工程与系统科学 2021-02-15 Archiki Prasad , Preethi Jyothi , Rajbabu Velmurugan

Recently, fully recurrent neural network (RNN) based end-to-end models have been proven to be effective for multi-speaker speech recognition in both the single-channel and multi-channel scenarios. In this work, we explore the use of…

音频与语音处理 · 电气工程与系统科学 2020-02-14 Xuankai Chang , Wangyou Zhang , Yanmin Qian , Jonathan Le Roux , Shinji Watanabe

End-to-end models with auto-regressive decoders have shown impressive results for automatic speech recognition (ASR). These models formulate the sequence-level probability as a product of the conditional probabilities of all individual…

音频与语音处理 · 电气工程与系统科学 2021-06-24 Qiujia Li , Yu Zhang , Bo Li , Liangliang Cao , Philip C. Woodland

Although end-to-end (E2E) trainable automatic speech recognition (ASR) has shown great success by jointly learning acoustic and linguistic information, it still suffers from the effect of domain shifts, thus limiting potential applications.…

音频与语音处理 · 电气工程与系统科学 2023-08-28 Keqi Deng , Philip C. Woodland

We present a novel large-context end-to-end automatic speech recognition (E2E-ASR) model and its effective training method based on knowledge distillation. Common E2E-ASR models have mainly focused on utterance-level processing in which…

计算与语言 · 计算机科学 2021-02-17 Ryo Masumura , Naoki Makishima , Mana Ihori , Akihiko Takashima , Tomohiro Tanaka , Shota Orihashi