中文
相关论文

相关论文: Fast-U2++: Fast and Accurate End-to-End Speech Rec…

200 篇论文

Recently multi-channel end-to-end (ME2E) ASR systems have emerged. While streaming single-channel end-to-end ASR has been extensively studied, streaming ME2E ASR is limited in exploration. Additionally, recent studies call attention to the…

音频与语音处理 · 电气工程与系统科学 2024-09-18 Xiangzhu Kong , Tianqi Ning , Hao Huang , Zhijian Ou

In this paper, we describe the work that we have done to participate in Task1 of the ConferencingSpeech2021 challenge. This task set a goal to develop the solution for multi-channel speech enhancement in a real-time manner. We propose a…

信号处理 · 电气工程与系统科学 2021-04-06 Vasiliy Kuzmin , Fyodor Kravchenko , Artem Sokolov , Jie Geng

As a robust and large-scale multilingual speech recognition model, Whisper has demonstrated impressive results in many low-resource and out-of-distribution scenarios. However, its encoder-decoder structure hinders its application to…

声音 · 计算机科学 2025-05-06 Haoyu Wang , Guoqiang Hu , Guodong Lin , Wei-Qiang Zhang , Jian Li

While the community keeps promoting end-to-end models over conventional hybrid models, which usually are long short-term memory (LSTM) models trained with a cross entropy criterion followed by a sequence discriminative training criterion,…

音频与语音处理 · 电气工程与系统科学 2020-03-18 Jinyu Li , Rui Zhao , Eric Sun , Jeremy H. M. Wong , Amit Das , Zhong Meng , Yifan Gong

This paper presents a simple end-to-end model for speech recognition, combining a convolutional network based acoustic model and a graph decoding. It is trained to output letters, with transcribed speech, without the need for force…

机器学习 · 计算机科学 2016-09-14 Ronan Collobert , Christian Puhrsch , Gabriel Synnaeve

In voice-enabled applications, a predetermined hotword isusually used to activate a device in order to attend to the query.However, speaking queries followed by a hotword each timeintroduces a cognitive burden in continued conversations.…

In this paper we present a Transformer-Transducer model architecture and a training technique to unify streaming and non-streaming speech recognition models into one model. The model is composed of a stack of transformer layers for audio…

声音 · 计算机科学 2020-10-08 Anshuman Tripathi , Jaeyoung Kim , Qian Zhang , Han Lu , Hasim Sak

Highly performing deep neural networks come at the cost of computational complexity that limits their practicality for deployment on portable devices. We propose the low-rank transformer (LRT), a memory-efficient and fast neural…

计算与语言 · 计算机科学 2020-02-17 Genta Indra Winata , Samuel Cahyawijaya , Zhaojiang Lin , Zihan Liu , Pascale Fung

All-neural end-to-end (E2E) automatic speech recognition (ASR) systems that use a single neural network to transduce audio to word sequences have been shown to achieve state-of-the-art results on several tasks. In this work, we examine the…

音频与语音处理 · 电气工程与系统科学 2019-10-28 Arun Narayanan , Rohit Prabhavalkar , Chung-Cheng Chiu , David Rybach , Tara N. Sainath , Trevor Strohman

One of limitations in end-to-end automatic speech recognition (ASR) framework is its performance would be compromised if train-test utterance lengths are mismatched. In this paper, we propose an on-the-fly random utterance concatenation…

音频与语音处理 · 电气工程与系统科学 2023-05-26 Yist Y. Lin , Tao Han , Haihua Xu , Van Tung Pham , Yerbolat Khassanov , Tze Yuang Chong , Yi He , Lu Lu , Zejun Ma

Transformer-based end-to-end (E2E) automatic speech recognition (ASR) systems have recently gained wide popularity, and are shown to outperform E2E models based on recurrent structures on a number of ASR tasks. However, like other E2E…

音频与语音处理 · 电气工程与系统科学 2020-11-30 Mohan Li , Catalin Zorila , Rama Doddipatla

End-to-end (E2E) systems have shown comparable performance to hybrid systems for automatic speech recognition (ASR). Word timings, as a by-product of ASR, are essential in many applications, especially for subtitling and computer-aided…

音频与语音处理 · 电气工程与系统科学 2023-06-14 Xianzhao Chen , Yist Y. Lin , Kang Wang , Yi He , Zejun Ma

Punctuated text prediction is crucial for automatic speech recognition as it enhances readability and impacts downstream natural language processing tasks. In streaming scenarios, the ability to predict punctuation in real-time is…

音频与语音处理 · 电气工程与系统科学 2023-10-31 Hanbyul Kim , Seunghyun Seo , Lukas Lee , Seolki Baek

End-to-end approaches open a new way for more accurate and efficient spoken language understanding (SLU) systems by alleviating the drawbacks of traditional pipeline systems. Previous works exploit textual information for an SLU model via…

计算与语言 · 计算机科学 2021-06-11 Seongbin Kim , Gyuwan Kim , Seongjin Shin , Sangmin Lee

This paper introduces a fast-slow encoder based transducer with streaming deliberation for end-to-end automatic speech recognition. We aim to improve the recognition accuracy of the fast-slow encoder based transducer while keeping its…

音频与语音处理 · 电气工程与系统科学 2022-12-16 Ke Li , Jay Mahadeokar , Jinxi Guo , Yangyang Shi , Gil Keren , Ozlem Kalinli , Michael L. Seltzer , Duc Le

Whispering is an important mode of human speech, but no end-to-end recognition results for it were reported yet, probably due to the scarcity of available whispered speech data. In this paper, we present several approaches for end-to-end…

计算与语言 · 计算机科学 2020-11-10 Heng-Jui Chang , Alexander H. Liu , Hung-yi Lee , Lin-shan Lee

Transformer-based models excel in speech recognition. Existing efforts to optimize Transformer inference, typically for long-context applications, center on simplifying attention score calculations. However, streaming speech recognition…

机器学习 · 计算机科学 2024-01-22 Yang Li , Liangzhen Lai , Yuan Shangguan , Forrest N. Iandola , Zhaoheng Ni , Ernie Chang , Yangyang Shi , Vikas Chandra

Adjusting the latency, power, and accuracy of natural language understanding models is a desirable objective of an efficient architecture. This paper proposes an efficient Transformer architecture that adjusts the inference computational…

计算与语言 · 计算机科学 2024-09-20 Sajjad Kachuee , Mohammad Sharifkhani

Recently, end-to-end speech recognition with a hybrid model consisting of the connectionist temporal classification(CTC) and the attention encoder-decoder achieved state-of-the-art results. In this paper, we propose a novel CTC decoder…

声音 · 计算机科学 2018-11-02 Zhe Yuan , Zhuoran Lyu , Jiwei Li , Xi Zhou

Recently, there has been an increasing interest in unifying streaming and non-streaming speech recognition models to reduce development, training and deployment cost. The best-known approaches rely on either window-based or dynamic…

音频与语音处理 · 电气工程与系统科学 2023-04-27 Xilai Li , Goeric Huybrechts , Srikanth Ronanki , Jeff Farris , Sravan Bodapati