中文
相关论文

相关论文: Extreme Encoder Output Frame Rate Reduction: Impro…

200 篇论文

Spoken Language Understanding (SLU) is a critical speech recognition application and is often deployed on edge devices. Consequently, on-device processing plays a significant role in the practical implementation of SLU. This paper focuses…

音频与语音处理 · 电气工程与系统科学 2023-06-05 Yosuke Kashiwagi , Siddhant Arora , Hayato Futami , Jessica Huynh , Shih-Lun Wu , Yifan Peng , Brian Yan , Emiru Tsunoo , Shinji Watanabe

End-to-end approaches have drawn much attention recently for significantly simplifying the construction of an automatic speech recognition (ASR) system. RNN transducer (RNN-T) is one of the popular end-to-end methods. Previous studies have…

计算与语言 · 计算机科学 2019-04-24 Senmao Wang , Pan Zhou , Wei Chen , Jia Jia , Lei Xie

End-to-end (E2E) automatic speech recognition (ASR) models have become standard practice for various commercial applications. However, in real-world scenarios, the long-tailed nature of word distribution often leads E2E ASR models to…

计算与语言 · 计算机科学 2024-09-11 Yi-Cheng Wang , Li-Ting Pai , Bi-Cheng Yan , Hsin-Wei Wang , Chi-Han Lin , Berlin Chen

Recent end-to-end automatic speech recognition (ASR) systems often utilize a Transformer-based acoustic encoder that generates embedding at a high frame rate. However, this design is inefficient, particularly for long speech signals due to…

计算与语言 · 计算机科学 2023-06-29 Yuang Li , Yu Wu , Jinyu Li , Shujie Liu

Large Audio Language Models (LALMs) demonstrate impressive performance across diverse tasks, ranging from speech recognition to general audio understanding. However, their scalability is limited by the quadratic complexity of attention and…

音频与语音处理 · 电气工程与系统科学 2025-11-27 Saurabhchand Bhati , Samuel Thomas , Hilde Kuehne , Rogerio Feris , James Glass

Recently, there has been a growing interest in end-to-end speech recognition that directly transcribes speech to text without any predefined alignments. In this paper, we explore the use of attention-based encoder-decoder model for Mandarin…

计算与语言 · 计算机科学 2018-02-14 Changhao Shan , Junbo Zhang , Yujun Wang , Lei Xie

End-to-end (E2E) spoken language understanding (SLU) systems that generate a semantic parse from speech have become more promising recently. This approach uses a single model that utilizes audio and text representations from pre-trained…

计算与语言 · 计算机科学 2023-07-25 Suyoun Kim , Akshat Shrivastava , Duc Le , Ju Lin , Ozlem Kalinli , Michael L. Seltzer

Large language model (LLM)-based automatic speech recognition (ASR) has recently attracted a lot of attention due to its high recognition accuracy and enhanced multi-dialect support. However, the high decoding latency of LLMs challenges the…

音频与语音处理 · 电气工程与系统科学 2025-07-29 Linye Wei , Shuzhang Zhong , Songqiang Xu , Runsheng Wang , Ru Huang , Meng Li

Latency-critical speech applications (e.g., live transcription, voice commands, and real-time translation) demand low time-to-first-token (TTFT) and high transcription accuracy, particularly on resource-constrained edge devices.…

计算与语言 · 计算机科学 2026-02-13 Manjunath Kudlur , Evan King , James Wang , Pete Warden

Automatic speech quality assessment is essential for audio researchers, developers, speech and language pathologists, and system quality engineers. The current state-of-the-art systems are based on framewise speech features (hand-engineered…

音频与语音处理 · 电气工程与系统科学 2022-11-15 Karl El Hajal , Zihan Wu , Neil Scheidwasser-Clow , Gasser Elbanna , Milos Cernak

End-to-End automatic speech recognition (ASR) models aim to learn a generalised speech representation to perform recognition. In this domain there is little research to analyse internal representation dependencies and their relationship to…

计算与语言 · 计算机科学 2022-11-04 Anna Ollerenshaw , Md Asif Jalal , Thomas Hain

Although recent advances in deep learning technology have boosted automatic speech recognition (ASR) performance in the single-talker case, it remains difficult to recognize multi-talker speech in which many voices overlap. One conventional…

音频与语音处理 · 电气工程与系统科学 2022-09-20 Takafumi Moriya , Hiroshi Sato , Tsubasa Ochiai , Marc Delcroix , Takahiro Shinozaki

We propose a MultiScale AutoEncoder(MSAE) based extreme image compression framework to offer visually pleasing reconstruction at a very low bitrate. Our method leverages the "priors" at different resolution scale to improve the compression…

图像与视频处理 · 电气工程与系统科学 2020-01-06 Chao Huang , Haojie Liu , Tong Chen , Qiu Shen , Zhan Ma

ASR endpointing (EP) plays a major role in delivering a good user experience in products supporting human or artificial agents in human-human/machine conversations. Transducer-based ASR (T-ASR) is an end-to-end (E2E) ASR modelling technique…

This paper proposes a simple yet effective way of regularising the encoder-decoder-based automatic speech recognition (ASR) models that enhance the robustness of the model and improve the generalisation to out-of-domain scenarios. The…

音频与语音处理 · 电气工程与系统科学 2024-10-24 Alexander Polok , Santosh Kesiraju , Karel Beneš , Lukáš Burget , Jan Černocký

Neural network models for audio tasks, such as automatic speech recognition (ASR) and acoustic scene classification (ASC), are susceptible to noise contamination for real-life applications. To improve audio quality, an enhancement module,…

Proper nouns present a challenge for end-to-end (E2E) automatic speech recognition (ASR) systems in that a particular name may appear only rarely during training, and may have a pronunciation similar to that of a more common word. Unlike…

音频与语音处理 · 电气工程与系统科学 2020-05-21 Cal Peyser , Tara N. Sainath , Golan Pundak

In this paper, we present an incremental domain adaptation technique to prevent catastrophic forgetting for an end-to-end automatic speech recognition (ASR) model. Conventional approaches require extra parameters of the same size as the…

音频与语音处理 · 电气工程与系统科学 2022-07-04 Yuki Takashima , Shota Horiguchi , Shinji Watanabe , Paola García , Yohei Kawaguchi

End-to-end (E2E) multi-channel ASR systems show state-of-the-art performance in far-field ASR tasks by joint training of a multi-channel front-end along with the ASR model. The main limitation of such systems is that they are usually…

音频与语音处理 · 电气工程与系统科学 2021-09-24 Marco Gaudesi , Felix Weninger , Dushyant Sharma , Puming Zhan

We study training a single end-to-end (E2E) automatic speech recognition (ASR) model for three languages used in Kazakhstan: Kazakh, Russian, and English. We first describe the development of multilingual E2E ASR based on Transformer…

音频与语音处理 · 电气工程与系统科学 2021-08-04 Saida Mussakhojayeva , Yerbolat Khassanov , Huseyin Atakan Varol