中文
相关论文

相关论文: Automatic Speech Recognition with BERT and CTC Tra…

200 篇论文

This paper proposes a novel label-synchronous speech-to-text alignment technique for automatic speech recognition (ASR). The speech-to-text alignment is a problem of splitting long audio recordings with un-aligned transcripts into…

音频与语音处理 · 电气工程与系统科学 2021-04-22 Yusuke Kida , Tatsuya Komatsu , Masahito Togami

Neural transducers (NT) provide an effective framework for speech streaming, demonstrating strong performance in automatic speech recognition (ASR). However, the application of NT to speech translation (ST) remains challenging, as existing…

计算与语言 · 计算机科学 2025-06-04 Amir Hussein , Cihan Xiao , Matthew Wiesner , Dan Povey , Leibny Paola Garcia , Sanjeev Khudanpur

Transformer-based models have demonstrated their effectiveness in automatic speech recognition (ASR) tasks and even shown superior performance over the conventional hybrid framework. The main idea of Transformers is to capture the…

声音 · 计算机科学 2022-07-05 Kun Wei , Pengcheng Guo , Ning Jiang

This paper proposes a unified framework, All-in-One ASR, that allows a single model to support multiple automatic speech recognition (ASR) paradigms, including connectionist temporal classification (CTC), attention-based encoder-decoder…

音频与语音处理 · 电气工程与系统科学 2025-12-15 Takafumi Moriya , Masato Mimura , Tomohiro Tanaka , Hiroshi Sato , Ryo Masumura , Atsunori Ogawa

Automatic speech recognition (ASR) has recently become an important challenge when using deep learning (DL). It requires large-scale training datasets and high computational and storage resources. Moreover, DL techniques and machine…

声音 · 计算机科学 2023-08-01 Hamza Kheddar , Yassine Himeur , Somaya Al-Maadeed , Abbes Amira , Faycal Bensaali

End-to-end automatic speech recognition (ASR), unlike conventional ASR, does not have modules to learn the semantic representation from speech encoder. Moreover, the higher frame-rate of speech representation prevents the model to learn the…

人工智能 · 计算机科学 2021-03-19 Md Akmal Haidar , Chao Xing , Mehdi Rezagholizadeh

In this work, we introduce a simple yet efficient post-processing model for automatic speech recognition (ASR). Our model has Transformer-based encoder-decoder architecture which "translates" ASR model output into grammatically and…

计算与语言 · 计算机科学 2019-10-24 Oleksii Hrinchuk , Mariya Popova , Boris Ginsburg

Automatic speech recognition (ASR) plays a pivotal role in our daily lives, offering utility not only for interacting with machines but also for facilitating communication for individuals with partial or profound hearing impairments. The…

音频与语音处理 · 电气工程与系统科学 2025-01-14 Billel Essaid , Hamza Kheddar , Noureddine Batel , Muhammad E. H. Chowdhury , Abderrahmane Lakas

Transformers have evolved with great success in various artificial intelligence tasks. Thanks to our recent prevalence of self-attention mechanisms, which capture long-term dependency, phenomenal outcomes in speech processing and…

计算与语言 · 计算机科学 2024-08-28 Shruti Singh , Muskaan Singh , Virender Kadyan

In the domain of air traffic control (ATC) systems, efforts to train a practical automatic speech recognition (ASR) model always faces the problem of small training samples since the collection and annotation of speech samples are expert-…

声音 · 计算机科学 2021-02-17 Yi Lin , Qin Li , Bo Yang , Zhen Yan , Huachun Tan , Zhengmao Chen

Code-switching speech recognition has attracted an increasing interest recently, but the need for expert linguistic knowledge has always been a big issue. End-to-end automatic speech recognition (ASR) simplifies the building of ASR systems…

计算与语言 · 计算机科学 2018-11-02 Ne Luo , Dongwei Jiang , Shuaijiang Zhao , Caixia Gong , Wei Zou , Xiangang Li

We introduce dual-decoder Transformer, a new model architecture that jointly performs automatic speech recognition (ASR) and multilingual speech translation (ST). Our models are based on the original Transformer architecture (Vaswani et…

计算与语言 · 计算机科学 2020-11-21 Hang Le , Juan Pino , Changhan Wang , Jiatao Gu , Didier Schwab , Laurent Besacier

Transformer neural networks, particularly Bidirectional Encoder Representations from Transformers (BERT), have shown remarkable performance across various tasks such as classification, text summarization, and question answering. However,…

机器学习 · 计算机科学 2025-02-18 Matteo Bonino , Giorgia Ghione , Giansalvo Cirrincione

Fine-tuned Bidirectional Encoder Representations from Transformers (BERT)-based sequence classification models have proven to be effective for detecting Alzheimer's Disease (AD) from transcripts of human speech. However, previous research…

计算与语言 · 计算机科学 2020-11-13 Aparna Balagopalan , Jekaterina Novikova

Recently, end-to-end speech recognition with a hybrid model consisting of the connectionist temporal classification(CTC) and the attention encoder-decoder achieved state-of-the-art results. In this paper, we propose a novel CTC decoder…

声音 · 计算机科学 2018-11-02 Zhe Yuan , Zhuoran Lyu , Jiwei Li , Xi Zhou

Deep learning approaches have been widely used in Automatic Speech Recognition (ASR) and they have achieved a significant accuracy improvement. Especially, Convolutional Neural Networks (CNNs) have been revisited in ASR recently. However,…

计算与语言 · 计算机科学 2017-02-28 Yisen Wang , Xuejiao Deng , Songbai Pu , Zhiheng Huang

Automatic Speech Recognition (ASR) systems generalize poorly on accented speech. The phonetic and linguistic variability of accents present hard challenges for ASR systems today in both data collection and modeling strategies. The resulting…

This paper proposes an adaptation method for end-to-end speech recognition. In this method, multiple automatic speech recognition (ASR) 1-best hypotheses are integrated in the computation of the connectionist temporal classification (CTC)…

计算与语言 · 计算机科学 2021-04-01 Cong-Thanh Do , Rama Doddipatla , Thomas Hain

Connectionist Temporal Classification has recently attracted a lot of interest as it offers an elegant approach to building acoustic models (AMs) for speech recognition. The CTC loss function maps an input sequence of observable feature…

计算与语言 · 计算机科学 2017-08-16 Thomas Zenkel , Ramon Sanabria , Florian Metze , Jan Niehues , Matthias Sperber , Sebastian Stüker , Alex Waibel

Automatic Speech Recognition (ASR) in medical contexts has the potential to save time, cut costs, increase report accuracy, and reduce physician burnout. However, the healthcare industry has been slower to adopt this technology, in part due…

音频与语音处理 · 电气工程与系统科学 2024-03-14 Joel Shor , Ruyue Agnes Bi , Subhashini Venugopalan , Steven Ibara , Roman Goldenberg , Ehud Rivlin