中文
相关论文

相关论文: A comparative analysis between Conformer-Transduce…

200 篇论文

Automatic Speech Recognition (ASR) systems are often optimized to work best for speakers with canonical speech patterns. Unfortunately, these systems perform poorly when tested on atypical speech and heavily accented speech. It has…

计算与语言 · 计算机科学 2021-09-16 Katrin Tomanek , Vicky Zayats , Dirk Padfield , Kara Vaillancourt , Fadi Biadsy

The Conformer has become the most popular encoder model for automatic speech recognition (ASR). It adds convolution modules to a transformer to learn both local and global dependencies. In this work we describe a faster, more…

音频与语音处理 · 电气工程与系统科学 2024-04-11 Zengwei Yao , Liyong Guo , Xiaoyu Yang , Wei Kang , Fangjun Kuang , Yifan Yang , Zengrui Jin , Long Lin , Daniel Povey

Pre-trained speech encoders have been central to pushing state-of-the-art results across various speech understanding and generation tasks. Nonetheless, the capabilities of these encoders in low-resource settings are yet to be thoroughly…

计算与语言 · 计算机科学 2023-05-30 Hao Yang , Jinming Zhao , Gholamreza Haffari , Ehsan Shareghi

Speech enhancement (SE) systems are typically evaluated using a variety of instrumental metrics. The use of automatic speech recognition (ASR) systems to evaluate SE performance is common in literature, usually in terms of word error rate…

音频与语音处理 · 电气工程与系统科学 2026-05-13 Danilo de Oliveira , Tal Peer , Timo Gerkmann

Self-supervision has shown great potential for audio-visual speech recognition by vastly reducing the amount of labeled data required to build good systems. However, existing methods are either not entirely end-to-end or do not train joint…

音频与语音处理 · 电气工程与系统科学 2024-01-23 Jiachen Lian , Alexei Baevski , Wei-Ning Hsu , Michael Auli

Attention-based contextual biasing approaches have shown significant improvements in the recognition of generic and/or personal rare-words in End-to-End Automatic Speech Recognition (E2E ASR) systems like neural transducers. These…

We present a method for transferring pre-trained self-supervised (SSL) speech representations to multiple languages. There is an abundance of unannotated speech, so creating self-supervised representations from raw audio and fine-tuning on…

音频与语音处理 · 电气工程与系统科学 2022-02-08 Samuel Kessler , Bethan Thomas , Salah Karout

Automatic speech recognition (ASR) has reached a level of accuracy in recent years, that even outperforms humans in transcribing speech to text. Nevertheless, all current ASR approaches show a certain weakness against ambient noise. To…

声音 · 计算机科学 2023-12-22 Christopher Simic , Tobias Bocklet

Prompting and adapter tuning have emerged as efficient alternatives to fine-tuning (FT) methods. However, existing studies on speech prompting focused on classification tasks and failed on more complex sequence generation tasks. Besides,…

音频与语音处理 · 电气工程与系统科学 2023-11-16 Kai-Wei Chang , Ming-Hsin Chen , Yun-Ping Lin , Jing Neng Hsu , Paul Kuo-Ming Huang , Chien-yu Huang , Shang-Wen Li , Hung-yi Lee

In recent years, advancements in the field of speech processing have led to cutting-edge deep learning algorithms with immense potential for real-world applications. The automated identification of stuttered speech is one of such…

声音 · 计算机科学 2023-11-10 Huma Ameer , Seemab Latif , Rabia Latif , Sana Mukhtar

This paper presents Conformer-1, an end-to-end Automatic Speech Recognition (ASR) model trained on an extensive dataset of 570k hours of speech audio data, 91% of which was acquired from publicly available sources. To achieve this, we…

OpenAI Whisper is a family of robust Automatic Speech Recognition (ASR) models trained on 680,000 hours of audio. However, its encoder-decoder architecture, trained with a sequence-to-sequence objective, lacks native support for streaming…

This study presents a model of automatic speech recognition (ASR) designed to diagnose pronunciation issues in children with speech sound disorders (SSDs) to replace manual transcriptions in clinical procedures. Since ASR models trained for…

With increasingly more powerful compute capabilities and resources in today's devices, traditionally compute-intensive automatic speech recognition (ASR) has been moving from the cloud to devices to better protect user privacy. However, it…

With the rise of SSL and ASR technologies, the Wav2Vec2 ASR-based model has been fine-tuned for automated speech disorder quality assessment tasks, yielding impressive results and setting a new baseline for Head and Neck Cancer speech…

音频与语音处理 · 电气工程与系统科学 2024-10-14 Tuan Nguyen , Corinne Fredouille , Alain Ghio , Mathieu Balaguer , Virginie Woisard

Self-supervised speech pre-training methods have developed rapidly in recent years, which show to be very effective for many near-field single-channel speech tasks. However, far-field multichannel speech processing is suffering from the…

音频与语音处理 · 电气工程与系统科学 2024-01-09 Qiushi Zhu , Jie Zhang , Yu Gu , Yuchen Hu , Lirong Dai

Speaker adaptation techniques provide a powerful solution to customise automatic speech recognition (ASR) systems for individual users. Practical application of unsupervised model-based speaker adaptation techniques to data intensive…

音频与语音处理 · 电气工程与系统科学 2023-02-16 Jiajun Deng , Xurong Xie , Tianzi Wang , Mingyu Cui , Boyang Xue , Zengrui Jin , Guinan Li , Shujie Hu , Xunying Liu

This paper investigates four types of cross-utterance speech contexts modeling approaches for streaming and non-streaming Conformer-Transformer (C-T) ASR systems: i) input audio feature concatenation; ii) cross-utterance Encoder embedding…

音频与语音处理 · 电气工程与系统科学 2025-08-15 Mingyu Cui , Mengzhe Geng , Jiajun Deng , Chengxi Deng , Jiawen Kang , Shujie Hu , Guinan Li , Tianzi Wang , Zhaoqing Li , Xie Chen , Xunying Liu

A crucial part of an accurate and reliable spoken language assessment system is the underlying ASR model. Recently, large-scale pre-trained ASR foundation models such as Whisper have been made available. As the output of these models is…

计算与语言 · 计算机科学 2023-10-11 Rao Ma , Mengjie Qian , Mark J. F. Gales , Kate M. Knill

Reliability on cloud providers for ASR inference to support child-centered voice-based applications is becoming challenging due to regulatory and privacy challenges. Motivated by a privacy-preserving design, this study aims to develop a…

音频与语音处理 · 电气工程与系统科学 2025-07-22 Satwik Dutta , Shruthigna Chandupatla , John Hansen