中文
相关论文

相关论文: Multi-Graph Decoding for Code-Switching ASR

200 篇论文

In this work, we introduce a simple yet efficient post-processing model for automatic speech recognition (ASR). Our model has Transformer-based encoder-decoder architecture which "translates" ASR model output into grammatically and…

计算与语言 · 计算机科学 2019-10-24 Oleksii Hrinchuk , Mariya Popova , Boris Ginsburg

Code-switching refers to the usage of two languages within a sentence or discourse. It is a global phenomenon among multilingual communities and has emerged as an independent area of research. With the increasing demand for the…

计算与语言 · 计算机科学 2018-10-02 Ganji Sreeram , Kunal Dhawan , Rohit Sinha

We present an end-to-end multichannel speaker-attributed automatic speech recognition (MC-SA-ASR) system that combines a Conformer-based encoder with multi-frame crosschannel attention and a speaker-attributed Transformer-based decoder. To…

计算与语言 · 计算机科学 2023-10-17 Can Cui , Imran Ahamad Sheikh , Mostafa Sadeghi , Emmanuel Vincent

At the present time, computers are employed to solve complex tasks and problems ranging from simple calculations to intensive digital image processing and intricate algorithmic optimization problems to computationally-demanding weather…

计算与语言 · 计算机科学 2012-03-26 Youssef Bassil , Paul Semaan

Automatic speech recognition (ASR) for dysarthric speech remains challenging due to data scarcity, particularly in non-English languages. To address this, we fine-tune a voice conversion model on English dysarthric speech (UASpeech) to…

While many speakers of low-resource languages regularly code-switch between their languages and other regional languages or English, datasets of codeswitched speech are too small to train bespoke acoustic models from scratch or do language…

计算与语言 · 计算机科学 2023-11-28 Tolúlopé Ògúnrèmí , Christopher D. Manning , Dan Jurafsky

While Separate Source-Channel Coding (SSCC) retains the practical benefits of modular system design, its effectiveness in noisy text transmission is fundamentally constrained by the fragility of autoregressive source decoding. In low-SNR…

信息论 · 计算机科学 2026-05-08 Ziqiong Wang , Rongpeng Li

Automatic Speech Recognition (ASR) is greatly developed in recent years, which expedites many applications on other fields. For the ASR research, speech corpus is always an essential foundation, especially for the vertical industry, such as…

计算与语言 · 计算机科学 2021-02-17 Bo Yang , Xianlong Tan , Zhengmao Chen , Bing Wang , Dan Li , Zhongping Yang , Xiping Wu , Yi Lin

Self-supervised learning (SSL) has shown tremendous success in various speech-related downstream tasks, including Automatic Speech Recognition (ASR). The output embeddings of the SSL model are treated as powerful short-time representations…

计算与语言 · 计算机科学 2022-06-10 Arunkumar A , Umesh S

Aphasia is a language disorder affecting one third of stroke patients. Current aphasia assessment does not consider natural speech due to the time consuming nature of manual transcriptions and a lack of knowledge on how to analyze such…

神经元与认知 · 定量生物学 2024-08-27 Mara Barberis , Pieter De Clercq , Bastiaan Tamm , Hugo Van hamme , Maaike Vandermosten

It is challenging to train and deploy Transformer LMs for hybrid speech recognition 2nd pass re-ranking in low-resource languages due to (1) data scarcity in low-resource languages, (2) expensive computing costs for training and refreshing…

计算与语言 · 计算机科学 2022-09-12 Li Miao , Jian Wu , Piyush Behre , Shuangyu Chang , Sarangarajan Parthasarathy

This work dedicates to continuous sign language recognition (CSLR), which is a weakly supervised task dealing with the recognition of continuous signs from videos, without any prior knowledge about the temporal boundaries between…

计算机视觉与模式识别 · 计算机科学 2023-08-22 Fangyun Wei , Yutong Chen

There exist three approaches for multilingual and crosslingual automatic speech recognition (MCL-ASR) - supervised pretraining with phonetic or graphemic transcription, and self-supervised pretraining. We find that pretraining with phonetic…

声音 · 计算机科学 2025-03-28 Saierdaer Yusuyin , Te Ma , Hao Huang , Wenbo Zhao , Zhijian Ou

We introduce dual-decoder Transformer, a new model architecture that jointly performs automatic speech recognition (ASR) and multilingual speech translation (ST). Our models are based on the original Transformer architecture (Vaswani et…

计算与语言 · 计算机科学 2020-11-21 Hang Le , Juan Pino , Changhan Wang , Jiatao Gu , Didier Schwab , Laurent Besacier

Automatic Speech Recognition (ASR), as the assistance of speech communication between pilots and air-traffic controllers, can significantly reduce the complexity of the task and increase the reliability of transmitted information. ASR…

计算与语言 · 计算机科学 2022-02-09 Iuliia Nigmatulina , Juan Zuluaga-Gomez , Amrutha Prasad , Seyyed Saeed Sarfjoo , Petr Motlicek

Exploiting cross-lingual resources is an effective way to compensate for data scarcity of low resource languages. Recently, a novel multilingual model fusion technique has been proposed where a model is trained to learn cross-lingual…

计算与语言 · 计算机科学 2023-06-16 Muhammad Umar Farooq , Thomas Hain

State-of-the-art ASRs show suboptimal performance for child speech. The scarcity of child speech limits the development of child speech recognition (CSR). Therefore, we studied child-to-child voice conversion (VC) from existing child…

计算与语言 · 计算机科学 2025-01-09 Yuanyuan Zhang , Zhengjun Yue , Tanvina Patel , Odette Scharenborg

This paper presents the architecture and performance of a novel Multilingual Automatic Speech Recognition (ASR) system developed by the Transsion Speech Team for Track 1 of the MLC-SLM 2025 Challenge. The proposed system comprises three key…

音频与语音处理 · 电气工程与系统科学 2025-08-22 Xiaoxiao Li , An Zhu , Youhai Jiang , Fengjie Zhu

End-to-end automatic speech recognition (ASR) systems based on transformer architectures, such as Whisper, offer high transcription accuracy and robustness. However, their autoregressive decoding is computationally expensive, hence limiting…

计算与语言 · 计算机科学 2025-07-30 Tuan Vu Ho , Hiroaki Kokubo , Masaaki Yamamoto , Yohei Kawaguchi

Speech accents pose a significant challenge to state-of-the-art automatic speech recognition (ASR) systems. Degradation in performance across underrepresented accents is a severe deterrent to the inclusive adoption of ASR. In this work, we…

计算与语言 · 计算机科学 2023-10-30 Darshan Prabhu , Preethi Jyothi , Sriram Ganapathy , Vinit Unni