中文
相关论文

相关论文: Multi-Level Embedding Conformer Framework for Beng…

200 篇论文

Recently, convolution-augmented transformer (Conformer) has achieved promising performance in automatic speech recognition (ASR) and time-domain speech enhancement (SE), as it can capture both local and global dependencies in the speech…

声音 · 计算机科学 2024-05-07 Ruizhe Cao , Sherif Abdulatif , Bin Yang

Multilingual speech processing with self-supervised or supervised pre-trained Speech Foundation Models (SFM) has achieved strong performance on tasks like Language Identification (LID) and Automatic Speech Recognition (ASR). However, these…

声音 · 计算机科学 2025-06-04 Qingzheng Wang , Jiancheng Sun , Yifan Peng , Shinji Watanabe

Automatic Speech Recognition (ASR) has advanced with Speech Foundation Models (SFMs), yet performance degrades on dysarthric speech due to variability and limited data. This study as part of the submission to the Speech Accessibility…

音频与语音处理 · 电气工程与系统科学 2025-05-28 Alexandre Ducorroy , Rachid Riad

Multi-speaker speech recognition of unsegmented recordings has diverse applications such as meeting transcription and automatic subtitle generation. With technical advances in systems dealing with speech separation, speaker diarization, and…

音频与语音处理 · 电气工程与系统科学 2020-11-05 Desh Raj , Pavel Denisov , Zhuo Chen , Hakan Erdogan , Zili Huang , Maokui He , Shinji Watanabe , Jun Du , Takuya Yoshioka , Yi Luo , Naoyuki Kanda , Jinyu Li , Scott Wisdom , John R. Hershey

This paper presents a printed Bengali and English text OCR system developed by us using a single hidden BLSTM-CTC architecture having 128 units. Here, we did not use any peephole connection and dropout in the BLSTM, which helped us in…

计算机视觉与模式识别 · 计算机科学 2019-08-26 Debabrata Paul , Bidyut Baran Chaudhuri

While integrating speech encoder with LLM requires substantial data and resources, use cases face limitations due to insufficient availability. To address this, we propose a solution with a parameter-efficient adapter that converts speech…

计算与语言 · 计算机科学 2025-09-08 Jaekwon Yoo , Kunal Chandiramani , Divya Tadimeti , Abenezer Girma , Chandra Dhir

We propose a first step toward multilingual end-to-end automatic speech recognition (ASR) by integrating knowledge about speech articulators. The key idea is to leverage a rich set of fundamental units that can be defined "universally"…

音频与语音处理 · 电气工程与系统科学 2023-09-19 Hao Yen , Sabato Marco Siniscalchi , Chin-Hui Lee

Low-resource accented speech recognition is one of the important challenges faced by current ASR technology in practical applications. In this study, we propose a Conformer-based architecture, called Aformer, to leverage both the acoustic…

声音 · 计算机科学 2023-06-21 Xuefei Wang , Yanhua Long , Yijie Li , Haoran Wei

Multilingual end-to-end automatic speech recognition models are attractive due to its simplicity in training and deployment. Recent work on large-scale training of such models has shown promising results compared to monolingual models.…

计算与语言 · 计算机科学 2022-10-13 Ke Hu , Bo Li , Tara N. Sainath

It is important to transcribe and archive speech data of endangered languages for preserving heritages of verbal culture and automatic speech recognition (ASR) is a powerful tool to facilitate this process. However, since endangered…

音频与语音处理 · 电气工程与系统科学 2020-08-03 Kohei Matsuura , Masato Mimura , Shinsuke Sakai , Tatsuya Kawahara

Hidden Markov model based various phoneme recognition methods for Bengali language is reviewed. Automatic phoneme recognition for Bengali language using multilayer neural network is reviewed. Usefulness of multilayer neural network over…

声音 · 计算机科学 2018-04-30 Sadia Tasnim Swarna , Shamim Ehsan , Md. Saiful Islam , Marium E Jannat

Adapting pre-trained text Large Language Models (LLMs) into Speech Language Models (Speech LMs) via continual pretraining on speech data is promising, but often degrades the original text capabilities. We propose Multimodal Depth Upscaling,…

计算与语言 · 计算机科学 2026-04-02 Kazuki Yano , Jun Suzuki , Shinji Watanabe

Recently Transformer and Convolution neural network (CNN) based models have shown promising results in Automatic Speech Recognition (ASR), outperforming Recurrent neural networks (RNNs). Transformer models are good at capturing…

音频与语音处理 · 电气工程与系统科学 2020-05-19 Anmol Gulati , James Qin , Chung-Cheng Chiu , Niki Parmar , Yu Zhang , Jiahui Yu , Wei Han , Shibo Wang , Zhengdong Zhang , Yonghui Wu , Ruoming Pang

End-to-end multilingual ASR has become more appealing because of several reasons such as simplifying the training and deployment process and positive performance transfer from high-resource to low-resource languages. However, scaling up the…

计算与语言 · 计算机科学 2022-11-11 Andros Tjandra , Nayan Singhal , David Zhang , Ozlem Kalinli , Abdelrahman Mohamed , Duc Le , Michael L. Seltzer

Automatic speech recognition (ASR) has been widely researched with supervised approaches, while many low-resourced languages lack audio-text aligned data, and supervised methods cannot be applied on them. In this work, we propose a…

计算与语言 · 计算机科学 2018-08-14 Yi-Chen Chen , Chia-Hao Shen , Sung-Feng Huang , Hung-yi Lee

We study the effect of applying a language model (LM) on the output of Automatic Speech Recognition (ASR) systems for Indic languages. We fine-tune wav2vec $2.0$ models for $18$ Indic languages and adjust the results with language models…

Code-switching (CS) automatic speech recognition (ASR) faces challenges due to the language confusion resulting from accents, auditory similarity, and seamless language switches. Adaptation on the pre-trained multi-lingual model has shown…

计算与语言 · 计算机科学 2025-01-07 Jiahui Zhao , Hao Shi , Chenrui Cui , Tianrui Wang , Hexin Liu , Zhaoheng Ni , Lingxuan Ye , Longbiao Wang

Automatic speech recognition (ASR) for low-resource languages remains a challenge due to the scarcity of labeled training data. Parameter-efficient fine-tuning and text-only adaptation are two popular methods that have been used to address…

计算与语言 · 计算机科学 2024-10-18 Abhishek Gupta , Amruta Parulekar , Sameep Chattopadhyay , Preethi Jyothi

Speech foundation models have achieved state-of-the-art (SoTA) performance across various tasks, such as automatic speech recognition (ASR) in hundreds of languages. However, multi-speaker ASR remains a challenging task for these models due…

音频与语音处理 · 电气工程与系统科学 2024-12-04 Weiqing Wang , Kunal Dhawan , Taejin Park , Krishna C. Puvvada , Ivan Medennikov , Somshubra Majumdar , He Huang , Jagadeesh Balam , Boris Ginsburg

Bootstrapping speech recognition on limited data resources has been an area of active research for long. The recent transition to all-neural models and end-to-end (E2E) training brought along particular challenges as these models are known…

音频与语音处理 · 电气工程与系统科学 2021-06-21 Manuel Giollo , Deniz Gunceler , Yulan Liu , Daniel Willett