中文
相关论文

相关论文: Code-Switching in End-to-End Automatic Speech Reco…

200 篇论文

This paper presents our latest effort on improving Code-switching language models that suffer from data scarcity. We investigate methods to augment Code-switching training text data by artificially generating them. Concretely, we propose a…

计算与语言 · 计算机科学 2021-12-14 Chia-Yu Li , Ngoc Thang Vu

Code-switching (CS) refers to the switching of languages within a speech signal and results in language confusion for automatic speech recognition (ASR). To address language confusion, we propose a language alignment loss (LAL) that aligns…

音频与语音处理 · 电气工程与系统科学 2025-11-04 Hexin Liu , Xiangyu Zhang , Haoyang Zhang , Leibny Paola Garcia , Andy W. H. Khong , Eng Siong Chng , Shinji Watanabe

Code-switching speech refers to a means of expression by mixing two or more languages within a single utterance. Automatic Speech Recognition (ASR) with End-to-End (E2E) modeling for such speech can be a challenging task due to the lack of…

音频与语音处理 · 电气工程与系统科学 2023-03-21 Haibin Yu , Yuxuan Hu , Yao Qian , Ma Jin , Linquan Liu , Shujie Liu , Yu Shi , Yanmin Qian , Edward Lin , Michael Zeng

Recognizing code-switched speech is challenging for Automatic Speech Recognition (ASR) for a variety of reasons, including the lack of code-switched training data. Recently, we showed that monolingual ASR systems fine-tuned on code-switched…

音频与语音处理 · 电气工程与系统科学 2020-06-11 Gurunath Reddy Madhumani , Sanket Shah , Basil Abraham , Vikas Joshi , Sunayana Sitaram

Code-switching (CS) occurs when a speaker alternates words of two or more languages within a single sentence or across sentences. Automatic speech recognition (ASR) of CS speech has to deal with two or more languages at the same time. In…

音频与语音处理 · 电气工程与系统科学 2020-06-19 Xinyuan Zhou , Emre Yılmaz , Yanhua Long , Yijie Li , Haizhou Li

Code-switching automatic speech recognition (ASR) aims to transcribe speech that contains two or more languages accurately. To better capture language-specific speech representations and address language confusion in code-switching ASR, the…

声音 · 计算机科学 2025-01-10 He Wang , Xucheng Wan , Naijun Zheng , Kai Liu , Huan Zhou , Guojian Li , Lei Xie

In the last decade of automatic speech recognition (ASR) research, the introduction of deep learning brought considerable reductions in word error rate of more than 50% relative, compared to modeling without deep learning. In the wake of…

音频与语音处理 · 电气工程与系统科学 2023-03-07 Rohit Prabhavalkar , Takaaki Hori , Tara N. Sainath , Ralf Schlüter , Shinji Watanabe

End-to-end neural network systems for automatic speech recognition (ASR) are trained from acoustic features to text transcriptions. In contrast to modular ASR systems, which contain separately-trained components for acoustic modeling,…

计算与语言 · 计算机科学 2020-04-21 Yonatan Belinkov , Ahmed Ali , James Glass

Speech accents pose a significant challenge to state-of-the-art automatic speech recognition (ASR) systems. Degradation in performance across underrepresented accents is a severe deterrent to the inclusive adoption of ASR. In this work, we…

计算与语言 · 计算机科学 2023-10-30 Darshan Prabhu , Preethi Jyothi , Sriram Ganapathy , Vinit Unni

A key desiderata for inclusive and accessible speech recognition technology is ensuring its robust performance to children's speech. Notably, this includes the rapidly advancing neural network based end-to-end speech recognition systems.…

音频与语音处理 · 电气工程与系统科学 2021-02-22 Prashanth Gurunath Shivakumar , Shrikanth Narayanan

Code-switching (CS) automatic speech recognition (ASR) faces challenges due to the language confusion resulting from accents, auditory similarity, and seamless language switches. Adaptation on the pre-trained multi-lingual model has shown…

计算与语言 · 计算机科学 2025-01-07 Jiahui Zhao , Hao Shi , Chenrui Cui , Tianrui Wang , Hexin Liu , Zhaoheng Ni , Lingxuan Ye , Longbiao Wang

Automatic Speech Recognition (ASR) has undergone a profound transformation over the past decade, driven by advances in deep learning. This survey provides a comprehensive overview of the modern era of ASR, charting its evolution from…

音频与语音处理 · 电气工程与系统科学 2025-10-16 Md. Nayeem , Md Shamse Tabrej , Kabbojit Jit Deb , Shaonti Goswami , Md. Azizul Hakim

Code-switching (CS) detection refers to the automatic detection of language switches in code-mixed utterances. This task can be achieved by using a CS automatic speech recognition (ASR) system that can handle such language switches. In our…

计算与语言 · 计算机科学 2019-06-20 Qinyi Wang , Emre Yılmaz , Adem Derinel , Haizhou Li

Automated Speech Recognition (ASR) is an interdisciplinary application of computer science and linguistics that enable us to derive the transcription from the uttered speech waveform. It finds several applications in Military like…

计算与语言 · 计算机科学 2022-04-05 Priyank Dubey , Bilal Shah

Transformers have evolved with great success in various artificial intelligence tasks. Thanks to our recent prevalence of self-attention mechanisms, which capture long-term dependency, phenomenal outcomes in speech processing and…

计算与语言 · 计算机科学 2024-08-28 Shruti Singh , Muskaan Singh , Virender Kadyan

Code-switching (CS), the alternation between two or more languages within a single conversation, presents significant challenges for automatic speech recognition (ASR) systems. Existing Mandarin-English code-switching datasets often suffer…

计算与语言 · 计算机科学 2025-03-13 Jiaming Zhou , Yujie Guo , Shiwan Zhao , Haoqin Sun , Hui Wang , Jiabei He , Aobo Kong , Shiyao Wang , Xi Yang , Yequan Wang , Yonghua Lin , Yong Qin

Conventional keyword search systems operate on automatic speech recognition (ASR) outputs, which causes them to have a complex indexing and search pipeline. This has led to interest in ASR-free approaches to simplify the search procedure.…

音频与语音处理 · 电气工程与系统科学 2023-08-17 Bolaji Yusuf , Jan Cernocky , Murat Saraclar

Code-switching automatic speech recognition becomes one of the most challenging and the most valuable scenarios of automatic speech recognition, due to the code-switching phenomenon between multilingual language and the frequent occurrence…

India is home to multiple languages, and training automatic speech recognition (ASR) systems for languages is challenging. Over time, each language has adopted words from other languages, such as English, leading to code-mixing. Most Indian…

音频与语音处理 · 电气工程与系统科学 2021-06-04 Mari Ganesh Kumar , Jom Kuriakose , Anand Thyagachandran , Arun Kumar A , Ashish Seth , Lodagala Durga Prasad , Saish Jaiswal , Anusha Prakash , Hema Murthy

Speech-to-text translation (ST), which translates source language speech into target language text, has attracted intensive attention in recent years. Compared to the traditional pipeline system, the end-to-end ST model has potential…

计算与语言 · 计算机科学 2019-12-17 Yuchen Liu , Jiajun Zhang , Hao Xiong , Long Zhou , Zhongjun He , Hua Wu , Haifeng Wang , Chengqing Zong