中文
相关论文

相关论文: The ASRU 2019 Mandarin-English Code-Switching Spee…

200 篇论文

Training multilingual automatic speech recognition (ASR) systems is challenging because acoustic and lexical information is typically language specific. Training multilingual system for Indic languages is even more tougher due to lack of…

计算与语言 · 计算机科学 2022-06-14 Harveen Singh Chadha , Priyanshi Shah , Ankur Dhuriya , Neeraj Chhimwal , Anirudh Gupta , Vivek Raghavan

Building Automatic Speech Recognition (ASR) systems for code-switched speech has recently gained renewed attention due to the widespread use of speech technologies in multilingual communities worldwide. End-to-end ASR systems are a natural…

计算与语言 · 计算机科学 2020-10-13 Yash Sharma , Basil Abraham , Karan Taneja , Preethi Jyothi

Code-switching-where multilingual speakers alternately switch between languages during conversations-still poses significant challenges to end-to-end (E2E) automatic speech recognition (ASR) systems due to phenomena of both acoustic and…

音频与语音处理 · 电气工程与系统科学 2024-12-13 Tzu-Ting Yang , Hsin-Wei Wang , Yi-Cheng Wang , Berlin Chen

Despite the significant progress in end-to-end (E2E) automatic speech recognition (ASR), E2E ASR for low resourced code-switching (CS) speech has not been well studied. In this work, we describe an E2E ASR pipeline for the recognition of CS…

计算与语言 · 计算机科学 2019-10-01 Xianghu Yue , Grandee Lee , Emre Yılmaz , Fang Deng , Haizhou Li

The choice of modeling units is critical to automatic speech recognition (ASR) tasks. Conventional ASR systems typically choose context-dependent states (CD-states) or context-dependent phonemes (CD-phonemes) as their modeling units.…

音频与语音处理 · 电气工程与系统科学 2018-05-22 Shiyu Zhou , Linhao Dong , Shuang Xu , Bo Xu

The prevalence of the powerful multilingual models, such as Whisper, has significantly advanced the researches on speech recognition. However, these models often struggle with handling the code-switching setting, which is essential in…

音频与语音处理 · 电气工程与系统科学 2024-01-15 Bobbi Aditya , Mahdin Rohmatillah , Liang-Hsuan Tai , Jen-Tzung Chien

We introduce romanization encoding for script-heavy languages to optimize multilingual and code-switching Automatic Speech Recognition (ASR) systems. By adopting romanization encoding alongside a balanced concatenated tokenizer within a…

计算与语言 · 计算机科学 2024-12-18 Wen Ding , Fei Jia , Hainan Xu , Yu Xi , Junjie Lai , Boris Ginsburg

Automatic speech recognition (ASR) systems have advanced significantly with models like Whisper, Conformer, and self-supervised frameworks such as Wav2vec 2.0 and HuBERT. However, developing robust ASR models for young children's speech…

Recently, there has been significant progress made in Automatic Speech Recognition (ASR) of code-switched speech, leading to gains in accuracy on code-switched datasets in many language pairs. Code-switched speech co-occurs with monolingual…

音频与语音处理 · 电气工程与系统科学 2020-06-02 Sanket Shah , Basil Abraham , Gurunath Reddy M , Sunayana Sitaram , Vikas Joshi

Call Centers have huge amount of audio data which can be used for achieving valuable business insights and transcription of phone calls is manually tedious task. An effective Automated Speech Recognition system can accurately transcribe…

计算与语言 · 计算机科学 2023-07-25 Muhammad Danyal Khan , Raheem Ali , Arshad Aziz

Code-switching is a speech phenomenon occurring when a speaker switches language during a conversation. Despite the spontaneous nature of code-switching in conversational spoken language, most existing works collect code-switching data from…

The advancement of multimodal large language models has accelerated the development of speech-to-speech interaction systems. While natural monolingual interaction has been achieved, we find existing models exhibit deficiencies in language…

计算与语言 · 计算机科学 2025-10-10 Heyang Liu , Yuhao Wang , Ziyang Cheng , Ronghua Wu , Qunshan Gu , Yanfeng Wang , Yu Wang

Code-switching is a pervasive linguistic phenomenon in global communication, yet modern information retrieval systems remain predominantly designed for, and evaluated within, monolingual contexts. To bridge this critical disconnect, we…

信息检索 · 计算机科学 2026-04-21 Qingcheng Zeng , Yuheng Lu , Zeqi Zhou , Heli Qi , Puxuan Yu , Fuheng Zhao , Hitomi Yanaka , Weihao Xuan , Naoto Yokoya

Code-switching in automatic speech recognition (ASR) is an important challenge due to globalization. Recent research in multilingual ASR shows potential improvement over monolingual systems. We study key issues related to multilingual…

计算与语言 · 计算机科学 2021-07-06 Ahmed Ali , Shammur Chowdhury , Amir Hussein , Yasser Hifny

Developing code-switched ASR systems is challenging due to language ambiguity and limited exposure to multilingual, code-switched data, while collecting such speech is costly. Prior work generates synthetic audio from text, but these…

计算与语言 · 计算机科学 2025-06-18 Tuan Nguyen , Huy-Dat Tran

We focus on the problem of language modeling for code-switched language, in the context of automatic speech recognition (ASR). Language modeling for code-switched language is challenging for (at least) three reasons: (1) lack of available…

计算与语言 · 计算机科学 2019-11-12 Hila Gonen , Yoav Goldberg

In this paper, we present our initial efforts for building a code-switching (CS) speech recognition system leveraging existing acoustic models (AMs) and language models (LMs), i.e., no training required, and specifically targeting…

音频与语音处理 · 电气工程与系统科学 2021-09-03 Zhen Huang , Xiaodan Zhuang , Daben Liu , Xiaoqiang Xiao , Yuchen Zhang , Sabato Marco Siniscalchi

The CHiME-7 and 8 distant speech recognition (DASR) challenges focus on multi-channel, generalizable, joint automatic speech recognition (ASR) and diarization of conversational speech. With participation from 9 teams submitting 32 diverse…

Conventional keyword search systems operate on automatic speech recognition (ASR) outputs, which causes them to have a complex indexing and search pipeline. This has led to interest in ASR-free approaches to simplify the search procedure.…

音频与语音处理 · 电气工程与系统科学 2023-08-17 Bolaji Yusuf , Jan Cernocky , Murat Saraclar

Recently, end-to-end (E2E) automatic speech recognition (ASR) systems have garnered tremendous attention because of their great success and unified modeling paradigms in comparison to conventional hybrid DNN-HMM ASR systems. Despite the…

音频与语音处理 · 电气工程与系统科学 2020-05-19 Tien-Hong Lo , Shi-Yan Weng , Hsiu-Jui Chang , Berlin Chen