English
Related papers

Related papers: Cross-lingual Embedding Clustering for Hierarchica…

200 papers

While supervised quality predictors for synthesized speech have demonstrated strong correlations with human ratings, their requirement for in-domain labeled training data hinders their generalization ability to new domains. Unsupervised…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-08 Erica Cooper , Takuma Okamoto , Yamato Ohtani , Tomoki Toda , Hisashi Kawai

This paper addresses challenges in integrating new languages into a pre-trained multilingual automatic speech recognition (mASR) system, particularly in scenarios where training data for existing languages is limited or unavailable. The…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-13 Yerbolat Khassanov , Zhipeng Chen , Tianfeng Chen , Tze Yuang Chong , Wei Li , Jun Zhang , Lu Lu , Yuxuan Wang

Self-supervised learning (SSL) has advanced speech processing but suffers from quadratic complexity due to self-attention. To address this, SummaryMixing (SM) has been proposed as a linear-time alternative that summarizes entire utterances…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-11 Aditya Srinivas Menon , Kumud Tripathi , Raj Gohil , Pankaj Wasnik

Recent speech foundation models excel at multilingual automatic speech recognition (ASR) for high-resource languages, but adapting them to low-resource languages remains challenging due to data scarcity and efficiency constraints.…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-03 Yang Xiao , Eun-Jung Holden , Ting Dang

End-to-end multilingual ASR has become more appealing because of several reasons such as simplifying the training and deployment process and positive performance transfer from high-resource to low-resource languages. However, scaling up the…

Computation and Language · Computer Science 2022-11-11 Andros Tjandra , Nayan Singhal , David Zhang , Ozlem Kalinli , Abdelrahman Mohamed , Duc Le , Michael L. Seltzer

Embedding-based retrieval models have made significant strides in retrieval-augmented generation (RAG) techniques for text and multimodal large language models (LLMs) applications. However, when it comes to speech larage language models…

Audio and Speech Processing · Electrical Eng. & Systems 2025-12-11 Chunyu Sun , Bingyu Liu , Zhichao Cui , Junhan Shi , Anbin Qi , Tian-hao Zhang , Dinghao Zhou , Lewei Lu

This paper describes the systems submitted by team HCCL to the Far-Field Speaker Verification Challenge. Our previous work in the AIshell Speaker Verification Challenge 2019 shows that the powerful modeling abilities of Neural Network…

Sound · Computer Science 2021-07-06 Zhuo Li , Ce Fang , Runqiu Xiao , Zhigao Chen , Wenchao Wang , Yonghong Yan

Contextual ASR or hotword customization holds substantial practical value. Despite the impressive performance of current end-to-end (E2E) automatic speech recognition (ASR) systems, they often face challenges in accurately recognizing rare…

Audio and Speech Processing · Electrical Eng. & Systems 2024-11-12 Guanrou Yang , Ziyang Ma , Zhifu Gao , Shiliang Zhang , Xie Chen

Automatic Speech Recognition (ASR) is traditionally evaluated using Word Error Rate (WER), a metric that is insensitive to meaning. Embedding-based semantic metrics are better correlated with human perception, but decoder-based Large…

Despite the recent advancements in Automatic Speech Recognition (ASR), the recognition of accented speech still remains a dominant problem. In order to create more inclusive ASR systems, research has shown that the integration of accent…

Computation and Language · Computer Science 2023-05-30 Juan Zuluaga-Gomez , Sara Ahmed , Danielius Visockas , Cem Subakan

Code-switching speech recognition has attracted an increasing interest recently, but the need for expert linguistic knowledge has always been a big issue. End-to-end automatic speech recognition (ASR) simplifies the building of ASR systems…

Computation and Language · Computer Science 2018-11-02 Ne Luo , Dongwei Jiang , Shuaijiang Zhao , Caixia Gong , Wei Zou , Xiangang Li

Unsupervised cross-lingual speech representation learning (XLSR) has recently shown promising results in speech recognition by leveraging vast amounts of unlabeled data across multiple languages. However, standard XLSR model suffers from…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-10 Yizhou Lu , Mingkun Huang , Xinghua Qu , Pengfei Wei , Zejun Ma

Self-supervised learning (SSL) methods which learn representations of data without explicit supervision have gained popularity in speech-processing tasks, particularly for single-talker applications. However, these models often have…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-02 Zili Huang , Desh Raj , Paola García , Sanjeev Khudanpur

Understanding linguistics and morphology of resource-scarce code-mixed texts remains a key challenge in text processing. Although word embedding comes in handy to support downstream tasks for low-resource languages, there are plenty of…

Computation and Language · Computer Science 2021-06-01 Ayan Sengupta , Sourabh Kumar Bhattacharjee , Tanmoy Chakraborty , Md Shad Akhtar

Generative Information Retrieval is an emerging retrieval paradigm that exhibits remarkable performance in monolingual scenarios.However, applying these methods to multilingual retrieval still encounters two primary challenges,…

Computation and Language · Computer Science 2025-10-10 Yuxin Huang , Simeng Wu , Ran Song , Yan Xiang , Yantuan Xian , Shengxiang Gao , Zhengtao Yu

We propose a symmetric low-rank representation (SLRR) method for subspace clustering, which assumes that a data set is approximately drawn from the union of multiple subspaces. The proposed technique can reveal the membership of multiple…

Computer Vision and Pattern Recognition · Computer Science 2015-11-24 Jie Chen , Haixian Zhang , Hua Mao , Yongsheng Sang , Zhang Yi

The goal of multilingual speech technology is to facilitate seamless communication between individuals speaking different languages, creating the experience as though everyone were a multilingual speaker. To create this experience, speech…

Computation and Language · Computer Science 2026-05-19 Supriti Sinhamahapatra , Thai-Binh Nguyen , Yiğit Oğuz , Enes Ugan , Jan Niehues , Alexander Waibel

We propose a bottom-up framework for automatic speech recognition (ASR) in syllable-based languages by unifying language-universal articulatory attribute modeling with syllable-level prediction. The system first recognizes sequences or…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-11 Hao Yen , Pin-Jui Ku , Sabato Marco Siniscalchi , Chin-Hui Lee

High-performance hybrid automatic speech recognition (ASR) systems are often trained with clustered triphone outputs, and thus require a complex training pipeline to generate the clustering. The same complex pipeline is often utilized in…

Sound · Computer Science 2021-10-13 Tina Raissi , Eugen Beck , Ralf Schlüter , Hermann Ney

Code-switching (CS) refers to the phenomenon that languages switch within a speech signal and leads to language confusion for automatic speech recognition (ASR). This paper aims to address language confusion for improving CS-ASR from two…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-27 Hexin Liu , Haihua Xu , Leibny Paola Garcia , Andy W. H. Khong , Yi He , Sanjeev Khudanpur