English
Related papers

Related papers: Multi-task Recurrent Model for True Multilingual S…

200 papers

This paper presents a novel method that allows a machine learning algorithm following the transformation-based learning paradigm \cite{brill95:tagging} to be applied to multiple classification tasks by training jointly and simultaneously on…

Computation and Language · Computer Science 2007-05-23 Radu Florian , Grace Ngai

The goal of multilingual speech technology is to facilitate seamless communication between individuals speaking different languages, creating the experience as though everyone were a multilingual speaker. To create this experience, speech…

Computation and Language · Computer Science 2026-05-19 Supriti Sinhamahapatra , Thai-Binh Nguyen , Yiğit Oğuz , Enes Ugan , Jan Niehues , Alexander Waibel

Conversational bilingual speech encompasses three types of utterances: two purely monolingual types and one intra-sententially code-switched type. In this work, we propose a general framework to jointly model the likelihoods of the…

Computation and Language · Computer Science 2021-12-01 Brian Yan , Chunlei Zhang , Meng Yu , Shi-Xiong Zhang , Siddharth Dalmia , Dan Berrebbi , Chao Weng , Shinji Watanabe , Dong Yu

In this paper, we present our studies and experiments carried out for the task 1 of the Challenge and Workshop on Multilingual Conversational Speech Language Model (MLC-SLM), which focuses on advancing multilingual conversational speech…

Sound · Computer Science 2025-07-28 Lorenzo Concina , Jordi Luque , Alessio Brutti , Marco Matassoni , Yuchen Zhang

Languages usually switch within a multilingual speech signal, especially in a bilingual society. This phenomenon is referred to as code-switching (CS), making automatic speech recognition (ASR) challenging under a multilingual scenario. We…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-02 Hexin Liu , Leibny Paola Garcia , Xiangyu Zhang , Andy W. H. Khong , Sanjeev Khudanpur

Speech-to-text translation (ST), which translates source language speech into target language text, has attracted intensive attention in recent years. Compared to the traditional pipeline system, the end-to-end ST model has potential…

Computation and Language · Computer Science 2019-12-17 Yuchen Liu , Jiajun Zhang , Hao Xiong , Long Zhou , Zhongjun He , Hua Wu , Haifeng Wang , Chengqing Zong

Building a multilingual Automated Speech Recognition (ASR) system in a linguistically diverse country like India can be a challenging task due to the differences in scripts and the limited availability of speech data. This problem can be…

Computation and Language · Computer Science 2023-06-01 Kaousheik Jayakumar , Vrunda N. Sukhadia , A Arunkumar , S. Umesh

Recent years have witnessed significant progress in multilingual automatic speech recognition (ASR), driven by the emergence of end-to-end (E2E) models and the scaling of multilingual datasets. Despite that, two main challenges persist in…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-12 Zheshu Song , Jianheng Zhuo , Yifan Yang , Ziyang Ma , Shixiong Zhang , Xie Chen

This paper presents the architecture and performance of a novel Multilingual Automatic Speech Recognition (ASR) system developed by the Transsion Speech Team for Track 1 of the MLC-SLM 2025 Challenge. The proposed system comprises three key…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-22 Xiaoxiao Li , An Zhu , Youhai Jiang , Fengjie Zhu

Recently, data-driven based Automatic Speech Recognition (ASR) systems have achieved state-of-the-art results. And transfer learning is often used when those existing systems are adapted to the target domain, e.g., fine-tuning, retraining.…

Sound · Computer Science 2019-04-18 Jiabin Xue , Jiqing Han , Tieran Zheng , Xiang Gao , Jiaxing Guo

Multi-speaker automatic speech recognition (ASR) is crucial for many real-world applications, but it requires dedicated modeling techniques. Existing approaches can be divided into modular and end-to-end methods. Modular approaches separate…

Computation and Language · Computer Science 2023-06-22 Simon Berger , Peter Vieting , Christoph Boeddeker , Ralf Schlüter , Reinhold Haeb-Umbach

The stream of words produced by Automatic Speech Recognition (ASR) systems is typically devoid of punctuations and formatting. Most natural language processing applications expect segmented and well-formatted texts as input, which is not…

Computation and Language · Computer Science 2017-07-19 Vardaan Pahuja , Anirban Laha , Shachar Mirkin , Vikas Raykar , Lili Kotlerman , Guy Lev

Multilingual automatic speech recognition (ASR) systems have garnered attention for their potential to extend language coverage globally. While self-supervised learning (SSL) models, like MMS, have demonstrated their effectiveness in…

Computation and Language · Computer Science 2024-04-30 Hongfei Xue , Qijie Shao , Kaixun Huang , Peikun Chen , Jie Liu , Lei Xie

The performance of automatic speech recognition systems degrades with increasing mismatch between the training and testing scenarios. Differences in speaker accents are a significant source of such mismatch. The traditional approach to deal…

Computation and Language · Computer Science 2018-02-09 Xuesong Yang , Kartik Audhkhasi , Andrew Rosenberg , Samuel Thomas , Bhuvana Ramabhadran , Mark Hasegawa-Johnson

We present an end-to-end multichannel speaker-attributed automatic speech recognition (MC-SA-ASR) system that combines a Conformer-based encoder with multi-frame crosschannel attention and a speaker-attributed Transformer-based decoder. To…

Computation and Language · Computer Science 2023-10-17 Can Cui , Imran Ahamad Sheikh , Mostafa Sadeghi , Emmanuel Vincent

As automatic speech recognition (ASR) systems are now being widely deployed in the wild, the increasing threat of adversarial attacks raises serious questions about the security and reliability of using such systems. On the other hand,…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-06 Nilaksh Das , Duen Horng Chau

Speaker-attributed automatic speech recognition (SA-ASR) in multi-party meeting scenarios is one of the most valuable and challenging ASR task. It was shown that single-channel frame-level diarization with serialized output training…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-03 Mohan Shi , Jie Zhang , Zhihao Du , Fan Yu , Qian Chen , Shiliang Zhang , Li-Rong Dai

The quality of automatic speech recognition (ASR) is critical to Dialogue Systems as ASR errors propagate to and directly impact downstream tasks such as language understanding (LU). In this paper, we propose multi-task neural approaches to…

Running automatic speech recognition (ASR) on edge devices is non-trivial due to resource constraints, especially in scenarios that require supporting multiple languages. We propose a new approach to enable multilingual speech recognition…

Computation and Language · Computer Science 2021-08-05 Sangeeta Ghangam , Daniel Whitenack , Joshua Nemecek

Accents, as variations from standard pronunciation, pose significant challenges for speech recognition systems. Although joint automatic speech recognition (ASR) and accent recognition (AR) training has been proven effective in handling…

Sound · Computer Science 2023-11-20 Qijie Shao , Pengcheng Guo , Jinghao Yan , Pengfei Hu , Lei Xie