English
Related papers

Related papers: Multi-task Recurrent Model for True Multilingual S…

200 papers

Despite recent advancements in speech processing, zero-resource speech translation (ST) and automatic speech recognition (ASR) remain challenging problems. In this work, we propose to leverage a multilingual Large Language Model (LLM) to…

In this paper, we analyzed how audio-visual speech enhancement can help to perform the ASR task in a cocktail party scenario. Therefore we considered two simple end-to-end LSTM-based models that perform single-channel audio-visual speech…

Audio and Speech Processing · Electrical Eng. & Systems 2019-11-28 Luca Pasa , Giovanni Morrone , Leonardo Badino

Confidence scores are very useful for downstream applications of automatic speech recognition (ASR) systems. Recent works have proposed using neural networks to learn word or utterance confidence scores for end-to-end ASR. In those studies,…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-28 David Qiu , Yanzhang He , Qiujia Li , Yu Zhang , Liangliang Cao , Ian McGraw

Large Language Models (LLMs) have showcased exceptional performance across diverse NLP tasks, and their integration with speech encoder is rapidly emerging as a dominant trend in the Automatic Speech Recognition (ASR) field. Previous works…

Artificial Intelligence · Computer Science 2024-12-05 Zheshu Song , Ziyang Ma , Yifan Yang , Jianheng Zhuo , Xie Chen

The emergence of large-scale automatic speech recognition (ASR) models such as Whisper has greatly expanded their adoption across diverse real-world applications. Ensuring robustness against even minor input perturbations is therefore…

Audio and Speech Processing · Electrical Eng. & Systems 2026-01-15 Xiaoxue Gao , Zexin Li , Yiming Chen , Nancy F. Chen

Speaker recognition is a well known and studied task in the speech processing domain. It has many applications, either for security or speaker adaptation of personal devices. In this paper, we present a new paradigm for automatic speaker…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-10 Mathieu Seurin , Florian Strub , Philippe Preux , Olivier Pietquin

We propose a novel end-to-end multi-talker automatic speech recognition (ASR) framework that enables both multi-speaker (MS) ASR and target-speaker (TS) ASR. Our proposed model is trained in a fully end-to-end manner, incorporating speaker…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-20 Jinhan Wang , Weiqing Wang , Kunal Dhawan , Taejin Park , Myungjong Kim , Ivan Medennikov , He Huang , Nithin Koluguri , Jagadeesh Balam , Boris Ginsburg

Multilingual pre-trained models could leverage the training data from a rich source language (such as English) to improve performance on low resource languages. However, the transfer quality for multilingual Machine Reading Comprehension…

Computation and Language · Computer Science 2020-05-11 Fei Yuan , Linjun Shou , Xuanyu Bai , Ming Gong , Yaobo Liang , Nan Duan , Yan Fu , Daxin Jiang

In this paper, we proposed to apply meta learning approach for low-resource automatic speech recognition (ASR). We formulated ASR for different languages as different tasks, and meta-learned the initialization parameters from many…

Sound · Computer Science 2019-10-29 Jui-Yang Hsu , Yuan-Jui Chen , Hung-yi Lee

There have been emerging research interest and advances in speech-to-speech translation (S2ST), translating utterances from one language to another. This work proposes Multitask Speech Language Model (MSLM), which is a decoder-only speech…

Computation and Language · Computer Science 2024-03-20 Yifan Peng , Ilia Kulikov , Yilin Yang , Sravya Popuri , Hui Lu , Changhan Wang , Hongyu Gong

Multilingual automatic speech recognition (ASR) in the medical domain serves as a foundational task for various downstream applications such as speech translation, spoken language understanding, and voice-activated assistants. This…

Computation and Language · Computer Science 2025-05-16 Khai Le-Duc , Phuc Phan , Tan-Hanh Pham , Bach Phan Tat , Minh-Huong Ngo , Chris Ngo , Thanh Nguyen-Tang , Truong-Son Hy

This paper describes our Triple X speech recognition system submitted to Task 1 of the Multi-Lingual Conversational Speech Language Modeling (MLC-SLM) Challenge. Our work focuses on optimizing speech recognition accuracy in multilingual…

Computation and Language · Computer Science 2026-03-16 Miaomiao Gao , Xiaoxiao Xiang , Yiwen Guo

This paper presents our modeling and architecture approaches for building a highly accurate low-latency language identification system to support multilingual spoken queries for voice assistants. A common approach to solve multilingual…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-02 Chander Chandak , Zeynab Raeesy , Ariya Rastrow , Yuzong Liu , Xiangyang Huang , Siyu Wang , Dong Kwon Joo , Roland Maas

This paper presents Seewo's systems for both tracks of the Multilingual Conversational Speech Language Model Challenge (MLC-SLM), addressing automatic speech recognition (ASR) and speaker diarization with ASR (SD-ASR). We introduce a…

Computation and Language · Computer Science 2025-06-19 Bo Li , Chengben Xu , Wufeng Zhang

This paper describes SHNU multilingual conversational speech recognition system (SHNU-mASR, team name-"maybe"), submitted to Track 1 of the INTERSPEECH 2025 MLC-SLM Challenge. Our system integrates a parallel-speech-encoder architecture…

Computation and Language · Computer Science 2025-07-09 Yuxiang Mei , Yuang Zheng , Dongxing Xu , Yanhua Long

Recent advancement in deep learning encouraged developing large automatic speech recognition (ASR) models that achieve promising results while ignoring computational and memory constraints. However, deploying such models on low resource…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Abdul Hannan , Alessio Brutti , Shah Nawaz , Mubashir Noman

This paper presents the TEA-ASLP's system submitted to the MLC-SLM 2025 Challenge, addressing multilingual conversational automatic speech recognition (ASR) in Task I and speech diarization ASR in Task II. For Task I, we enhance Ideal-LLM…

Sound · Computer Science 2025-07-25 Hongfei Xue , Kaixun Huang , Zhikai Zhou , Shen Huang , Shidong Shang

Attention-based encoder-decoder architectures such as Listen, Attend, and Spell (LAS), subsume the acoustic, pronunciation and language model components of a traditional automatic speech recognition (ASR) system into a single neural…

To better model the contextual information and increase the generalization ability of Speech Activity Detection (SAD) system, this paper leverages a multi-lingual Automatic Speech Recognition (ASR) system to perform SAD. Sequence…

Sound · Computer Science 2021-04-13 Seyyed Saeed Sarfjoo , Srikanth Madikeri , Petr Motlicek

We propose a multitask training method for attention-based end-to-end speech recognition models. We regularize the decoder in a listen, attend, and spell model by multitask training it on both audio-text and text-only data. Trained on the…

Computation and Language · Computer Science 2021-06-15 Peidong Wang , Tara N. Sainath , Ron J. Weiss