English
Related papers

Related papers: Language ID Prediction from Speech Using Self-Atte…

200 papers

Most state-of-the-art Deep Learning (DL) approaches for speaker recognition work on a short utterance level. Given the speech signal, these algorithms extract a sequence of speaker embeddings from short segments and those are averaged to…

Sound · Computer Science 2019-07-03 Miquel India , Pooyan Safari , Javier Hernando

Language identification is the task of automatically determining the identity of a language conveyed by a spoken segment. It has a profound impact on the multilingual interoperability of an intelligent speech system. Despite language…

Computation and Language · Computer Science 2025-01-14 Yuting Nie , Junhong Zhao , Wei-Qiang Zhang , Jinfeng Bai

In this paper, we propose a novel strategy for text-independent speaker identification system: Multi-Label Training (MLT). Instead of the commonly used one-to-one correspondence between the speech and the speaker label, we divide all the…

Audio and Speech Processing · Electrical Eng. & Systems 2024-08-19 Yuqi Xue

This paper introduces and motivates the use of hybrid robust feature extraction technique for spoken language identification (LID) system. The speech recognizers use a parametric form of a signal to get the most important distinguishable…

Sound · Computer Science 2010-03-31 Pawan Kumar , Astik Biswas , A . N. Mishra , Mahesh Chandra

Speech intelligibility is crucial in language learning for effective communication. Thus, to develop computer-assisted language learning systems, automatic speech intelligibility detection (SID) is necessary. Most of the works have assessed…

Sound · Computer Science 2023-06-16 Nayan Anand , Meenakshi Sirigiraju , Chiranjeevi Yarra

Pre-trained Transformer-based speech models have shown striking performance when fine-tuned on various downstream tasks such as automatic speech recognition and spoken language identification (SLID). However, the problem of domain mismatch…

Computation and Language · Computer Science 2023-12-13 Mohammed Maqsood Shaik , Dietrich Klakow , Badr M. Abdullah

We propose supervised systems for speech activity detection (SAD) and speaker identification (SID) tasks in Fearless Steps Challenge Phase-2. The proposed systems for both the tasks share a common convolutional neural network (CNN)…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-11 Karthik Pandia D S , Cosimo Spera

Multilingual end-to-end(E2E) models have shown a great potential in the expansion of the language coverage in the realm of automatic speech recognition(ASR). In this paper, we aim to enhance the multilingual ASR performance in two ways,…

Computation and Language · Computer Science 2021-10-18 Rimita Lahiri , Kenichi Kumatani , Eric Sun , Yao Qian

Recently, language identity information has been utilized to improve the performance of end-to-end code-switching (CS) speech recognition. However, previous works use an additional language identification (LID) model as an auxiliary module,…

Computation and Language · Computer Science 2020-02-20 Shuai Zhang , Jiangyan Yi , Zhengkun Tian , Jianhua Tao , Ye Bai

Spoken language understanding (SLU) is a task aiming to extract high-level semantics from spoken utterances. Previous works have investigated the use of speech self-supervised models and textual pre-trained models, which have shown…

Computation and Language · Computer Science 2022-11-08 Jiatong Shi , Chan-Jan Hsu , Holam Chung , Dongji Gao , Paola Garcia , Shinji Watanabe , Ann Lee , Hung-yi Lee

Language identification greatly impacts the success of downstream tasks such as automatic speech recognition. Recently, self-supervised speech representations learned by wav2vec 2.0 have been shown to be very effective for a range of speech…

Computation and Language · Computer Science 2021-10-19 Andros Tjandra , Diptanu Gon Choudhury , Frank Zhang , Kritika Singh , Alexis Conneau , Alexei Baevski , Assaf Sela , Yatharth Saraf , Michael Auli

Usable speech criteria are proposed to extract minimally corrupted speech for speaker identification (SID) in co-channel speech. In co-channel speech, either speaker can randomly appear as the stronger speaker or the weaker one at a time.…

Sound · Computer Science 2013-01-03 Wajdi Ghezaiel , Amel Ben Slimane , Ezzedine Ben Braiek

Running automatic speech recognition (ASR) on edge devices is non-trivial due to resource constraints, especially in scenarios that require supporting multiple languages. We propose a new approach to enable multilingual speech recognition…

Computation and Language · Computer Science 2021-08-05 Sangeeta Ghangam , Daniel Whitenack , Joshua Nemecek

Closed-set spoken language identification is the task of recognizing the language being spoken in a recorded audio clip from a set of known languages. In this study, a language identification system was built and trained to distinguish…

Computation and Language · Computer Science 2022-05-20 Benjamin Kepecs , Homayoon Beigi

Language identification (LID) is a fundamental step in curating multilingual corpora. However, LID models still perform poorly for many languages, especially on the noisy and heterogeneous web data often used to train multilingual language…

Computation and Language · Computer Science 2026-01-27 Pedro Ortiz Suarez , Laurie Burchell , Catherine Arnett , Rafael Mosquera-Gómez , Sara Hincapie-Monsalve , Thom Vaughan , Damian Stewart , Malte Ostendorff , Idris Abdulmumin , Vukosi Marivate , Shamsuddeen Hassan Muhammad , Atnafu Lambebo Tonja , Hend Al-Khalifa , Nadia Ghezaiel Hammouda , Verrah Otiende , Tack Hwa Wong , Jakhongir Saydaliev , Melika Nobakhtian , Muhammad Ravi Shulthan Habibi , Chalamalasetti Kranti , Carol Muchemi , Khang Nguyen , Faisal Muhammad Adam , Luis Frentzen Salim , Reem Alqifari , Cynthia Amol , Joseph Marvin Imperial , Ilker Kesen , Ahmad Mustafid , Pavel Stepachev , Leshem Choshen , David Anugraha , Hamada Nayel , Seid Muhie Yimam , Vallerie Alexandra Putra , My Chiffon Nguyen , Azmine Toushik Wasi , Gouthami Vadithya , Rob van der Goot , Lanwenn ar C'horr , Karan Dua , Andrew Yates , Mithil Bangera , Yeshil Bangera , Hitesh Laxmichand Patel , Shu Okabe , Fenal Ashokbhai Ilasariya , Dmitry Gaynullin , Genta Indra Winata , Yiyuan Li , Juan Pablo Martínez , Amit Agarwal , Ikhlasul Akmal Hanif , Raia Abu Ahmad , Esther Adenuga , Filbert Aurelian Tjiaranata , Weerayut Buaphet , Michael Anugraha , Sowmya Vajjala , Benjamin Rice , Azril Hafizi Amirudin , Jesujoba O. Alabi , Srikant Panda , Yassine Toughrai , Bruhan Kyomuhendo , Daniel Ruffinelli , Akshata A , Manuel Goulão , Ej Zhou , Ingrid Gabriela Franco Ramirez , Cristina Aggazzotti , Konstantin Dobler , Jun Kevin , Quentin Pagès , Nicholas Andrews , Nuhu Ibrahim , Mattes Ruckdeschel , Amr Keleg , Mike Zhang , Casper Muziri , Saron Samuel , Sotaro Takeshita , Kun Kerdthaisong , Luca Foppiano , Rasul Dent , Tommaso Green , Ahmad Mustapha Wali , Kamohelo Makaaka , Vicky Feliren , Inshirah Idris , Hande Celikkanat , Abdulhamid Abubakar , Jean Maillard , Benoît Sagot , Thibault Clérice , Kenton Murray , Sarah Luger

Multilingual Automatic Speech Recognition (ASR) models have extended the usability of speech technologies to a wide variety of languages. With how many languages these models have to handle, however, a key to understanding their imbalanced…

Computation and Language · Computer Science 2023-02-28 William Chen , Brian Yan , Jiatong Shi , Yifan Peng , Soumi Maiti , Shinji Watanabe

In this paper, we extend previous self-supervised approaches for language identification by experimenting with Conformer based architecture in a multilingual pre-training paradigm. We find that pre-trained speech models optimally encode…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-14 Travis M. Bartley , Fei Jia , Krishna C. Puvvada , Samuel Kriman , Boris Ginsburg

Language identification from speech is a common preprocessing step in many spoken language processing systems. In recent years, this field has seen fast progress, mostly due to the use of self-supervised models pretrained on multilingual…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-04 Kunnar Kukk , Tanel Alumäe

The goal of this paper is to learn strong lip reading models that can recognise speech in silent videos. Most prior works deal with the open-set visual speech recognition problem by adapting existing automatic speech recognition techniques…

Computer Vision and Pattern Recognition · Computer Science 2021-12-06 K R Prajwal , Triantafyllos Afouras , Andrew Zisserman

Language agnostic and semantic-language information isolation is an emerging research direction for multilingual representations models. We explore this problem from a novel angle of geometric algebra and semantic space. A simple but highly…

Computation and Language · Computer Science 2021-09-13 Ziyi Yang , Yinfei Yang , Daniel Cer , Eric Darve