English
Related papers

Related papers: Improving Language Identification for Multilingual…

200 papers

Extensive works have tackled Language Identification (LID) in the speech domain, however their application to the singing voice trails and performances on Singing Language Identification (SLID) can be improved leveraging recent progresses…

Sound · Computer Science 2021-06-01 Lenny Renault , Andrea Vaglio , Romain Hennequin

In this research, we advanced a spoken language recognition system, moving beyond traditional feature vector-based models. Our improvements focused on effectively capturing language characteristics over extended periods using a specialized…

Sound · Computer Science 2025-01-22 Or Haim Anidjar , Roi Yozevitch

Language identification (LID) is a fundamental step in many natural language processing pipelines. However, current LID systems are far from perfect, particularly on lower-resource languages. We present a LID model which achieves a…

Computation and Language · Computer Science 2023-08-31 Laurie Burchell , Alexandra Birch , Nikolay Bogoychev , Kenneth Heafield

Language identification is the task of automatically determining the identity of a language conveyed by a spoken segment. It has a profound impact on the multilingual interoperability of an intelligent speech system. Despite language…

Computation and Language · Computer Science 2025-01-14 Yuting Nie , Junhong Zhao , Wei-Qiang Zhang , Jinfeng Bai

Language identification (LID) is a fundamental step in curating multilingual corpora. However, LID models still perform poorly for many languages, especially on the noisy and heterogeneous web data often used to train multilingual language…

Computation and Language · Computer Science 2026-01-27 Pedro Ortiz Suarez , Laurie Burchell , Catherine Arnett , Rafael Mosquera-Gómez , Sara Hincapie-Monsalve , Thom Vaughan , Damian Stewart , Malte Ostendorff , Idris Abdulmumin , Vukosi Marivate , Shamsuddeen Hassan Muhammad , Atnafu Lambebo Tonja , Hend Al-Khalifa , Nadia Ghezaiel Hammouda , Verrah Otiende , Tack Hwa Wong , Jakhongir Saydaliev , Melika Nobakhtian , Muhammad Ravi Shulthan Habibi , Chalamalasetti Kranti , Carol Muchemi , Khang Nguyen , Faisal Muhammad Adam , Luis Frentzen Salim , Reem Alqifari , Cynthia Amol , Joseph Marvin Imperial , Ilker Kesen , Ahmad Mustafid , Pavel Stepachev , Leshem Choshen , David Anugraha , Hamada Nayel , Seid Muhie Yimam , Vallerie Alexandra Putra , My Chiffon Nguyen , Azmine Toushik Wasi , Gouthami Vadithya , Rob van der Goot , Lanwenn ar C'horr , Karan Dua , Andrew Yates , Mithil Bangera , Yeshil Bangera , Hitesh Laxmichand Patel , Shu Okabe , Fenal Ashokbhai Ilasariya , Dmitry Gaynullin , Genta Indra Winata , Yiyuan Li , Juan Pablo Martínez , Amit Agarwal , Ikhlasul Akmal Hanif , Raia Abu Ahmad , Esther Adenuga , Filbert Aurelian Tjiaranata , Weerayut Buaphet , Michael Anugraha , Sowmya Vajjala , Benjamin Rice , Azril Hafizi Amirudin , Jesujoba O. Alabi , Srikant Panda , Yassine Toughrai , Bruhan Kyomuhendo , Daniel Ruffinelli , Akshata A , Manuel Goulão , Ej Zhou , Ingrid Gabriela Franco Ramirez , Cristina Aggazzotti , Konstantin Dobler , Jun Kevin , Quentin Pagès , Nicholas Andrews , Nuhu Ibrahim , Mattes Ruckdeschel , Amr Keleg , Mike Zhang , Casper Muziri , Saron Samuel , Sotaro Takeshita , Kun Kerdthaisong , Luca Foppiano , Rasul Dent , Tommaso Green , Ahmad Mustapha Wali , Kamohelo Makaaka , Vicky Feliren , Inshirah Idris , Hande Celikkanat , Abdulhamid Abubakar , Jean Maillard , Benoît Sagot , Thibault Clérice , Kenton Murray , Sarah Luger

One of the methods for language Identification (LID) involves deriving speech representation from pre-trained models using self-supervised learning, followed by fine-tuning the model for the LID task. State-of-the-art approaches for LID use…

Audio and Speech Processing · Electrical Eng. & Systems 2025-02-11 Jitendra Kumar dhiman , Jainag Ambati

Of the over 7,000 languages spoken in the world, commercial language identification (LID) systems only reliably identify a few hundred in written form. Research-grade systems extend this coverage under certain circumstances, but for most…

Computation and Language · Computer Science 2026-02-10 Rasul Dent , Pedro Ortiz Suarez , Thibault Clérice , Benoît Sagot

This paper introduces and motivates the use of hybrid robust feature extraction technique for spoken language identification (LID) system. The speech recognizers use a parametric form of a signal to get the most important distinguishable…

Sound · Computer Science 2010-03-31 Pawan Kumar , Astik Biswas , A . N. Mishra , Mahesh Chandra

We propose gated language experts and curriculum training to enhance multilingual transformer transducer models without requiring language identification (LID) input from users during inference. Our method incorporates a gating mechanism…

Computation and Language · Computer Science 2023-07-11 Eric Sun , Jinyu Li , Yuxuan Hu , Yimeng Zhu , Long Zhou , Jian Xue , Peidong Wang , Linquan Liu , Shujie Liu , Edward Lin , Yifan Gong

Language development experts need tools that can automatically identify languages from fluent, conversational speech, and provide reliable estimates of usage rates at the level of an individual recording. However, language identification…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-31 Suzy J. Styles , Victoria Y. H. Chua , Fei Ting Woon , Hexin Liu , Leibny Paola Garcia Perera , Sanjeev Khudanpur , Andy W. H. Khong , Justin Dauwels

An important and difficult task in code-switched speech recognition is to recognize the language, as lots of words in two languages can sound similar, especially in some accents. We focus on improving performance of end-to-end Automatic…

Computation and Language · Computer Science 2024-03-14 Yash Sharma , Basil Abraham , Preethi Jyothi

Several recent papers have published good solutions for language identification (LID) for about 300 high-resource and medium-resource languages. However, there is no LID available that (i) covers a wide range of low-resource languages, (ii)…

Computation and Language · Computer Science 2024-07-04 Amir Hossein Kargaran , Ayyoob Imani , François Yvon , Hinrich Schütze

Large text corpora are increasingly important for a wide variety of Natural Language Processing (NLP) tasks, and automatic language identification (LangID) is a core technology needed to collect such datasets in a multilingual context.…

Computation and Language · Computer Science 2020-10-30 Isaac Caswell , Theresa Breiner , Daan van Esch , Ankur Bapna

Multilingual Automatic Speech Recognition (ASR) models have extended the usability of speech technologies to a wide variety of languages. With how many languages these models have to handle, however, a key to understanding their imbalanced…

Computation and Language · Computer Science 2023-02-28 William Chen , Brian Yan , Jiatong Shi , Yifan Peng , Soumi Maiti , Shinji Watanabe

Due to a drastic improvement in the quality of internet services worldwide, there is an explosion of multilingual content generation and consumption. This is especially prevalent in countries with large multilingual audience, who are…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-14 Mudit Verma , Arun Balaji Buduru

Language identification (LID) is an essential step in building high-quality multilingual datasets from web data. Existing LID tools (such as OpenLID or GlotLID) often struggle to identify closely related languages and to distinguish valid…

Computation and Language · Computer Science 2026-02-24 Mariia Fedorova , Nikolay Arefyev , Maja Buljan , Jindřich Helcl , Stephan Oepen , Egil Rønningstad , Yves Scherrer

It is a well-known fact that current AI-based language technology -- language models, machine translation systems, multilingual dictionaries and corpora -- focuses on the world's 2-3% most widely spoken languages. Recent research efforts…

Computation and Language · Computer Science 2023-07-26 Gábor Bella , Paula Helm , Gertraud Koch , Fausto Giunchiglia

This memo describes NTR-TSU submission for SIGTYP 2021 Shared Task on predicting language IDs from speech. Spoken Language Identification (LID) is an important step in a multilingual Automated Speech Recognition (ASR) system pipeline. For…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-08 Roman Bedyakin , Nikolay Mikhaylovskiy

Language Identification (LI) is an important first step in several speech processing systems. With a growing number of voice-based assistants, speech LI has emerged as a widely researched field. To approach the problem of identifying…

Computation and Language · Computer Science 2019-10-11 Sarthak , Shikhar Shukla , Govind Mittal

The increase in the use of microblogging came along with the rapid growth on short linguistic data. On the other hand deep learning is considered to be the new frontier to extract meaningful information out of large amount of raw data in an…

Computation and Language · Computer Science 2017-01-16 Priyank Mathur , Arkajyoti Misra , Emrah Budur