English
Related papers

Related papers: Cross-Corpora Language Recognition: A Preliminary …

200 papers

Knowing the language of an input text/audio is a necessary first step for using almost every NLP tool such as taggers, parsers, or translation systems. Language identification is a well-studied problem, sometimes even considered solved; in…

Computation and Language · Computer Science 2023-11-07 Milind Agarwal , Md Mahfuz Ibn Alam , Antonios Anastasopoulos

This paper presents the challenges in creating and managing large parallel corpora of 12 major Indian languages (which is soon to be extended to 23 languages) as part of a major consortium project funded by the Department of Information…

Computation and Language · Computer Science 2021-12-06 Ritesh Kumar , Shiv Bhusan Kaushik , Pinkey Nainwani , Girish Nath Jha

Multilingual models for Automatic Speech Recognition (ASR) are attractive as they have been shown to benefit from more training data, and better lend themselves to adaptation to under-resourced languages. However, initialisation from…

Audio and Speech Processing · Electrical Eng. & Systems 2018-01-24 Sibo Tong , Philip N. Garner , Hervé Bourlard

This paper analyzes dysarthric speech datasets from three languages with different prosodic systems: English, Korean, and Tamil. We inspect 39 acoustic measurements which reflect three speech dimensions including voice quality,…

Computation and Language · Computer Science 2022-11-04 Eun Jung Yeo , Sunhee Kim , Minhwa Chung

Introduction: Clinical text classification using natural language processing (NLP) models requires adequate training data to achieve optimal performance. For that, 200-500 documents are typically annotated. The number is constrained by time…

Computation and Language · Computer Science 2026-01-23 Jaya Chaturvedi , Saniya Deshpande , Chenkai Ma , Robert Cobb , Angus Roberts , Robert Stewart , Daniel Stahl , Diana Shamsutdinova

With the increasing utilization of multilingual text information, Cross-Lingual Information Retrieval (CLIR) has become a crucial research area. However, the impact of training data composition on both CLIR and Mono-Lingual Information…

Information Retrieval · Computer Science 2026-05-20 Youngjoon Jang , Junyoung Son , Taemin Lee , Seongtae Hong , Hyeonseok Moon , Seungyoon Lee , Andrew Matteson , Heuiseok Lim

Automatic Cognate Detection (ACD) is a challenging task which has been utilized to help NLP applications like Machine Translation, Information Retrieval and Computational Phylogenetics. Unidentified cognate pairs can pose a challenge to…

Computation and Language · Computer Science 2022-01-03 Diptesh Kanojia , Kevin Patel , Pushpak Bhattacharyya , Malhar Kulkarni , Gholamreza Haffari

Multilingual generative models obtain remarkable cross-lingual in-context learning capabilities through pre-training on large-scale corpora. However, they still exhibit a performance bias toward high-resource languages and learn isolated…

Computation and Language · Computer Science 2024-06-13 Chong Li , Shaonan Wang , Jiajun Zhang , Chengqing Zong

Cross-lingual information retrieval (CLIR) enables access to multilingual knowledge but remains challenging due to disparities in resources, scripts, and weak cross-lingual semantic alignment in embedding models. Existing pipelines often…

Information Retrieval · Computer Science 2025-11-25 Roksana Goworek , Olivia Macmillan-Scott , Eda B. Özyiğit

This paper examines how linguistic similarity affects cross-lingual phonetic representation in speech processing for low-resource languages, emphasizing effective source language selection. Previous cross-lingual research has used various…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-14 Minu Kim , Kangwook Jang , Hoirin Kim

The performance of Large Language Models (LLMs) on natural language tasks can be improved through both supervised fine-tuning (SFT) and in-context learning (ICL), which operate via distinct mechanisms. Supervised fine-tuning updates the…

Computation and Language · Computer Science 2025-05-21 Saahith Janapati , Yangfeng Ji

A cornerstone in AI research has been the creation and adoption of standardized training and test datasets to earmark the progress of state-of-the-art models. A particularly successful example is the GLUE dataset for training and evaluating…

Computation and Language · Computer Science 2022-12-16 Tahir Javed , Kaushal Santosh Bhogale , Abhigyan Raman , Anoop Kunchukuttan , Pratyush Kumar , Mitesh M. Khapra

Large Language Models (LLMs) can be adapted to extend their text capabilities to speech inputs. However, these speech-adapted LLMs consistently underperform their text-based counterparts--and even cascaded pipelines--on language…

Computation and Language · Computer Science 2026-02-24 Santiago Cuervo , Skyler Seto , Maureen de Seyssel , Richard He Bai , Zijin Gu , Tatiana Likhomanenko , Navdeep Jaitly , Zakaria Aldeneh

Although multilingual LLMs have achieved remarkable performance across benchmarks, we find they continue to underperform on non-Latin script languages across contemporary LLM families. This discrepancy arises from the fact that LLMs are…

Computation and Language · Computer Science 2025-06-27 Hoang H Nguyen , Khyati Mahajan , Vikas Yadav , Julian Salazar , Philip S. Yu , Masoud Hashemi , Rishabh Maheshwary

Large language models (LLMs) are increasingly deployed in multilingual applications but often generate plausible yet incorrect or misleading outputs, known as hallucinations. While hallucination detection has been studied extensively in…

Computation and Language · Computer Science 2025-12-02 Hrishikesh Terdalkar , Kirtan Bhojani , Aryan Dongare , Omm Aditya Behera

The research on code-mixed data is limited due to the unavailability of dedicated code-mixed datasets and pre-trained language models. In this work, we focus on the low-resource Indian language Marathi which lacks any prior work in…

Computation and Language · Computer Science 2023-07-21 Tanmay Chavan , Omkar Gokhale , Aditya Kane , Shantanu Patankar , Raviraj Joshi

Early detection of cognitive decline is crucial for enabling interventions that can slow neurodegenerative disease progression. Traditional diagnostic approaches rely on labor-intensive clinical assessments, which are impractical for…

Computation and Language · Computer Science 2025-09-04 Kristin Qi , Youxiang Zhu , Caroline Summerour , John A. Batsis , Xiaohui Liang

The effectiveness of Large Language Models (LLMs) depends heavily on the availability of high-quality post-training data, particularly instruction-tuning and preference-based examples. Existing open-source datasets, however, often lack…

Computation and Language · Computer Science 2025-10-09 Neel Prabhanjan Rachamalla , Aravind Konakalla , Gautam Rajeev , Ashish Kulkarni , Chandra Khatri , Shubham Agarwal

Large Language Models (LLMs) have shown remarkable capabilities in natural language processing but exhibit significant performance gaps among different languages. Most existing approaches to address these disparities rely on pretraining or…

Computation and Language · Computer Science 2024-10-17 Weixuan Wang , Minghao Wu , Barry Haddow , Alexandra Birch

Internal Language Model Estimation (ILME) based language model (LM) fusion has been shown significantly improved recognition results over conventional shallow fusion in both intra-domain and cross-domain speech recognition tasks. In this…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-12 Yizhou Peng , Yufei Liu , Jicheng Zhang , Haihua Xu , Yi He , Hao Huang , Eng Siong Chng