English
Related papers

Related papers: Discriminating between Indo-Aryan Languages Using …

200 papers

With nearly 1.5 billion people and more than 120 major languages, India represents one of the most diverse regions in the world. As multilingual Vision-Language Models (VLMs) gain prominence, robust evaluation methodologies are essential to…

In this paper, we introduce Neural Information Retrieval resources for 11 widely spoken Indian Languages (Assamese, Bengali, Gujarati, Hindi, Kannada, Malayalam, Marathi, Oriya, Punjabi, Tamil, and Telugu) from two major Indian language…

Information Retrieval · Computer Science 2023-12-18 Saiful Haq , Ashutosh Sharma , Pushpak Bhattacharyya

This paper presents Centre for Development of Advanced Computing Mumbai's (CDACM) submission to NLP Tools Contest on Statistical Machine Translation in Indian Languages (ILSMT) 2015 (collocated with ICON 2015). The aim of the contest was to…

Computation and Language · Computer Science 2016-10-26 Raj Nath Patel , Prakash B. Pimpale

Language identification is used as the first step in many data collection and crawling efforts because it allows us to sort online text into language-specific buckets. However, many modern languages, such as Konkani, Kashmiri, Punjabi etc.,…

Computation and Language · Computer Science 2024-06-27 Milind Agarwal , Joshua Otten , Antonios Anastasopoulos

language identification (LID) is identifing a language in a given spoken utterance. Language segmentation is equally inportant as language identification where language boundaries can be spotted in a multi language utterance. In this paper,…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-19 Anirban Bhowmick , Astik Biswas

Automatic Speech Recognition (ASR) is increasingly used to document clinical encounters, yet its reliability in multilingual and demographically diverse Indian healthcare contexts remains largely unknown. In this study, we conduct the first…

Hindi, one of the most spoken language of India, exhibits a diverse array of accents due to its usage among individuals from diverse linguistic origins. To enable a robust evaluation of Hindi ASR systems on multiple accents, we create a…

Computation and Language · Computer Science 2024-08-22 Tahir Javed , Janki Nawale , Sakshi Joshi , Eldho George , Kaushal Bhogale , Deovrat Mehendale , Mitesh M. Khapra

Vision-language models (VLMs) have demonstrated impressive generalization across multimodal tasks, yet most evaluation benchmarks remain Western-centric, leaving open questions about their performance in culturally diverse and multilingual…

Computer Vision and Pattern Recognition · Computer Science 2025-11-10 Ali Faraz , Akash , Shaharukh Khan , Raja Kolla , Akshat Patidar , Suranjan Goswami , Abhinav Ravi , Chandra Khatri , Shubham Agarwal

As large language models (LLMs) see increasing adoption across the globe, it is imperative for LLMs to be representative of the linguistic diversity of the world. India is a linguistically diverse country of 1.4 Billion people. To…

Computation and Language · Computer Science 2024-08-09 Harman Singh , Nitish Gupta , Shikhar Bharadwaj , Dinesh Tewari , Partha Talukdar

While large language models excel on high-resource multilingual tasks, low- and extremely low-resource Indic languages remain severely under-evaluated. We present IndicParam, a human-curated benchmark of over 13,000 multiple-choice…

Computation and Language · Computer Science 2026-01-13 Ayush Maheshwari , Kaushal Sharma , Vivek Patel , Aditya Maheshwari

We create publicly available language identification (LID) datasets and models in all 22 Indian languages listed in the Indian constitution in both native-script and romanized text. First, we create Bhasha-Abhijnaanam, a language…

Computation and Language · Computer Science 2023-10-27 Yash Madhani , Mitesh M. Khapra , Anoop Kunchukuttan

In this paper, we conduct one of the very first studies for cross-corpora performance evaluation in the spoken language identification (LID) problem. Cross-corpora evaluation was not explored much in LID research, especially for the Indian…

Audio and Speech Processing · Electrical Eng. & Systems 2021-05-13 Spandan Dey , Goutam Saha , Md Sahidullah

We present sentence aligned parallel corpora across 10 Indian Languages - Hindi, Telugu, Tamil, Malayalam, Gujarati, Urdu, Bengali, Oriya, Marathi, Punjabi, and English - many of which are categorized as low resource. The corpora are…

Computation and Language · Computer Science 2020-07-16 Shashank Siripragada , Jerin Philip , Vinay P. Namboodiri , C V Jawahar

Traditionally linguists have organized languages of the world as language families modelled as trees. In this work we take a contrarian approach and question the tree-based model that is rather restrictive. For example, the affinity that…

Computation and Language · Computer Science 2020-12-15 Priya S. Nayak , Rhythm Girdhar , Shreekanth M. Prabhu

This research investigates biases in text-to-image (TTI) models for the Indic languages widely spoken across India. It evaluates and compares the generative performance and cultural relevance of leading TTI models in these languages against…

Computation and Language · Computer Science 2024-08-02 Surbhi Mittal , Arnav Sudan , Mayank Vatsa , Richa Singh , Tamar Glaser , Tal Hassner

Most existing approaches for unsupervised bilingual lexicon induction (BLI) depend on good quality static or contextual embeddings requiring large monolingual corpora for both languages. However, unsupervised BLI is most likely to be useful…

Computation and Language · Computer Science 2024-03-26 Niyati Bafna , Cristina España-Bonet , Josef van Genabith , Benoît Sagot , Rachel Bawden

Vision-language models score well on mathematical, scientific, and spatial reasoning benchmarks, yet these evaluations are overwhelmingly English. I present the first cross-lingual visual reasoning audit for Indian languages. 980 questions…

Computation and Language · Computer Science 2026-03-31 Swastik R

Recent methods in speech and language technology pretrain very LARGE models which are fine-tuned for specific tasks. However, the benefits of such LARGE models are often limited to a few resource rich languages of the world. In this work,…

Evaluating instruction-tuned Large Language Models (LLMs) in Hindi is challenging due to a lack of high-quality benchmarks, as direct translation of English datasets fails to capture crucial linguistic and cultural nuances. To address this,…

Computation and Language · Computer Science 2025-10-16 Anusha Kamath , Kanishk Singla , Rakesh Paul , Raviraj Joshi , Utkarsh Vaidya , Sanjay Singh Chauhan , Niranjan Wartikar

This paper describes the submissions by team HWR to the Dravidian Language Identification (DLI) shared task organized at VarDial 2021 workshop. The DLI training set includes 16,674 YouTube comments written in Roman script containing…

Computation and Language · Computer Science 2021-03-10 Tommi Jauhiainen , Tharindu Ranasinghe , Marcos Zampieri