English
Related papers

Related papers: INDIC DIALECT: A Multi Task Benchmark to Evaluate …

200 papers

Evaluating machine translation (MT) for low-resource languages poses a persistent challenge, primarily due to the limited availability of high quality reference translations. This issue is further exacerbated in languages with multiple…

Computation and Language · Computer Science 2025-05-20 Md. Atiqur Rahman , Sabrina Islam , Mushfiqul Haque Omi

Agent benchmarks remain largely English-centric, while their multilingual versions are often built with machine translation (MT) and limited post-editing. We argue that, for agentic tasks, this minimal workflow can easily break benchmark…

Computation and Language · Computer Science 2026-04-29 Yunsu Kim , Kaden Uhlig , Joern Wuebker

Open-source Large Language models (OsLLMs) propel the democratization of natural language research by giving the flexibility to augment or update model parameters for performance improvement. Nevertheless, like proprietary LLMs, Os-LLMs…

Computation and Language · Computer Science 2024-12-16 Arijit Nag , Soumen Chakrabarti , Animesh Mukherjee , Niloy Ganguly

The effectiveness of brand monitoring in India is increasingly challenged by the rise of Hinglish--a hybrid of Hindi and English--used widely in user-generated content on platforms like Twitter. Traditional Natural Language Processing (NLP)…

Computation and Language · Computer Science 2026-01-09 Aashi Garg , Aneshya Das , Arshi Arya , Anushka Goyal , Aditi

We demonstrate a new approach to Neural Machine Translation (NMT) for low-resource languages using a ubiquitous linguistic resource, Interlinear Glossed Text (IGT). IGT represents a non-English sentence as a sequence of English lemmas and…

Computation and Language · Computer Science 2020-03-04 Zhong Zhou , Lori Levin , David R. Mortensen , Alex Waibel

We present MultiLoKo, a new benchmark for evaluating multilinguality in LLMs covering 31 languages. MultiLoKo consists of three partitions: a main partition consisting of 500 questions per language, separately sourced to be locally relevant…

Computation and Language · Computer Science 2025-04-16 Dieuwke Hupkes , Nikolay Bogoychev

As large language models (LLMs) are deployed in multilingual settings, their safety behavior in culturally diverse, low-resource languages remains poorly understood. We present the first systematic evaluation of LLM safety across 12 Indic…

Computation and Language · Computer Science 2026-05-18 Priyaranjan Pattnayak , Sanchari Chowdhuri

Existing large language model (LLM) evaluation benchmarks primarily focus on English, while current multilingual tasks lack parallel questions that specifically assess cross-linguistic reasoning abilities. This dual limitation makes it…

Developing high-quality large language models (LLMs) for moderately resourced languages presents unique challenges in data availability, model adaptation, and evaluation. We introduce Llama-3-Nanda-10B-Chat, or Nanda for short, a…

Despite Telugu being spoken by over 80 million people, speech translation research for this morphologically rich language remains severely underexplored. We address this gap by developing a high-quality Telugu--English speech translation…

Computation and Language · Computer Science 2025-12-09 Bhavana Akkiraju , Srihari Bandarupalli , Swathi Sambangi , Vasavi Ravuri , R Vijaya Saraswathi , Anil Kumar Vuppala

Most existing medical dialogue systems operate in a single-turn question--answering paradigm or rely on template-based datasets, limiting conversational realism and multilingual applicability. We introduce IndicMedDialog, a parallel…

Computation and Language · Computer Science 2026-05-14 Shubham Kumar Nigam , Suparnojit Sarkar , Piyush Patel

Text style transfer (TST) involves altering the linguistic style of a text while preserving its core content. This paper focuses on sentiment transfer, a popular TST subtask, across a spectrum of Indian languages: Hindi, Magahi, Malayalam,…

Computation and Language · Computer Science 2024-08-28 Sourabrata Mukherjee , Atul Kr. Ojha , Akanksha Bansal , Deepak Alok , John P. McCrae , Ondřej Dušek

Natural Language Inference (NLI) is the task of inferring the logical relationship, typically entailment or contradiction, between a premise and hypothesis. Code-mixing is the use of more than one language in the same conversation or…

Computation and Language · Computer Science 2020-04-14 Simran Khanuja , Sandipan Dandapat , Sunayana Sitaram , Monojit Choudhury

Language Identification (LI) is crucial for various natural language processing tasks, serving as a foundational step in applications such as sentiment analysis, machine translation, and information retrieval. In multilingual societies like…

Computation and Language · Computer Science 2025-03-13 Aniket Deroy , Subhankar Maity

Large Language Models (LLMs) have demonstrated strong translation abilities through prompting, even without task-specific training. However, their effectiveness in dialectal and low-resource contexts remains underexplored. This study…

Computation and Language · Computer Science 2025-12-01 Tabia Tanzin Prama , Christopher M. Danforth , Peter Sheridan Dodds

In order for NLP technology to be widely applicable, fair, and useful, it needs to serve a diverse set of speakers across the world's languages, be equitable, i.e., not unduly biased towards any particular language, and be inclusive of all…

Computation and Language · Computer Science 2023-04-13 Simran Khanuja , Sebastian Ruder , Partha Talukdar

Sanskrit is a classical language with about 30 million extant manuscripts fit for digitisation, available in written, printed or scannedimage forms. However, it is still considered to be a low-resource language when it comes to available…

Computation and Language · Computer Science 2022-11-16 Ayush Maheshwari , Nikhil Singh , Amrith Krishna , Ganesh Ramakrishnan

Large Language Models (LLMs) demonstrate impressive general knowledge and reasoning abilities, yet their evaluation has predominantly focused on global or anglocentric subjects, often neglecting low-resource languages and culturally…

Dialects introduce syntactic and lexical variations in language that occur in regional or social groups. Most NLP methods are not sensitive to such variations. This may lead to unfair behavior of the methods, conveying negative bias towards…

Computation and Language · Computer Science 2024-06-17 Maximilian Spliethöver , Sai Nikhil Menon , Henning Wachsmuth

Given the large number of Hindi speakers worldwide, there is a pressing need for robust and efficient information retrieval systems for Hindi. Despite ongoing research, there is a lack of comprehensive benchmark for evaluating retrieval…

Information Retrieval · Computer Science 2024-08-20 Arkadeep Acharya , Rudra Murthy , Vishwajeet Kumar , Jaydeep Sen