中文
相关论文

相关论文: Modeling Romanized Hindi and Bengali: Dataset Crea…

200 篇论文

With nearly 1.5 billion people and more than 120 major languages, India represents one of the most diverse regions in the world. As multilingual Vision-Language Models (VLMs) gain prominence, robust evaluation methodologies are essential to…

As an Indo-Aryan language with limited available data, Chakma remains largely underrepresented in language models. In this work, we introduce a novel corpus of contextually coherent Bangla-transliterated Chakma, curated from Chakma…

计算与语言 · 计算机科学 2025-11-27 Adity Khisa , Nusrat Jahan Lia , Tasnim Mahfuz Nafis , Zarif Masud , Tanzir Pial , Shebuti Rayana , Ahmedul Kabir

In the contemporary digital era, the Internet functions as an unparalleled catalyst, dismantling geographical and linguistic barriers particularly evident in texting. This evolution facilitates global communication, transcending physical…

计算与语言 · 计算机科学 2024-01-10 Selva Kumar S , Afifah Khan Mohammed Ajmal Khan , Chirag Manjeshwar , Imadh Ajaz Banday

Large language models (LLMs) frequently exhibit performance biases against regional dialects of low-resource languages. However, frameworks to quantify these disparities remain scarce. We propose a two-phase framework to evaluate dialectal…

计算与语言 · 计算机科学 2026-03-24 K. M. Jubair Sami , Dipto Sumit , Ariyan Hossain , Farig Sadeque

Social media often serves as a breeding ground for various hateful and offensive content. Identifying such content on social media is crucial due to its impact on the race, gender, or religion in an unprejudiced society. However, while…

计算与语言 · 计算机科学 2022-10-10 Mithun Das , Somnath Banerjee , Punyajoy Saha , Animesh Mukherjee

Translating from a standard language to its regional dialects is a significant NLP challenge due to scarce data and linguistic variation, a problem prominent in the Bengali language. This paper proposes and compares two novel RAG pipelines…

计算与语言 · 计算机科学 2025-12-17 K. M. Jubair Sami , Dipto Sumit , Ariyan Hossain , Farig Sadeque

The effectiveness of brand monitoring in India is increasingly challenged by the rise of Hinglish--a hybrid of Hindi and English--used widely in user-generated content on platforms like Twitter. Traditional Natural Language Processing (NLP)…

计算与语言 · 计算机科学 2026-01-09 Aashi Garg , Aneshya Das , Arshi Arya , Anushka Goyal , Aditi

Language modeling has witnessed remarkable advancements in recent years, with Large Language Models (LLMs) like ChatGPT setting unparalleled benchmarks in human-like text generation. However, a prevailing limitation is the…

计算与语言 · 计算机科学 2023-11-13 Abhinand Balachandran

Language models based on the Transformer architecture have achieved state-of-the-art performance on a wide range of NLP tasks such as text classification, question-answering, and token classification. However, this performance is usually…

计算与语言 · 计算机科学 2020-11-05 Kushal Jain , Adwait Deshpande , Kumar Shridhar , Felix Laumann , Ayushman Dash

Multilingual language models have shown impressive cross-lingual transfer ability across a diverse set of languages and tasks. To improve the cross-lingual ability of these models, some strategies include transliteration and finer-grained…

计算与语言 · 计算机科学 2023-05-08 Sonal Sannigrahi , Rachel Bawden

The paper overviews the shared task on Real-Time Reverse Transliteration for Romanized Indo-Aryan languages. It focuses on the reverse transliteration of low-resourced languages in the Indo-Aryan family to their native scripts. Typing…

计算与语言 · 计算机科学 2025-02-25 Deshan Sumanathilaka , Isuri Anuradha , Ruvan Weerasinghe , Nicholas Micallef , Julian Hough

Figurative language understanding remains a significant challenge for Large Language Models (LLMs), especially for low-resource languages. To address this, we introduce a new idiom dataset, a large-scale, culturally-grounded corpus of…

计算与语言 · 计算机科学 2026-02-16 Adib Sakhawat , Shamim Ara Parveen , Md Ruhul Amin , Shamim Al Mahmud , Md Saiful Islam , Tahera Khatun

Despite the considerable advancements in English LLMs, the progress in building comparable models for other languages has been hindered due to the scarcity of tailored resources. Our work aims to bridge this divide by introducing an…

This report evaluates the performance of text-in text-out Large Language Models (LLMs) to understand and generate Indic languages. This evaluation is used to identify and prioritize Indic languages suited for inclusion in safety benchmarks.…

计算与语言 · 计算机科学 2025-01-24 Aatman Vaidya , Tarunima Prabhakar , Denny George , Swair Shah

Large language models (LLMs) are increasingly deployed in multilingual applications but often generate plausible yet incorrect or misleading outputs, known as hallucinations. While hallucination detection has been studied extensively in…

计算与语言 · 计算机科学 2025-12-02 Hrishikesh Terdalkar , Kirtan Bhojani , Aryan Dongare , Omm Aditya Behera

Large language models (LLMs) are used worldwide, yet exhibit Western cultural tendencies. Many countries are now building ``regional'' or ``sovereign'' LLMs, but it remains unclear whether they reflect local values and practices or merely…

计算与语言 · 计算机科学 2026-01-26 Dhruv Agarwal , Anya Shukla , Sunayana Sitaram , Aditya Vashistha

Social media plays a significant role in cross-cultural communication. A vast amount of this occurs in code-mixed and multilingual form, posing a significant challenge to Natural Language Processing (NLP) tools for processing such…

计算与语言 · 计算机科学 2026-01-21 Dwip Dalal , Vivek Srivastava , Mayank Singh

Large language models (LLMs) can produce text that closely resembles human writing. This capability raises concerns about misuse, including disinformation and content manipulation. Detecting AI-generated text is essential to maintain…

Multilingual speakers often switch between languages to express themselves on social communication platforms. Sometimes, the original script of the language is preserved, while using a common script for all the languages is quite popular as…

计算与语言 · 计算机科学 2018-03-19 Soumil Mandal , Dipankar Das

The performance of Language Models (LMs) on low-resource, morphologically rich languages like Sinhala remains largely unexplored, particularly regarding script variation in digital communication. Sinhala exhibits script duality, with…

计算与语言 · 计算机科学 2026-05-11 Minuri Rajapakse , Ruvan Weerasinghe