中文
相关论文

相关论文: IndoRobusta: Towards Robustness Against Diverse Co…

200 篇论文

Multilingual large language models (LLMs) are increasingly deployed in linguistically diverse regions like India, yet most interpretability tools remain tailored to English. Prior work reveals that LLMs often operate in English centric…

计算与语言 · 计算机科学 2026-02-19 Mihir Panchal , Deeksha Varshney , Mamta , Asif Ekbal

Bengali is an underrepresented language in NLP research. However, it remains a challenge due to its unique linguistic structure and computational constraints. In this work, we systematically investigate the challenges that hinder Bengali…

计算与语言 · 计算机科学 2025-08-01 Shimanto Bhowmik , Tawsif Tashwar Dipto , Md Sazzad Islam , Sheryl Hsu , Tahsin Reasat

Safety alignment of large language models (LLMs) is mostly evaluated in English and contract-bound, leaving multilingual vulnerabilities understudied. We introduce \textbf{Indic Jailbreak Robustness (IJR)}, a judge-free benchmark for…

人工智能 · 计算机科学 2026-02-20 Priyaranjan Pattnayak , Sanchari Chowdhuri

Code-switching, or alternating between languages within a single conversation, presents challenges for multilingual language models on NLP tasks. This research investigates if pre-training Multilingual BERT (mBERT) on code-switched datasets…

计算与语言 · 计算机科学 2025-03-12 Katherine Xie , Nitya Babbar , Vicky Chen , Yoanna Turura

Code-mixing is a frequent communication style among multilingual speakers where they mix words and phrases from two different languages in the same utterance of text or speech. Identifying and filtering code-mixed text is a challenging task…

计算与语言 · 计算机科学 2021-06-21 Vivek Srivastava , Mayank Singh

The term "Code Mixed" refers to the use of more than one language in the same text. This phenomenon is predominantly observed on social media platforms, with an increasing amount of adaptation as time goes on. It is critical to detect…

计算与语言 · 计算机科学 2023-05-29 Aryan Patil , Varad Patwardhan , Abhishek Phaltankar , Gauri Takawane , Raviraj Joshi

This paper introduces PMIndiaSum, a multilingual and massively parallel summarization corpus focused on languages in India. Our corpus provides a training and testing ground for four language families, 14 languages, and the largest to date…

计算与语言 · 计算机科学 2023-10-23 Ashok Urlana , Pinzhen Chen , Zheng Zhao , Shay B. Cohen , Manish Shrivastava , Barry Haddow

Code-mixing is the phenomenon of using more than one language in a sentence. It is a very frequently observed pattern of communication on social media platforms. Flexibility to use multiple languages in one text message might help to…

计算与语言 · 计算机科学 2020-04-21 Vivek Srivastava , Mayank Singh

NLP applications for code-mixed (CM) or mix-lingual text have gained a significant momentum recently, the main reason being the prevalence of language mixing in social media communications in multi-lingual societies like India, Mexico,…

计算与语言 · 计算机科学 2021-11-15 Mohsin Ali , Kandukuri Sai Teja , Sumanth Manduru , Parth Patwa , Amitava Das

Even though over seven hundred ethnic languages are spoken in Indonesia, the available technology remains limited that could support communication within indigenous communities as well as with people outside the villages. As a result,…

计算与语言 · 计算机科学 2020-11-05 Sashi Novitasari , Andros Tjandra , Sakriani Sakti , Satoshi Nakamura

Motivation. Large language models (LLMs) have exhibited remarkable proficiency in diverse software engineering (SE) tasks. Handling such tasks typically involves acquiring foundational coding knowledge on large, general-purpose datasets…

软件工程 · 计算机科学 2024-08-02 José Antonio Hernández López , Boqi Chen , Mootez Saaz , Tushar Sharma , Dániel Varró

Hate detection has long been a challenging task for the NLP community. The task becomes complex in a code-mixed environment because the models must understand the context and the hate expressed through language alteration. Compared to the…

计算与语言 · 计算机科学 2024-10-22 Debajyoti Mazumder , Aakash Kumar , Jasabanta Patro

Large language models have exhibited significant proficiency in languages endowed with extensive linguistic resources, such as English and Chinese. Nevertheless, their effectiveness notably diminishes when applied to languages characterized…

计算与语言 · 计算机科学 2024-04-16 Sophia Maria

Building Natural Language Understanding (NLU) capabilities for Indic languages, which have a collective speaker base of more than one billion speakers is absolutely crucial. In this work, we aim to improve the NLU capabilities of Indic…

In this work, we present an extensive study of statistical machine translation involving languages of the Indian subcontinent. These languages are related by genetic and contact relationships. We describe the similarities between Indic…

计算与语言 · 计算机科学 2020-03-20 Anoop Kunchukuttan , Pushpak Bhattacharyya

Code-switching is a widespread practice among the world's multilingual majority, yet few benchmarks accurately reflect its complexity in everyday communication. We present PingPong, a benchmark for natural multi-party code-switching…

Recent advances in Unsupervised Neural Machine Translation (UNMT) have minimized the gap between supervised and unsupervised machine translation performance for closely related language pairs. However, the situation is very different for…

计算与语言 · 计算机科学 2021-06-10 Tamali Banerjee , Rudra Murthy , Pushpak Bhattacharyya

Evaluations of Large Language Models (LLMs) often overlook intersectional and culturally specific biases, particularly in underrepresented multilingual regions like South Asia. This work addresses these gaps by conducting a multilingual and…

计算与语言 · 计算机科学 2026-05-07 Mamnuya Rinki , Chahat Raj , Anjishnu Mukherjee , Ziwei Zhu

Multilingual language models (LMs) promise broader NLP access, yet current systems deliver uneven performance across the world's languages. This survey examines why these gaps persist and whether they reflect intrinsic linguistic difficulty…

计算与语言 · 计算机科学 2026-04-13 Chen Shani , Yuval Reif , Nathan Roll , Dan Jurafsky , Ekaterina Shutova

Previous work in Indonesian part-of-speech (POS) tagging are hard to compare as they are not evaluated on a common dataset. Furthermore, in spite of the success of neural network models for English POS tagging, they are rarely explored for…

计算与语言 · 计算机科学 2019-02-27 Kemal Kurniawan , Alham Fikri Aji