中文
相关论文

相关论文: Evaluating Cross-lingual Knowledge Consistency in …

200 篇论文

Large Language Models (LLMs) have demonstrated remarkable capabilities in code generation from natural language prompts, revolutionizing software development workflows. As we advance towards agent-based development paradigms, these models…

软件工程 · 计算机科学 2025-02-27 Ujjwal Singh , Aditi Sharma , Nikhil Gupta , Deepakshi , Vivek Kumar Jha

Despite their strong ability to retrieve knowledge in English, current large language models show imbalance abilities in different languages. Two approaches are proposed to address this, i.e., multilingual pretraining and multilingual…

计算与语言 · 计算机科学 2024-04-09 Changjiang Gao , Hongda Hu , Peng Hu , Jiajun Chen , Jixing Li , Shujian Huang

As large language models (LLMs) see increasing adoption across the globe, it is imperative for LLMs to be representative of the linguistic diversity of the world. India is a linguistically diverse country of 1.4 Billion people. To…

计算与语言 · 计算机科学 2024-08-09 Harman Singh , Nitish Gupta , Shikhar Bharadwaj , Dinesh Tewari , Partha Talukdar

Vision-language models (VLMs) have demonstrated impressive generalization across multimodal tasks, yet most evaluation benchmarks remain Western-centric, leaving open questions about their performance in culturally diverse and multilingual…

计算机视觉与模式识别 · 计算机科学 2025-11-10 Ali Faraz , Akash , Shaharukh Khan , Raja Kolla , Akshat Patidar , Suranjan Goswami , Abhinav Ravi , Chandra Khatri , Shubham Agarwal

Popular benchmarks (e.g., XNLI) used to evaluate cross-lingual language understanding consist of parallel versions of English evaluation sets in multiple target languages created with the help of professional translators. When creating such…

计算与语言 · 计算机科学 2024-02-06 Ashish Sunil Agrawal , Barah Fazili , Preethi Jyothi

Cross-Language Information Retrieval (CLIR) has become an important problem to solve in the recent years due to the growth of content in multiple languages in the Web. One of the standard methods is to use query translation from source to…

计算与语言 · 计算机科学 2016-08-05 Paheli Bhattacharya , Pawan Goyal , Sudeshna Sarkar

The task of automatically identifying a language used in a given text is called Language Identification (LI). India is a multilingual country and many Indians especially youths are comfortable with Hindi and English, in addition to their…

计算与语言 · 计算机科学 2022-11-21 H. L. Shashirekha , F. Balouchzahi , M. D. Anusha , G. Sidorov

Natural language processing (NLP) techniques have become mainstream in the recent decade. Most of these advances are attributed to the processing of a single language. More recently, with the extensive growth of social media platforms focus…

计算与语言 · 计算机科学 2022-01-12 Ramchandra Joshi , Raviraj Joshi

Low-resource languages, by its very definition, tend to be under represented in the pre-training corpora of Large Language Models. In this work, we investigate three low-resource cross-lingual approaches that enable an LLM adapt to tasks in…

计算与语言 · 计算机科学 2024-06-26 Vaibhav Singh , Amrith Krishna , Karthika NJ , Ganesh Ramakrishnan

We introduce COMI-LINGUA, the largest manually annotated Hindi-English code-mixed dataset, comprising 125K+ high-quality instances across five core NLP tasks: Matrix Language Identification, Token-level Language Identification,…

计算与语言 · 计算机科学 2025-09-18 Rajvee Sheth , Himanshu Beniwal , Mayank Singh

With the growing presence of multilingual users on social media, detecting abusive language in code-mixed text has become increasingly challenging. Code-mixed communication, where users seamlessly switch between English and their native…

计算与语言 · 计算机科学 2025-05-01 Manish Pandey , Nageshwar Prasad Yadav , Mokshada Adduru , Sawan Rai

In this paper, we report the results of the TeamNRC's participation in the BHASHA-Task 1 Grammatical Error Correction shared task https://github.com/BHASHA-Workshop/IndicGEC2025/ for 5 Indian languages. Our approach, focusing on…

计算与语言 · 计算机科学 2025-11-20 Sowmya Vajjala

The rapid progress in question-answering (QA) systems has predominantly benefited high-resource languages, leaving Indic languages largely underrepresented despite their vast native speaker base. In this paper, we present IndicSQuAD, a…

计算与语言 · 计算机科学 2025-05-14 Sharvi Endait , Ruturaj Ghatage , Aditya Kulkarni , Rajlaxmi Patil , Raviraj Joshi

Generative Large Language Models (LLMs) have achieved remarkable advancements in various NLP tasks. In this work, our aim is to explore the multilingual capabilities of large language models by using machine translation as a task involving…

Language models based on the Transformer architecture have achieved state-of-the-art performance on a wide range of NLP tasks such as text classification, question-answering, and token classification. However, this performance is usually…

计算与语言 · 计算机科学 2020-11-05 Kushal Jain , Adwait Deshpande , Kumar Shridhar , Felix Laumann , Ayushman Dash

In-Context Learning (ICL) has emerged as a pivotal capability of auto-regressive large language models, yet it is hindered by a notable sensitivity to the ordering of context examples regardless of their mutual independence. To address this…

计算与语言 · 计算机科学 2025-05-09 Lizhe Fang , Yifei Wang , Khashayar Gatmiry , Lei Fang , Yisen Wang

Most safety evaluations of large language models (LLMs) remain anchored in English. Translation is often used as a shortcut to probe multilingual behavior, but it rarely captures the full picture, especially when harmful intent or structure…

计算与语言 · 计算机科学 2026-02-10 Vaibhav Shukla , Hardik Sharma , Adith N Reganti , Soham Wasmatkar , Bagesh Kumar , Vrijendra Singh

While automatic metrics drive progress in Machine Translation (MT) and Text Summarization (TS), existing metrics have been developed and validated almost exclusively for English and other high-resource languages. This narrow focus leaves…

计算与语言 · 计算机科学 2025-10-09 Amir Hossein Yari , Kalmit Kulkarni , Ahmad Raza Khan , Fajri Koto

Multilingual generative models obtain remarkable cross-lingual in-context learning capabilities through pre-training on large-scale corpora. However, they still exhibit a performance bias toward high-resource languages and learn isolated…

计算与语言 · 计算机科学 2024-06-13 Chong Li , Shaonan Wang , Jiajun Zhang , Chengqing Zong

Training multilingual automatic speech recognition (ASR) systems is challenging because acoustic and lexical information is typically language specific. Training multilingual system for Indic languages is even more tougher due to lack of…

计算与语言 · 计算机科学 2022-06-14 Harveen Singh Chadha , Priyanshi Shah , Ankur Dhuriya , Neeraj Chhimwal , Anirudh Gupta , Vivek Raghavan