English
Related papers

Related papers: Exploring Multilingual Probing in Large Language M…

200 papers

Reasoning capabilities of large language models are primarily studied for English, even when pretrained models are multilingual. In this work, we investigate to what extent English reasoning finetuning with long chain-of-thoughts (CoTs) can…

This paper studies the performance of large language models (LLMs), particularly regarding demographic fairness, in solving real-world healthcare tasks. We evaluate state-of-the-art LLMs with three prevalent learning frameworks across six…

Computation and Language · Computer Science 2024-12-10 Yue Zhou , Barbara Di Eugenio , Lu Cheng

Despite advancements in English-dominant generative large language models, further development is needed for low-resource languages to enhance global accessibility. The primary methods for representing these languages are monolingual and…

Computation and Language · Computer Science 2024-05-14 Cagri Toraman

Natural language processing (NLP) has witnessed a profound impact of large language models (LLMs) that excel in a multitude of tasks. However, the limitation of LLMs in multilingual settings, particularly in underrepresented languages,…

Computation and Language · Computer Science 2024-09-24 Samuel Cahyawijaya

Previous work indicates that large language models exhibit a significant "English bias", i.e. they often perform better when tasks are presented in English. Interestingly, we have observed that using certain other languages in reasoning…

Computation and Language · Computer Science 2025-04-17 Changjiang Gao , Xu Huang , Wenhao Zhu , Shujian Huang , Lei Li , Fei Yuan

Large Language Models (LLMs) have achieved remarkable success across a wide range of natural language tasks, and recent efforts have sought to extend their capabilities to multimodal domains and resource-constrained environments. However,…

Machine Learning · Computer Science 2025-05-26 Yun-Da Tsai

Large Language Models (LLMs) encode vast world knowledge across multiple languages, yet their internal beliefs are often unevenly distributed across linguistic spaces. When external evidence contradicts these language-dependent memories,…

Computation and Language · Computer Science 2026-01-13 Jiaqi Zhao , Qiang Huang , Haodong Chen , Xiaoxing You , Jun Yu

Large language models (LLMs) remain unreliable for global enterprise applications due to substantial performance gaps between high-resource and mid/low-resource languages, driven by English-centric pretraining and internal reasoning biases.…

Computation and Language · Computer Science 2025-10-28 Amit Agarwal , Hansa Meghwani , Hitesh Laxmichand Patel , Tao Sheng , Sujith Ravi , Dan Roth

Large language models (LLMs) demonstrate impressive multilingual capability, but their performance varies substantially across different languages. In this work, we introduce a simple yet effective method, called cross-lingual-thought…

Computation and Language · Computer Science 2023-10-24 Haoyang Huang , Tianyi Tang , Dongdong Zhang , Wayne Xin Zhao , Ting Song , Yan Xia , Furu Wei

Large Language Models (LLMs) have become a milestone in the field of artificial intelligence and natural language processing. However, their large-scale deployment remains constrained by the need for significant computational resources.…

Computation and Language · Computer Science 2025-08-07 Julián Camilo Velandia Gutiérrez

With the widespread adoption of Large Language Models (LLMs), in this paper we investigate the multilingual capability of these models. Our preliminary results show that, translating the native language context, question and answer into a…

Computation and Language · Computer Science 2024-02-05 Adar Kahana , Jaya Susan Mathew , Said Bleik , Jeremy Reynolds , Oren Elisha

Large Language Models (LLMs) are increasingly deployed in multilingual and multicultural environments where moral reasoning is essential for generating ethically appropriate responses. Yet, the dominant pretraining of LLMs on…

Computation and Language · Computer Science 2025-09-29 Sualeha Farid , Jayden Lin , Zean Chen , Shivani Kumar , David Jurgens

Researchers working on low-resource languages face persistent challenges due to limited data availability and restricted access to computational resources. Although most large language models (LLMs) are predominantly trained in…

Computation and Language · Computer Science 2025-05-27 Odunayo Ogundepo , Akintunde Oladipo , Kelechi Ogueji , Esther Adenuga , David Ifeoluwa Adelani , Jimmy Lin

As global demand for multilingual large language models (LLMs) grows, most LLMs still remain overly focused on English, leading to the limited access to advanced AI for non-English speakers. Current methods to enhance multilingual…

Computation and Language · Computer Science 2025-05-27 Weixiang Zhao , Yulin Hu , Jiahe Guo , Xingyu Sui , Tongtong Wu , Yang Deng , Yanyan Zhao , Bing Qin , Wanxiang Che , Ting Liu

Large language models have transformed AI-assisted software engineering, but current research remains biased toward high-resource languages such as Python, with weaker performance in languages like Rust and OCaml. Since real-world systems…

Software Engineering · Computer Science 2026-04-30 Chao Jiang , Dugang Liu , Cheng Wen , Zhiwu Xu , Hua Zheng , Muhammad Sadiq , Jawwad Ahmed Shamsi , Shengchao Qin , Zhong Ming

Recent Large Reasoning Models (LRMs) with thinking traces have shown strong performance on English reasoning tasks. However, their ability to think in other languages is less studied. This capability is as important as answer accuracy for…

Computation and Language · Computer Science 2025-12-12 Jirui Qi , Shan Chen , Zidi Xiong , Raquel Fernández , Danielle S. Bitterman , Arianna Bisazza

Multilingual Large Language Models (LLMs) have recently shown great capabilities in a wide range of tasks, exhibiting state-of-the-art performance through zero-shot or few-shot prompting methods. While there have been extensive studies on…

Computation and Language · Computer Science 2023-10-24 Ruochen Zhang , Samuel Cahyawijaya , Jan Christian Blaise Cruz , Genta Indra Winata , Alham Fikri Aji

Large Language Models (LLMs) are known to process information using a proficient internal language consistently, referred to as latent language, which may differ from the input or output languages. However, how the discrepancy between the…

As the performance of Large-scale Vision Language Models (LVLMs) improves, they are increasingly capable of responding in multiple languages, and there is an expectation that the demand for explanations generated by LVLMs will grow.…

Computation and Language · Computer Science 2025-02-17 Shintaro Ozaki , Kazuki Hayashi , Yusuke Sakai , Hidetaka Kamigaito , Katsuhiko Hayashi , Taro Watanabe

Multilingual large language models (LLMs) often demonstrate a performance gap between English and non-English languages, particularly in low-resource settings. Aligning these models to low-resource languages is essential yet challenging due…

Computation and Language · Computer Science 2025-10-16 Rakesh Paul , Anusha Kamath , Kanishk Singla , Raviraj Joshi , Utkarsh Vaidya , Sanjay Singh Chauhan , Niranjan Wartikar