English
Related papers

Related papers: How does a Multilingual LM Handle Multiple Languag…

200 papers

Large language models (LLMs) are known to effectively perform tasks by simply observing few exemplars. However, in low-resource languages, obtaining such hand-picked exemplars can still be challenging, where unsupervised techniques may be…

Computation and Language · Computer Science 2024-07-22 Xuan-Phi Nguyen , Sharifah Mahani Aljunied , Shafiq Joty , Lidong Bing

Knowledge bases (KBs) contain plenty of structured world and commonsense knowledge. As such, they often complement distributional text-based information and facilitate various downstream tasks. Since their manual construction is resource-…

Computation and Language · Computer Science 2022-03-10 Wenxuan Zhou , Fangyu Liu , Ivan Vulić , Nigel Collier , Muhao Chen

The development of Large Language Models (LLMs) relies on extensive text corpora, which are often unevenly distributed across languages. This imbalance results in LLMs performing significantly better on high-resource languages like English,…

Computation and Language · Computer Science 2024-12-12 Zihao Li , Yucheng Shi , Zirui Liu , Fan Yang , Ali Payani , Ninghao Liu , Mengnan Du

The success of large pretrained language models (LMs) such as BERT and RoBERTa has sparked interest in probing their representations, in order to unveil what types of knowledge they implicitly capture. While prior research focused on…

Computation and Language · Computer Science 2020-10-13 Ivan Vulić , Edoardo Maria Ponti , Robert Litschko , Goran Glavaš , Anna Korhonen

Instruction tuning a large language model with multiple languages can prepare it for multilingual downstream tasks. Nonetheless, it is yet to be determined whether having a handful of languages is sufficient, or whether the benefits…

Computation and Language · Computer Science 2024-12-10 Shaoxiong Ji , Pinzhen Chen

We present the first comprehensive study of Memorization in Multilingual Large Language Models (MLLMs), analyzing 95 languages using models across diverse model scales, architectures, and memorization definitions. As MLLMs are increasingly…

Computation and Language · Computer Science 2026-01-08 Xiaoyu Luo , Yiyi Chen , Johannes Bjerva , Qiongxiu Li

The development of open-source, multilingual medical language models can benefit a wide, linguistically diverse audience from different regions. To promote this domain, we present contributions from the following: First, we construct a…

Computation and Language · Computer Science 2024-06-04 Pengcheng Qiu , Chaoyi Wu , Xiaoman Zhang , Weixiong Lin , Haicheng Wang , Ya Zhang , Yanfeng Wang , Weidi Xie

We present Belebele, a multiple-choice machine reading comprehension (MRC) dataset spanning 122 language variants. Significantly expanding the language coverage of natural language understanding (NLU) benchmarks, this dataset enables the…

Modern NLP breakthrough includes large multilingual models capable of performing tasks across more than 100 languages. State-of-the-art language models came a long way, starting from the simple one-hot representation of words capable of…

Computation and Language · Computer Science 2023-09-06 Fahim Faisal

Multilingual BERT (mBERT) trained on 104 languages has shown surprisingly good cross-lingual performance on several NLP tasks, even without explicit cross-lingual signals. However, these evaluations have focused on cross-lingual transfer…

Computation and Language · Computer Science 2020-10-02 Shijie Wu , Mark Dredze

Large Language Models (LLMs) are rapidly reshaping machine translation (MT), particularly by introducing instruction-following, in-context learning, and preference-based alignment into what has traditionally been a supervised…

Computation and Language · Computer Science 2026-04-29 Baban Gain , Dibyanayan Bandyopadhyay , Asif Ekbal , Trilok Nath Singh

Generative large language models (LLMs) have been shown to exhibit harmful biases and stereotypes. While safety fine-tuning typically takes place in English, if at all, these models are being used by speakers of many different languages.…

Computation and Language · Computer Science 2024-07-18 Vera Neplenbroek , Arianna Bisazza , Raquel Fernández

Sentiment analysis serves as a pivotal component in Natural Language Processing (NLP). Advancements in multilingual pre-trained models such as XLM-R and mT5 have contributed to the increasing interest in cross-lingual sentiment analysis.…

Computation and Language · Computer Science 2024-06-28 Xiliang Zhu , Shayna Gardiner , Tere Roldán , David Rossouw

Multilingual language models have gained significant attention in recent years, enabling the development of applications that meet diverse linguistic contexts. In this paper, we present a comprehensive evaluation of three popular…

Computation and Language · Computer Science 2024-02-14 Sina Bagheri Nezhad , Ameeta Agrawal

Theory of Mind (ToM) refers to the cognitive ability to infer and attribute mental states to oneself and others. As large language models (LLMs) are increasingly evaluated for social and cognitive capabilities, it remains unclear to what…

Computation and Language · Computer Science 2024-11-26 Jayanta Sadhu , Ayan Antik Khan , Noshin Nawal , Sanju Basak , Abhik Bhattacharjee , Rifat Shahriyar

Despite cross-lingual generalization demonstrated by pre-trained multilingual models, the translate-train paradigm of transferring English datasets across multiple languages remains to be a key mechanism for training task-specific…

Computation and Language · Computer Science 2023-02-14 Abhijeet Awasthi , Nitish Gupta , Bidisha Samanta , Shachi Dave , Sunita Sarawagi , Partha Talukdar

Multilingual Pre-trained Language models (multiPLMs), trained on the Masked Language Modelling (MLM) objective are commonly being used for cross-lingual tasks such as bitext mining. However, the performance of these models is still…

Computation and Language · Computer Science 2025-01-13 Aloka Fernando , Surangika Ranathunga

Language modeling studies the probability distributions over strings of texts. It is one of the most fundamental tasks in natural language processing (NLP). It has been widely used in text generation, speech recognition, machine…

Computation and Language · Computer Science 2024-07-18 Chengwei Wei , Yun-Cheng Wang , Bin Wang , C. -C. Jay Kuo

In recent years, multimodal large language models (MLLMs) have achieved significant breakthroughs, enhancing understanding across text and vision. However, current MLLMs still face challenges in effectively integrating knowledge across…

Computation and Language · Computer Science 2025-03-10 Boyu Jia , Junzhe Zhang , Huixuan Zhang , Xiaojun Wan

In this study, we reveal an in-context learning (ICL) capability of multilingual large language models (LLMs): by translating the input to several languages, we provide Parallel Input in Multiple Languages (PiM) to LLMs, which significantly…

Computation and Language · Computer Science 2025-06-04 Yongyu Mu , Peinan Feng , Zhiquan Cao , Yuzhang Wu , Bei Li , Chenglong Wang , Tong Xiao , Kai Song , Tongran Liu , Chunliang Zhang , Jingbo Zhu