English
Related papers

Related papers: Does Transliteration Help Multilingual Language Mo…

200 papers

Multilingual language models have recently gained attention as a promising solution for representing multiple languages in a single model. In this paper, we propose new criteria to evaluate the quality of lexical representation and…

Computation and Language · Computer Science 2023-05-30 Tomasz Limisiewicz , Jiří Balhar , David Mareček

The world's more than 7000 languages are written in at least 293 scripts. Due to various reasons, many closely related languages use different scripts, which poses a difficulty for multilingual pretrained language models (mPLMs) in learning…

Computation and Language · Computer Science 2024-05-24 Yihong Liu , Chunlan Ma , Haotian Ye , Hinrich Schütze

The curse of multilinguality phenomenon is a fundamental problem of multilingual Large Language Models (LLMs), where the competition between massive languages results in inferior performance. It mainly comes from limited capacity and…

Computation and Language · Computer Science 2025-06-17 Chong Li , Yingzhuo Deng , Jiajun Zhang , Chengqing Zong

The successful adaptation of multilingual language models (LMs) to a specific language-task pair critically depends on the availability of data tailored for that condition. While cross-lingual transfer (XLT) methods have contributed to…

Computation and Language · Computer Science 2024-06-06 Seong Hoon Lim , Taejun Yun , Jinhyeon Kim , Jihun Choi , Taeuk Kim

Multilingual Large Language Models (LLMs) have recently shown great capabilities in a wide range of tasks, exhibiting state-of-the-art performance through zero-shot or few-shot prompting methods. While there have been extensive studies on…

Computation and Language · Computer Science 2023-10-24 Ruochen Zhang , Samuel Cahyawijaya , Jan Christian Blaise Cruz , Genta Indra Winata , Alham Fikri Aji

Machine-translated benchmarks are widely used to assess the multilingual capabilities of large language models (LLMs), yet translation errors in these benchmarks remain underexplored, raising concerns about the reliability and comparability…

Computation and Language · Computer Science 2026-05-26 Klaudia-Doris Thellmann , Bernhard Stadler , Michael Färber , Jens Lehmann

Existing large language models (LLMs) for machine translation are typically fine-tuned on sentence-level translation instructions and achieve satisfactory performance at the sentence level. However, when applied to document-level…

Computation and Language · Computer Science 2024-01-17 Yachao Li , Junhui Li , Jing Jiang , Min Zhang

Multilingual large language models (MLLMs) are jointly trained on data from many different languages such that representation of individual languages can benefit from other languages' data. Impressive performance on zero-shot cross-lingual…

Computation and Language · Computer Science 2024-05-22 Rochelle Choenni , Dan Garrette , Ekaterina Shutova

Machine transliteration is a method for automatically converting words in one language into phonetically equivalent ones in another language. Machine transliteration plays an important role in natural language applications such as…

Computation and Language · Computer Science 2011-10-10 K. Choi , H. Isahara , J. Oh

Parallel corpora play an important role in training machine translation (MT) models, particularly for low-resource languages where high-quality bilingual data is scarce. This review provides a comprehensive overview of available parallel…

Computation and Language · Computer Science 2025-04-23 Rahul Raja , Arpita Vats

Large language models (LLMs) have led to a surge in collaborative writing with model assistance. As different users incorporate suggestions from the same model, there is a risk of decreased diversity in the produced content, potentially…

Computation and Language · Computer Science 2024-07-02 Vishakh Padmakumar , He He

Language is far more than a communication tool. A wealth of information - including but not limited to the identities, psychological states, and social contexts of its users - can be gleaned through linguistic markers, and such insights are…

In-context machine translation (MT) with large language models (LLMs) is a promising approach for low-resource MT, as it can readily take advantage of linguistic resources such as grammar books and dictionaries. Such resources are usually…

Computation and Language · Computer Science 2025-05-30 Renhao Pei , Yihong Liu , Peiqin Lin , François Yvon , Hinrich Schütze

Recent studies have highlighted the potential of exploiting parallel corpora to enhance multilingual large language models, improving performance in both bilingual tasks, e.g., machine translation, and general-purpose tasks, e.g., text…

Computation and Language · Computer Science 2025-02-11 Peiqin Lin , André F. T. Martins , Hinrich Schütze

Multilingual Large Language Models (LLMs) can process many languages, yet how they internally represent this diversity remains unclear. Do they form shared multilingual representations with language-specific decoding, and if so, why does…

Computation and Language · Computer Science 2026-02-10 Abir Harrasse , Florent Draye , Punya Syon Pandey , Zhijing Jin , Bernhard Schölkopf

As instruction-tuned large language models (LLMs) gain global adoption, their ability to follow instructions in multiple languages becomes increasingly crucial. In this work, we investigate how multilinguality during instruction tuning of a…

Computation and Language · Computer Science 2024-05-22 Uri Shaham , Jonathan Herzig , Roee Aharoni , Idan Szpektor , Reut Tsarfaty , Matan Eyal

In this work, we study whether multilingual language models (MultiLMs) can transfer logical reasoning abilities to other languages when they are fine-tuned for reasoning in a different language. We evaluate the cross-lingual reasoning…

Computation and Language · Computer Science 2023-10-25 Negar Foroutan , Mohammadreza Banaei , Karl Aberer , Antoine Bosselut

Most languages lack sufficient data for large-scale monolingual pretraining, creating a "data wall." Multilingual pretraining helps but is limited by language imbalance and the "curse of multilinguality." An alternative is to translate…

Computation and Language · Computer Science 2025-09-23 Dan John Velasco , Matthew Theodore Roque

While multilingual language models (MLMs) have been trained on 100+ languages, they are typically only evaluated across a handful of them due to a lack of available test data in most languages. This is particularly problematic when…

Computation and Language · Computer Science 2024-06-21 Rochelle Choenni , Sara Rajaee , Christof Monz , Ekaterina Shutova

Cross-lingual semantic textual similarity systems estimate the degree of the meaning similarity between two sentences, each in a different language. State-of-the-art algorithms usually employ machine translation and combine vast amount of…

Computation and Language · Computer Science 2018-07-12 Tomáš Brychcín