English
Related papers

Related papers: Breaking the Script Barrier in Multilingual Pre-Tr…

200 papers

Recent studies have shown that post-aligning multilingual pretrained language models (mPLMs) using alignment objectives on both original and transliterated data can improve crosslingual alignment. This improvement further leads to better…

Computation and Language · Computer Science 2024-12-17 Yihong Liu , Mingyang Wang , Amir Hossein Kargaran , Ayyoob Imani , Orgest Xhelili , Haotian Ye , Chunlan Ma , François Yvon , Hinrich Schütze

Transliterating related languages that use different scripts into a common script is effective for improving crosslingual transfer in downstream tasks. However, this methodology often makes pretraining a model from scratch unavoidable, as…

Computation and Language · Computer Science 2024-12-17 Yihong Liu , Chunlan Ma , Haotian Ye , Hinrich Schütze

Large language models demonstrate reasonable multilingual abilities, despite predominantly English-centric pretraining. However, the spontaneous multilingual alignment in these models is shown to be weak, leading to unsatisfactory…

Computation and Language · Computer Science 2024-11-19 Jiahuan Li , Shujian Huang , Aarron Ching , Xinyu Dai , Jiajun Chen

Though the pre-trained contextualized language model (PrLM) has made a significant impact on NLP, training PrLMs in languages other than English can be impractical for two reasons: other languages often lack corpora sufficient for training…

Computation and Language · Computer Science 2021-07-28 Zuchao Li , Kevin Parnow , Hai Zhao , Zhuosheng Zhang , Rui Wang , Masao Utiyama , Eiichiro Sumita

Pretrained language models (PLMs) display impressive performances and have captured the attention of the NLP community. Establishing best practices in pretraining has, therefore, become a major focus of NLP research, especially since…

Computation and Language · Computer Science 2024-10-08 Zihao Li , Shaoxiong Ji , Timothee Mickus , Vincent Segonne , Jörg Tiedemann

Transliteration is a task in the domain of NLP where the output word is a similar-sounding word written using the letters of any foreign language. Today this system has been developed for several language pairs that involve English as…

Computation and Language · Computer Science 2022-08-24 Yash Raj , Bhavesh Laddagiri

Large multilingual pretrained language models (mPLMs) have become the de facto state of the art for cross-lingual transfer in NLP. However, their large-scale deployment to many languages, besides pretraining data scarcity, is also hindered…

Computation and Language · Computer Science 2023-04-19 Sukannya Purkayastha , Sebastian Ruder , Jonas Pfeiffer , Iryna Gurevych , Ivan Vulić

Cross-lingual transfer in NLP is often hindered by the ``script barrier'' where differences in writing systems inhibit transfer learning between languages. Transliteration, the process of converting the script, has emerged as a powerful…

Computation and Language · Computer Science 2026-04-22 Thanmay Jayakumar , Deepon Halder , Raj Dabre

Most Transformer language models are primarily pretrained on English text, limiting their use for other languages. As the model sizes grow, the performance gap between English and other languages with fewer compute and data resources…

Computation and Language · Computer Science 2023-01-24 Malte Ostendorff , Georg Rehm

Transliteration has emerged as a promising means to bridge the gap between various languages in multilingual NLP, showing promising results especially for languages using non-Latin scripts. We investigate the degree to which shared script,…

Computation and Language · Computer Science 2026-03-25 Haeji Jung , Jinju Kim , Kyungjin Kim , Youjeong Roh , David R. Mortensen

While large language models demonstrate remarkable capabilities at task-specific applications through fine-tuning, extending these benefits across diverse languages is essential for broad accessibility. However, effective cross-lingual…

Computation and Language · Computer Science 2025-06-03 Danni Liu , Jan Niehues

Script diversity presents a challenge to Multilingual Language Models (MLLM) by reducing lexical overlap among closely related languages. Therefore, transliterating closely related languages that use different writing scripts to a common…

Computation and Language · Computer Science 2023-08-01 Ibraheem Muhammad Moosa , Mahmud Elahi Akhter , Ashfia Binte Habib

Massively multilingual language models such as multilingual BERT offer state-of-the-art cross-lingual transfer performance on a range of NLP tasks. However, due to limited capacity and large differences in pretraining data sizes, there is a…

Computation and Language · Computer Science 2021-09-13 Jonas Pfeiffer , Ivan Vulić , Iryna Gurevych , Sebastian Ruder

Multilingual pre-trained language models (PLMs) have demonstrated impressive performance on several downstream tasks for both high-resourced and low-resourced languages. However, there is still a large performance drop for languages unseen…

Computation and Language · Computer Science 2022-10-19 Jesujoba O. Alabi , David Ifeoluwa Adelani , Marius Mosbach , Dietrich Klakow

Recent multilingual pretrained language models (mPLMs) have been shown to encode strong language-specific signals, which are not explicitly provided during pretraining. It remains an open question whether it is feasible to employ mPLMs to…

Computation and Language · Computer Science 2024-07-08 Peiqin Lin , Chengzhi Hu , Zheyu Zhang , André F. T. Martins , Hinrich Schütze

The world's more than 7000 languages are written in at least 293 scripts. Due to various reasons, many closely related languages use different scripts, which poses a difficulty for multilingual pretrained language models (mPLMs) in learning…

Computation and Language · Computer Science 2024-05-24 Yihong Liu , Chunlan Ma , Haotian Ye , Hinrich Schütze

The success of pretrained cross-lingual language models relies on two essential abilities, i.e., generalization ability for learning downstream tasks in a source language, and cross-lingual transferability for transferring the task…

Computation and Language · Computer Science 2021-09-24 Zewen Chi , Heyan Huang , Luyang Liu , Yu Bai , Xian-Ling Mao

Although multilingual language models exhibit impressive cross-lingual transfer capabilities on unseen languages, the performance on downstream tasks is impacted when there is a script disparity with the languages used in the multilingual…

Computation and Language · Computer Science 2025-08-18 Kurt Micallef , Nizar Habash , Claudia Borg , Fadhl Eryani , Houda Bouamor

Transfer learning based on pretraining language models on a large amount of raw data has become a new norm to reach state-of-the-art performance in NLP. Still, it remains unclear how this approach should be applied for unseen languages that…

Computation and Language · Computer Science 2021-04-20 Benjamin Muller , Antonis Anastasopoulos , Benoît Sagot , Djamé Seddah

Pretrained multilingual models (PMMs) enable zero-shot learning via cross-lingual transfer, performing best for languages seen during pretraining. While methods exist to improve performance for unseen languages, they have almost exclusively…

Computation and Language · Computer Science 2021-06-07 Abteen Ebrahimi , Katharina Kann
‹ Prev 1 2 3 10 Next ›