English
Related papers

Related papers: Cross-lingual Language Model Pretraining

200 papers

Large language models (LLMs) showcase increasingly impressive English benchmark scores, however their performance profiles remain inconsistent across multilingual settings. To address this gap, we introduce PolyPrompt, a novel,…

Computation and Language · Computer Science 2025-06-04 Nathan Roll

Although recent Massively Multilingual Language Models (MMLMs) like mBERT and XLMR support around 100 languages, most existing multilingual NLP benchmarks provide evaluation data in only a handful of these languages with little linguistic…

Computation and Language · Computer Science 2022-11-15 Kabir Ahuja , Sandipan Dandapat , Sunayana Sitaram , Monojit Choudhury

Pre-trained multilingual language models such as mBERT have shown immense gains for several natural language processing (NLP) tasks, especially in the zero-shot cross-lingual setting. Most, if not all, of these pre-trained models rely on…

Computation and Language · Computer Science 2020-10-26 Aditi Chaudhary , Karthik Raman , Krishna Srinivasan , Jiecao Chen

Pre-trained language models (PLMs) have achieved remarkable success in natural language generation (NLG) tasks. Up to now, most NLG-oriented PLMs are pre-trained in an unsupervised manner using the large-scale general corpus. In the…

Computation and Language · Computer Science 2023-05-30 Tianyi Tang , Junyi Li , Wayne Xin Zhao , Ji-Rong Wen

While monolingual data has been shown to be useful in improving bilingual neural machine translation (NMT), effectively and efficiently leveraging monolingual data for Multilingual NMT (MNMT) systems is a less explored area. In this work,…

Computation and Language · Computer Science 2020-10-07 Yiren Wang , ChengXiang Zhai , Hany Hassan Awadalla

Open-source large language models (LLMs) have gained significant strength across diverse fields. Nevertheless, the majority of studies primarily concentrate on English, with only limited exploration into the realm of multilingual abilities.…

Computation and Language · Computer Science 2024-02-20 Haoyu Wang , Shuo Wang , Yukun Yan , Xujia Wang , Zhiyu Yang , Yuzhuang Xu , Zhenghao Liu , Liner Yang , Ning Ding , Xu Han , Zhiyuan Liu , Maosong Sun

Pre-training models on vast quantities of unlabeled data has emerged as an effective approach to improving accuracy on many NLP tasks. On the other hand, traditional machine translation has a long history of leveraging unlabeled data…

Computation and Language · Computer Science 2020-11-17 Shruti Bhosale , Kyra Yee , Sergey Edunov , Michael Auli

Large language models (LLMs) have demonstrated significant progress in multilingual language understanding and generation. However, due to the imbalance in training data, their capabilities in non-English languages are limited. Recent…

Computation and Language · Computer Science 2025-03-06 Wenshuai Huo , Xiaocheng Feng , Yichong Huang , Chengpeng Fu , Baohang Li , Yangfan Ye , Zhirui Zhang , Dandan Tu , Duyu Tang , Yunfei Lu , Hui Wang , Bing Qin

In recent years, Large Language Models (LLMs) have achieved almost human-like performance on various tasks. While some LLMs have been trained on multilingual data, most of the training data is in English; hence, their performance in English…

Large-scale cross-lingual language models (LM), such as mBERT, Unicoder and XLM, have achieved great success in cross-lingual representation learning. However, when applied to zero-shot cross-lingual transfer tasks, most existing methods…

Computation and Language · Computer Science 2020-12-16 Yuwei Fang , Shuohang Wang , Zhe Gan , Siqi Sun , Jingjing Liu

Large Language Models (LLMs) have gained significant attention due to their high performance on a wide range of natural language tasks since the release of ChatGPT. The LLMs learn to understand and generate language by training billions of…

Computation and Language · Computer Science 2024-08-29 Wazir Ali , Sampo Pyysalo

Multilingual understanding models (or encoder-based), pre-trained via masked language modeling, have achieved promising results on many language understanding tasks (e.g., mBERT). However, these non-autoregressive (NAR) models still…

Computation and Language · Computer Science 2023-05-23 Bohong Wu , Fei Yuan , Hai Zhao , Lei Li , Jingjing Xu

In this paper, we elaborate upon recipes for building multilingual representation models that are not only competitive with existing state-of-the-art models but are also more parameter efficient, thereby promoting better adoption in…

Computation and Language · Computer Science 2022-10-27 Barun Patra , Saksham Singhal , Shaohan Huang , Zewen Chi , Li Dong , Furu Wei , Vishrav Chaudhary , Xia Song

Generative Large Language Models (LLMs) have achieved remarkable advancements in various NLP tasks. However, these advances have not been reflected in the translation task, especially those with moderate model sizes (i.e., 7B or 13B…

Computation and Language · Computer Science 2024-02-07 Haoran Xu , Young Jin Kim , Amr Sharaf , Hany Hassan Awadalla

Research in multilingual speech-to-text translation is topical. Having a single model that supports multiple translation tasks is desirable. The goal of this work it to improve cross-lingual transfer learning in multilingual speech-to-text…

Computation and Language · Computer Science 2024-01-26 Sameer Khurana , Nauman Dawalatabad , Antoine Laurent , Luis Vicente , Pablo Gimeno , Victoria Mingote , James Glass

Multilingual large language models (MLLMs) have shown impressive capabilities across a variety of languages. However, efficacy can differ greatly between different language families, especially for those with limited linguistic resources.…

Computation and Language · Computer Science 2025-01-23 Xin Huang , Tarun Kumar Vangani , Minh Duc Pham , Xunlong Zou , Bin Wang , Zhengyuan Liu , Ai Ti Aw

Language model pre-training has shown promising results in various downstream tasks. In this context, we introduce a cross-modal pre-trained language model, called Speech-Text BERT (ST-BERT), to tackle end-to-end spoken language…

Computation and Language · Computer Science 2021-04-13 Minjeong Kim , Gyuwan Kim , Sang-Woo Lee , Jung-Woo Ha

Large Language Models (LLMs) have achieved remarkable success in Natural Language Processing (NLP), yet their cross-lingual performance consistency remains a significant challenge. This paper introduces a novel methodology for efficiently…

Computation and Language · Computer Science 2025-05-27 Zixiang Xu , Yanbo Wang , Yue Huang , Xiuying Chen , Jieyu Zhao , Meng Jiang , Xiangliang Zhang

This paper explores cost-efficient methods to adapt pretrained Large Language Models (LLMs) to new lower-resource languages, with a specific focus on Estonian. Leveraging the Llama 2 model, we investigate the impact of combining…

Computation and Language · Computer Science 2024-07-03 Hele-Andra Kuulmets , Taido Purason , Agnes Luhtaru , Mark Fishel

Enhancing the complex reasoning capabilities of Large Language Models (LLMs) attracts widespread attention. While reinforcement learning (RL) has shown superior performance for improving complex reasoning, its impact on cross-lingual…

Computation and Language · Computer Science 2025-09-30 Shulin Huang , Yiran Ding , Junshu Pan , Yue Zhang