English
Related papers

Related papers: Model Selection for Cross-Lingual Transfer

200 papers

Recent state-of-the-art language models utilize a two-phase training procedure comprised of (i) unsupervised pre-training on unlabeled text, and (ii) fine-tuning for a specific supervised task. More recently, many studies have been focused…

Computation and Language · Computer Science 2019-11-15 Itzik Malkiel , Lior Wolf

Pretrained multilingual models enable zero-shot learning even for unseen languages, and that performance can be further improved via adaptation prior to finetuning. However, it is unclear how the number of pretraining languages influences a…

Computation and Language · Computer Science 2022-03-22 Yoshinari Fujinuma , Jordan Boyd-Graber , Katharina Kann

Word order variances generally exist in different languages. In this paper, we hypothesize that cross-lingual models that fit into the word order of the source language might fail to handle target languages. To verify this hypothesis, we…

Computation and Language · Computer Science 2020-12-09 Zihan Liu , Genta Indra Winata , Samuel Cahyawijaya , Andrea Madotto , Zhaojiang Lin , Pascale Fung

Recent advancements in NLP have given us models like mBERT and XLMR that can serve over 100 languages. The languages that these models are evaluated on, however, are very few in number, and it is unlikely that evaluation datasets will cover…

Computation and Language · Computer Science 2021-10-19 Anirudh Srinivasan , Sunayana Sitaram , Tanuja Ganu , Sandipan Dandapat , Kalika Bali , Monojit Choudhury

Learned metrics such as BLEURT have in recent years become widely employed to evaluate the quality of machine translation systems. Training such metrics requires data which can be expensive and difficult to acquire, particularly for…

Computation and Language · Computer Science 2023-02-08 Amirkeivan Mohtashami , Mauro Verzetti , Paul K. Rubenstein

While pretrained models such as BERT have shown large gains across natural language understanding tasks, their performance can be improved by further training the model on a data-rich intermediate task, before fine-tuning it on a target…

Substantial improvements have been made in machine reading comprehension, where the machine answers questions based on a given context. Current state-of-the-art models even surpass human performance on several benchmarks. However, their…

Computation and Language · Computer Science 2021-05-11 Wei-Cheng Huang , Chien-yu Huang , Hung-yi Lee

We study the power of cross-attention in the Transformer architecture within the context of transfer learning for machine translation, and extend the findings of studies into cross-attention when training from scratch. We conduct a series…

Computation and Language · Computer Science 2021-09-15 Mozhdeh Gheini , Xiang Ren , Jonathan May

We study the selection of transfer languages for automatic abusive language detection. Instead of preparing a dataset for every language, we demonstrate the effectiveness of cross-lingual transfer learning for zero-shot abusive language…

Computation and Language · Computer Science 2022-06-07 Juuso Eronen , Michal Ptaszynski , Fumito Masui , Masaki Arata , Gniewosz Leliwa , Michal Wroczynski

Machine translation (MT) models used in industries with constantly changing topics, such as translation or news agencies, need to adapt to new data to maintain their performance over time. Our aim is to teach a pre-trained MT model to…

Computation and Language · Computer Science 2021-04-01 Farid Arthaud , Rachel Bawden , Alexandra Birch

Large pre-trained language models (LMs) such as GPT-3 have acquired a surprising ability to perform zero-shot learning. For example, to classify sentiment without any training examples, we can "prompt" the LM with the review and the label…

Computation and Language · Computer Science 2021-09-09 Ruiqi Zhong , Kristy Lee , Zheng Zhang , Dan Klein

In zero-shot cross-lingual transfer, a supervised NLP task trained on a corpus in one language is directly applicable to another language without any additional training. A source of cross-lingual transfer can be as straightforward as…

Computation and Language · Computer Science 2021-01-27 Hyunjin Choi , Judong Kim , Seongho Joe , Seungjai Min , Youngjune Gwon

Multilingual pre-trained language models (PLMs) have demonstrated impressive performance on several downstream tasks for both high-resourced and low-resourced languages. However, there is still a large performance drop for languages unseen…

Computation and Language · Computer Science 2022-10-19 Jesujoba O. Alabi , David Ifeoluwa Adelani , Marius Mosbach , Dietrich Klakow

Large Language Models (LLMs) have demonstrated remarkable abilities in general scenarios. Instruction finetuning empowers them to align with humans in various tasks. Nevertheless, the Diversity and Quality of the instruction data remain two…

Computation and Language · Computer Science 2024-07-09 Xingyuan Pan , Luyang Huang , Liyan Kang , Zhicheng Liu , Yu Lu , Shanbo Cheng

Many-to-one neural machine translation systems improve over one-to-one systems when training data is scarce. In this paper, we design and test a novel algorithm for selecting the language of minibatches when training such systems. The…

Computation and Language · Computer Science 2024-10-08 Àlex R. Atrio , Alexis Allemann , Ljiljana Dolamic , Andrei Popescu-Belis

Hate speech detection is a challenging problem with most of the datasets available in only one language: English. In this paper, we conduct a large scale analysis of multilingual hate speech in 9 languages from 16 different sources. We…

Social and Information Networks · Computer Science 2020-12-10 Sai Saketh Aluru , Binny Mathew , Punyajoy Saha , Animesh Mukherjee

Large language models (LLMs) have achieved state-of-the-art performance in various software engineering tasks, including error detection, clone detection, and code translation, primarily leveraging high-resource programming languages like…

Computation and Language · Computer Science 2025-06-11 Razan Baltaji , Saurabh Pujar , Louis Mandel , Martin Hirzel , Luca Buratti , Lav Varshney

Fine-tuning of pre-trained transformer networks such as BERT yield state-of-the-art results for text classification tasks. Typically, fine-tuning is performed on task-specific training datasets in a supervised manner. One can also fine-tune…

Computation and Language · Computer Science 2020-06-12 Gregor Wiedemann , Seid Muhie Yimam , Chris Biemann

When training multilingual machine translation (MT) models that can translate to/from multiple languages, we are faced with imbalanced training sets: some languages have much more training data than others. Standard practice is to up-sample…

Computation and Language · Computer Science 2020-09-08 Xinyi Wang , Yulia Tsvetkov , Graham Neubig

Multilingual transformer models like mBERT and XLM-RoBERTa have obtained great improvements for many NLP tasks on a variety of languages. However, recent works also showed that results from high-resource languages could not be easily…

Computation and Language · Computer Science 2020-10-08 Michael A. Hedderich , David Adelani , Dawei Zhu , Jesujoba Alabi , Udia Markus , Dietrich Klakow