English
Related papers

Related papers: Analyzing the Evaluation of Cross-Lingual Knowledg…

200 papers

Instruction tuning (IT) is widely used to teach pretrained large language models (LLMs) to follow arbitrary instructions, but is under-studied in multilingual settings. In this work, we conduct a systematic study of zero-shot cross-lingual…

Computation and Language · Computer Science 2024-04-23 Nadezhda Chirkova , Vassilina Nikoulina

While recent work on multilingual language models has demonstrated their capacity for cross-lingual zero-shot transfer on downstream tasks, there is a lack of consensus in the community as to what shared properties between languages enable…

Computation and Language · Computer Science 2022-05-05 Ameet Deshpande , Partha Talukdar , Karthik Narasimhan

Large language models (LLMs) have exerted a considerable impact on diverse language-related tasks in recent years. Their demonstrated state-of-the-art performance is achieved through methodologies such as zero-shot or few-shot prompting.…

Computation and Language · Computer Science 2023-12-21 Arshad Kaji , Manan Shah

Multilingual Large Language Models (LLMs) achieve remarkable levels of zero-shot cross-lingual transfer performance. We speculate that this is predicated on their ability to align languages without explicit supervision from parallel…

Computation and Language · Computer Science 2024-06-21 Hetong Wang , Pasquale Minervini , Edoardo M. Ponti

A model's capacity to generalize its knowledge to interpret unseen inputs with different characteristics is crucial to build robust and reliable machine learning systems. Language model evaluation tasks lack information metrics about model…

Computation and Language · Computer Science 2024-09-10 Saksham Bassi , Duygu Ataman , Kyunghyun Cho

We explore the transferability of a multilingual neural machine translation model to unseen languages when the transfer is grounded solely on the cross-lingual word embeddings. Our experimental results show that the translation knowledge…

Computation and Language · Computer Science 2020-11-04 Shifei Chen , Ali Basirat

Zero-shot cross-lingual transfer learning has been shown to be highly challenging for tasks involving a lot of linguistic specificities or when a cultural gap is present between languages, such as in hate speech detection. In this paper, we…

Computation and Language · Computer Science 2022-10-26 Syrielle Montariol , Arij Riabi , Djamé Seddah

Multi-lingual language models (LM), such as mBERT, XLM-R, mT5, mBART, have been remarkably successful in enabling natural language tasks in low-resource languages through cross-lingual transfer from high-resource ones. In this work, we try…

Computation and Language · Computer Science 2022-12-06 Benjamin Muller , Deepanshu Gupta , Siddharth Patwardhan , Jean-Philippe Fauconnier , David Vandyke , Sachin Agarwal

Zero-shot cross-lingual transfer by fine-tuning multilingual pretrained models shows promise for low-resource languages, but often suffers from misalignment of internal representations between languages. We hypothesize that even when the…

Computation and Language · Computer Science 2024-09-18 Ryokan Ri , Shun Kiyono , Sho Takase

Zero-shot cross-lingual transfer is when a multilingual model is trained to perform a task in one language and then is applied to another language. Although the zero-shot cross-lingual transfer approach has achieved success in various…

Computation and Language · Computer Science 2023-05-30 Tianjian Li , Kenton Murray

Phrase break prediction is a crucial task for improving the prosody naturalness of a text-to-speech (TTS) system. However, most proposed phrase break prediction models are monolingual, trained exclusively on a large amount of labeled data.…

Computation and Language · Computer Science 2023-06-06 Hoyeon Lee , Hyun-Wook Yoon , Jong-Hwan Kim , Jae-Min Kim

Probabilistic topic modeling is a popular choice as the first step of crosslingual tasks to enable knowledge transfer and extract multilingual features. While many multilingual topic models have been developed, their assumptions on the…

Computation and Language · Computer Science 2019-06-11 Shudong Hao , Michael J. Paul

Zero-shot cross-lingual knowledge transfer enables a multilingual pretrained language model, finetuned on a task in one language, make predictions for this task in other languages. While being broadly studied for natural language…

Computation and Language · Computer Science 2024-04-23 Nadezhda Chirkova , Vassilina Nikoulina

Recent work in cross-lingual semantic parsing has successfully applied machine translation to localize parsers to new languages. However, these advances assume access to high-quality machine translation systems and word alignment tools. We…

Computation and Language · Computer Science 2022-03-08 Tom Sherborne , Mirella Lapata

We introduce the task of zero-shot style transfer between different languages. Our training data includes multilingual parallel corpora, but does not contain any parallel sentences between styles, similarly to the recent previous work. We…

Computation and Language · Computer Science 2018-08-02 Elizaveta Korotkova , Maksym Del , Mark Fishel

Although Automatic Speech Recognition (ASR) systems have achieved human-like performance for a few languages, the majority of the world's languages do not have usable systems due to the lack of large speech datasets to train these models.…

Computation and Language · Computer Science 2022-02-28 Hemant Yadav , Sunayana Sitaram

Cross-lingual consistency should be considered to assess cross-lingual transferability, maintain the factuality of the model knowledge across languages, and preserve the parity of language model performance. We are thus interested in…

Computation and Language · Computer Science 2025-10-02 Xi Ai , Mahardika Krisna Ihsani , Min-Yen Kan

Prior work on multilingual question answering has mostly focused on using large multilingual pre-trained language models (LM) to perform zero-shot language-wise learning: train a QA model on English and test on other languages. In this…

Computation and Language · Computer Science 2020-12-14 Mihaela Bornea , Lin Pan , Sara Rosenthal , Radu Florian , Avirup Sil

Transfer learning based on pretraining language models on a large amount of raw data has become a new norm to reach state-of-the-art performance in NLP. Still, it remains unclear how this approach should be applied for unseen languages that…

Computation and Language · Computer Science 2021-04-20 Benjamin Muller , Antonis Anastasopoulos , Benoît Sagot , Djamé Seddah

Pretrained multilingual models enable zero-shot learning even for unseen languages, and that performance can be further improved via adaptation prior to finetuning. However, it is unclear how the number of pretraining languages influences a…

Computation and Language · Computer Science 2022-03-22 Yoshinari Fujinuma , Jordan Boyd-Graber , Katharina Kann