English
Related papers

Related papers: Multilingual Knowledge Transfer under Data Constra…

200 papers

Large language models (LLMs) are very proficient text generators. We leverage this capability of LLMs to generate task-specific data via zero-shot prompting and promote cross-lingual transfer for low-resource target languages. Given…

Computation and Language · Computer Science 2024-07-16 Barah Fazili , Ashish Sunil Agrawal , Preethi Jyothi

Large language models (LLMs) that are tuned with instructions have demonstrated remarkable capabilities in various tasks and languages. However, their ability to generalize to underrepresented languages is limited due to the scarcity of…

Computation and Language · Computer Science 2023-10-25 Samuel Cahyawijaya , Holy Lovenia , Tiezheng Yu , Willy Chung , Pascale Fung

The development of state-of-the-art generative large language models (LLMs) disproportionately relies on English-centric tokenizers, vocabulary and pre-training data. Despite the fact that some LLMs have multilingual capabilities, recent…

Computation and Language · Computer Science 2024-09-27 Atsuki Yamaguchi , Aline Villavicencio , Nikolaos Aletras

Large language models (LLMs) are at the forefront of transforming numerous domains globally. However, their inclusivity and effectiveness remain limited for non-Latin scripts and low-resource languages. This paper tackles the imperative…

Computation and Language · Computer Science 2025-01-08 Somnath Kumar , Vaibhav Balloli , Mercy Ranjit , Kabir Ahuja , Tanuja Ganu , Sunayana Sitaram , Kalika Bali , Akshay Nambi

Pre-trained large language models (LLMs) have become a cornerstone of modern natural language processing, with their capabilities extending across a wide range of applications and languages. However, the fine-tuning of multilingual LLMs,…

Computation and Language · Computer Science 2025-07-08 Wanru Zhao , Yihong Chen , Royson Lee , Xinchi Qiu , Yan Gao , Hongxiang Fan , Nicholas D. Lane

This paper addresses the limited transfer and adaptation capabilities of large language models in low-resource language scenarios. It proposes a unified framework that combines a knowledge transfer module with parameter-efficient…

Computation and Language · Computer Science 2025-07-03 Shuangquan Lyu , Yingnan Deng , Guiran Liu , Zhen Qi , Ruotong Wang

Hierarchical attention networks have recently achieved remarkable performance for document classification in a given language. However, when multilingual document collections are considered, training such models separately for each language…

Computation and Language · Computer Science 2017-09-18 Nikolaos Pappas , Andrei Popescu-Belis

Cross-lingual transfer is an effective way to build syntactic analysis tools in low-resource languages. However, transfer is difficult when transferring to typologically distant languages, especially when neither annotated target data nor…

Computation and Language · Computer Science 2021-04-30 Junxian He , Zhisong Zhang , Taylor Berg-Kirkpatrick , Graham Neubig

We propose a method to transfer knowledge across neural machine translation (NMT) models by means of a shared dynamic vocabulary. Our approach allows to extend an initial model for a given language pair to cover new languages by adapting…

Computation and Language · Computer Science 2018-11-06 Surafel M. Lakew , Aliia Erofeeva , Matteo Negri , Marcello Federico , Marco Turchi

Multi-Source cross-lingual transfer learning deals with the transfer of task knowledge from multiple labelled source languages to an unlabeled target language under the language shift. Existing methods typically focus on weighting the…

Computation and Language · Computer Science 2024-03-08 Ling Ge , Chunming Hu , Guanghui Ma , Jihong Liu , Hong Zhang

Multilingual large language models (LLMs) often demonstrate a performance gap between English and non-English languages, particularly in low-resource settings. Aligning these models to low-resource languages is essential yet challenging due…

Computation and Language · Computer Science 2025-10-16 Rakesh Paul , Anusha Kamath , Kanishk Singla , Raviraj Joshi , Utkarsh Vaidya , Sanjay Singh Chauhan , Niranjan Wartikar

Large language models (LLMs), with their powerful generative capabilities and vast knowledge, empower various tasks in everyday life. However, these abilities are primarily concentrated in high-resource languages, leaving low-resource…

Computation and Language · Computer Science 2024-12-20 Shaolei Zhang , Kehao Zhang , Qingkai Fang , Shoutao Guo , Yan Zhou , Xiaodong Liu , Yang Feng

We describe a simple but effective method for cross-lingual syntactic transfer of dependency parsers, in the scenario where a large amount of translation data is not available. The method makes use of three steps: 1) a method for deriving…

Computation and Language · Computer Science 2017-02-07 Mohammad Sadegh Rasooli , Michael Collins

Effective data selection is essential for pretraining large language models (LLMs), enhancing efficiency and improving generalization to downstream tasks. However, existing approaches often require leveraging external pretrained models,…

Machine Learning · Computer Science 2026-02-04 Jie Hao , Rui Yu , Wei Zhang , Huixia Wang , Jie Xu , Mingrui Liu

In this paper, we introduce the approach behind our submission for the MIRACL challenge, a WSDM 2023 Cup competition that centers on ad-hoc retrieval across 18 diverse languages. Our solution contains two neural-based models. The first…

Information Retrieval · Computer Science 2023-02-28 Zhiqi Huang , Puxuan Yu , James Allan

As global demand for multilingual large language models (LLMs) grows, most LLMs still remain overly focused on English, leading to the limited access to advanced AI for non-English speakers. Current methods to enhance multilingual…

Computation and Language · Computer Science 2025-05-27 Weixiang Zhao , Yulin Hu , Jiahe Guo , Xingyu Sui , Tongtong Wu , Yang Deng , Yanyan Zhao , Bing Qin , Wanxiang Che , Ting Liu

Transferring information retrieval (IR) models from a high-resource language (typically English) to other languages in a zero-shot fashion has become a widely adopted approach. In this work, we show that the effectiveness of zero-shot…

Computation and Language · Computer Science 2023-05-29 Robert Litschko , Ekaterina Artemova , Barbara Plank

Cross-lingual transfer learning from high-resource to medium and low-resource languages has shown encouraging results. However, the scarcity of resources in target languages remains a challenge. In this work, we resort to data augmentation…

Computation and Language · Computer Science 2023-11-06 Gretel Liz De la Peña Sarracén , Paolo Rosso , Robert Litschko , Goran Glavaš , Simone Paolo Ponzetto

Low-resource languages, by its very definition, tend to be under represented in the pre-training corpora of Large Language Models. In this work, we investigate three low-resource cross-lingual approaches that enable an LLM adapt to tasks in…

Computation and Language · Computer Science 2024-06-26 Vaibhav Singh , Amrith Krishna , Karthika NJ , Ganesh Ramakrishnan

Multilingual pre-trained language models (MPLMs) not only can handle tasks in different languages but also exhibit surprising zero-shot cross-lingual transferability. However, MPLMs usually are not able to achieve comparable supervised…

Computation and Language · Computer Science 2022-03-01 Ziqing Yang , Yiming Cui , Zhigang Chen , Shijin Wang