中文
相关论文

相关论文: A Three-Pronged Approach to Cross-Lingual Adaptati…

200 篇论文

Despite advances in the multilingual capabilities of Large Language Models (LLMs), their performance varies substantially across different languages and tasks. In multilingual retrieval-augmented generation (RAG)-based systems, knowledge…

计算与语言 · 计算机科学 2025-08-01 Aman Gupta , Yingying Zhuang , Zhou Yu , Ziji Zhang , Anurag Beniwal

Large language models (LLMs) are very proficient text generators. We leverage this capability of LLMs to generate task-specific data via zero-shot prompting and promote cross-lingual transfer for low-resource target languages. Given…

计算与语言 · 计算机科学 2024-07-16 Barah Fazili , Ashish Sunil Agrawal , Preethi Jyothi

Multilingual Large Language Models (MLLMs) represent a pivotal advancement in democratizing artificial intelligence across linguistic boundaries. While theoretical foundations are well-established, practical implementation guidelines remain…

计算与语言 · 计算机科学 2024-10-24 Junhua Liu , Bin Fu

In fine-tuning large language models (LLMs), conserving computational resources while maintaining effectiveness and improving outcomes within the same computational constraints is crucial. The Low-Rank Adaptation (LoRA) strategy balances…

机器学习 · 计算机科学 2024-09-05 Xiaojun Xiao , Sen Shen , Qiming Bao , Hongfei Rong , Kairui Liu , Zhongsheng Wang , Jiamou Liu

Adapting large language models (LLMs) to low-resource languages (LRLs) is constrained by the scarcity of task data and computational resources. Although Proxy Tuning offers a logit-level strategy for introducing scaling effects, it often…

计算与语言 · 计算机科学 2026-04-21 Chen Zhang , Jiuheng Lin , Zhiyuan Liao , Yansong Feng

Cross-lingual knowledge transfer, especially between high- and low-resource languages, remains challenging in natural language processing (NLP). This study offers insights for improving cross-lingual NLP applications through the combination…

计算与语言 · 计算机科学 2025-06-13 Ivan Vykopal , Simon Ostermann , Marián Šimko

This paper explores the integration of graph knowledge from linguistic ontologies into multilingual Large Language Models (LLMs) using adapters to improve performance for low-resource languages (LRLs) in sentiment analysis (SA) and named…

计算与语言 · 计算机科学 2024-12-19 Daniil Gurgurov , Mareike Hartmann , Simon Ostermann

Instruction-tuned Large Language Models (LLMs) underperform on low resource, non-Latin scripts due to tokenizer fragmentation and weak cross-lingual coupling. We present LLINK (Latent Language Injection for Non-English Knowledge), a compute…

计算与语言 · 计算机科学 2025-11-03 Rajan Agarwal , Aarush Gupta

What can pre-trained multilingual sequence-to-sequence models like mBART contribute to translating low-resource languages? We conduct a thorough empirical experiment in 10 languages to ascertain this, considering five factors: (1) the…

Large Language Models (LLMs) consistently under perform in low-resource linguistic contexts such as Konkani. This performance deficit stems from acute training data scarcity compounded by high script diversity across Devanagari, Romi and…

计算与语言 · 计算机科学 2026-03-26 Reuben Chagas Fernandes , Gaurang S. Patkar

To democratize large language models (LLMs) to most natural languages, it is imperative to make these models capable of understanding and generating texts in many languages, in particular low-resource ones. While recent multilingual LLMs…

计算与语言 · 计算机科学 2024-06-05 Wen Lai , Mohsen Mesgar , Alexander Fraser

The current state-of-the-art for few-shot cross-lingual transfer learning first trains on abundant labeled data in the source language and then fine-tunes with a few examples on the target language, termed target-adapting. Though this has…

计算与语言 · 计算机科学 2022-05-02 Haoran Xu , Kenton Murray

The integration of large language models (LLMs) into automated algorithm design has shown promising potential. A prevalent approach embeds LLMs within search routines to iteratively generate and refine candidate algorithms. However, most…

机器学习 · 计算机科学 2026-05-20 Fei Liu , Rui Zhang , Xi Lin , Zhichao Lu , Qingfu Zhang

While multilingual large language models generally perform adequately, and sometimes even rival English performance on high-resource languages (HRLs), they often significantly underperform on low-resource languages (LRLs). Among several…

计算与语言 · 计算机科学 2025-10-09 Yilei Tu , Andrew Xue , Freda Shi

Despite the significant improvements achieved by large language models (LLMs) in English reasoning tasks, these models continue to struggle with multilingual reasoning. Recent studies leverage a full-parameter and two-stage training…

计算与语言 · 计算机科学 2025-01-08 Yuchun Fan , Yongyu Mu , Yilin Wang , Lei Huang , Junhao Ruan , Bei Li , Tong Xiao , Shujian Huang , Xiaocheng Feng , Jingbo Zhu

Large Language Models (LLMs) have shown remarkable capabilities in natural language processing but exhibit significant performance gaps among different languages. Most existing approaches to address these disparities rely on pretraining or…

计算与语言 · 计算机科学 2024-10-17 Weixuan Wang , Minghao Wu , Barry Haddow , Alexandra Birch

While recent benchmarks have spurred a lot of new work on improving the generalization of pretrained multilingual language models on multilingual tasks, techniques to improve code-switched natural language understanding tasks have been far…

计算与语言 · 计算机科学 2021-07-22 Archiki Prasad , Mohammad Ali Rehan , Shreya Pathak , Preethi Jyothi

The 2025 Multimodal Models for Low-Resource Contexts and Social Impact (MMLoSo) Language Challenge addresses one of India's most pressing linguistic gaps: the lack of resources for its diverse low-resource languages (LRLs). In this study,…

Existing large language models show disparate capability across different languages, due to the imbalance in the training data. Their performances on English tasks are often stronger than on tasks of other languages. In this paper, we…

计算与语言 · 计算机科学 2023-10-10 Wenhao Zhu , Yunzhe Lv , Qingxiu Dong , Fei Yuan , Jingjing Xu , Shujian Huang , Lingpeng Kong , Jiajun Chen , Lei Li

This work investigates the in-context learning abilities of pretrained large language models (LLMs) when instructed to translate text from a low-resource language into a high-resource language as part of an automated machine translation…

计算与语言 · 计算机科学 2024-10-28 Sara Court , Micha Elsner