中文
相关论文

相关论文: Vuyko Mistral: Adapting LLMs for Low-Resource Dial…

200 篇论文

In this paper, we examine the development and usage of six low-resource machine translation systems translating between the Ukrainian language and each of the official languages of the Baltic states. We developed these systems in reaction…

计算与语言 · 计算机科学 2022-09-29 Toms Bergmanis , Mārcis Pinnis

Translating from a standard language to its regional dialects is a significant NLP challenge due to scarce data and linguistic variation, a problem prominent in the Bengali language. This paper proposes and compares two novel RAG pipelines…

计算与语言 · 计算机科学 2025-12-17 K. M. Jubair Sami , Dipto Sumit , Ariyan Hossain , Farig Sadeque

This study investigates the challenges of translating low-resource languages by integrating Large Language Models (LLMs) with Retrieval-Augmented Generation (RAG). Various model configurations were tested on Hakka translations, with BLEU…

计算与语言 · 计算机科学 2025-05-19 Chen-Chi Chang , Chong-Fu Li , Chu-Hsuan Lee , Hung-Shin Lee

State-of-the-art machine translation (MT) systems are typically trained to generate the "standard" target language; however, many languages have multiple varieties (regional varieties, dialects, sociolects, non-native varieties) that are…

计算与语言 · 计算机科学 2021-10-19 Sachin Kumar , Antonios Anastasopoulos , Shuly Wintner , Yulia Tsvetkov

Low-resource languages (LRLs) often lack high-quality, large-scale datasets for training effective text embedding models, hindering their application in tasks like retrieval-augmented generation (RAG) and semantic search. In this work, we…

计算与语言 · 计算机科学 2026-03-25 Zaruhi Navasardyan , Spartak Bughdaryan , Bagrat Minasyan , Hrant Davtyan

The increase in technological adoption worldwide comes with demands for novel tools to be used by the general population. Large Language Models (LLMs) provide a great opportunity in this respect, but their capabilities remain limited for…

计算与语言 · 计算机科学 2025-10-13 Stefan Krsteski , Matea Tashkovska , Borjan Sazdov , Hristijan Gjoreski , Branislav Gerazov

Numerous recent work on unsupervised machine translation (UMT) implies that competent unsupervised translations of low-resource and unrelated languages, such as Nepali or Sinhala, are only possible if the model is trained in a massive…

计算与语言 · 计算机科学 2022-10-04 Xuan-Phi Nguyen , Shafiq Joty , Wu Kui , Ai Ti Aw

Machine translation (MT) systems that support low-resource languages often struggle on specialized domains. While researchers have proposed various techniques for domain adaptation, these approaches typically require model fine-tuning,…

计算与语言 · 计算机科学 2025-05-27 Raphaël Merx , Hanna Suominen , Lois Hong , Nick Thieberger , Trevor Cohn , Ekaterina Vylomova

Large Language Models (LLMs) demonstrate exceptional zero-shot capabilities in various NLP tasks, significantly enhancing user experience and efficiency. However, this advantage is primarily limited to resource-rich languages. For the…

计算与语言 · 计算机科学 2025-09-23 Wenhao Zhuang , Yuan Sun

In this survey, we systematically analyze techniques used to adapt large multimodal models (LMMs) for low-resource (LR) languages, examining approaches ranging from visual enhancement and data creation to cross-modal transfer and fusion…

计算与语言 · 计算机科学 2026-02-03 Marian Lupascu , Ana-Cristina Rogoz , Mihai Sorin Stupariu , Radu Tudor Ionescu

Evaluating machine translation (MT) for low-resource languages poses a persistent challenge, primarily due to the limited availability of high quality reference translations. This issue is further exacerbated in languages with multiple…

计算与语言 · 计算机科学 2025-05-20 Md. Atiqur Rahman , Sabrina Islam , Mushfiqul Haque Omi

Multilingual Neural Machine Translation (MNMT) for low-resource languages (LRL) can be enhanced by the presence of related high-resource languages (HRL), but the relatedness of HRL usually relies on predefined linguistic assumptions about…

计算与语言 · 计算机科学 2019-10-31 Surafel M. Lakew , Alina Karakanta , Marcello Federico , Matteo Negri , Marco Turchi

Creating multilingual LLMs poses a significant challenge. Pretraining or fine-tuning LLMs to adopt new languages is evidently very costly. Furthermore, there exist limitations concerning benchmark datasets and the metrics used to measure…

计算与语言 · 计算机科学 2024-04-08 Bibek Upadhayay , Vahid Behzadan

This study explores the use of large language models (LLMs) for translating English into Mambai, a low-resource Austronesian language spoken in Timor-Leste, with approximately 200,000 native speakers. Leveraging a novel corpus derived from…

计算与语言 · 计算机科学 2025-01-28 Raphaël Merx , Aso Mahmudi , Katrina Langford , Leo Alberto de Araujo , Ekaterina Vylomova

In this work, we evaluated Lithuanian and general history knowledge of multilingual Large Language Models (LLMs) on a multiple-choice question-answering task. The models were tested on a dataset of Lithuanian national and general history…

计算与语言 · 计算机科学 2025-01-17 Yevhen Kostiuk , Oxana Vitman , Łukasz Gagała , Artur Kiulian

The 2025 Multimodal Models for Low-Resource Contexts and Social Impact (MMLoSo) Language Challenge addresses one of India's most pressing linguistic gaps: the lack of resources for its diverse low-resource languages (LRLs). In this study,…

Multilingual Large Language Models (LLMs) often provide suboptimal performance on low-resource languages like Urdu. This paper introduces UrduLLaMA 1.0, a model derived from the open-source Llama-3.1-8B-Instruct architecture and continually…

计算与语言 · 计算机科学 2025-02-25 Layba Fiaz , Munief Hassan Tahir , Sana Shams , Sarmad Hussain

Leading large language models have demonstrated impressive capabilities in reasoning-intensive tasks, such as standardized educational testing. However, they often require extensive training in low-resource settings with inaccessible…

计算与语言 · 计算机科学 2025-03-19 Mykyta Syromiatnikov , Victoria Ruvinskaya , Nataliia Komleva

This paper examines the effectiveness of Large Language Models (LLMs) in translating the low-resource Lebanese dialect, focusing on the impact of culturally authentic data versus larger translated datasets. We compare three fine-tuning…

计算与语言 · 计算机科学 2025-05-02 Silvana Yakhni , Ali Chehab

Despite the widespread adoption of Large Language Models (LLMs), their strongest capabilities remain largely confined to a small number of high-resource languages for which there is abundant training data. Recently, continual pre-training…

计算与语言 · 计算机科学 2026-03-02 Eeham Khan , Firas Saidani , Owen Van Esbroeck , Richard Khoury , Leila Kosseim