English
Related papers

Related papers: Aligning Large Language Models to Low-Resource Lan…

200 papers

The scarcity of parallel data is a major obstacle for training high-quality machine translation systems for low-resource languages. Fortunately, some low-resource languages are linguistically related or similar to high-resource languages;…

Dataset curation has become a basis for strong large language model (LLM) performance. While various rule-based filtering heuristics exist for English and multilingual datasets, model-based filtering techniques have primarily focused on…

Computation and Language · Computer Science 2026-02-20 Bettina Messmer , Vinko Sabolčec , Martin Jaggi

Recent large language models (LLM) exhibit sub-optimal performance on low-resource languages, as the training data of these models is usually dominated by English and other high-resource languages. Furthermore, it is challenging to train…

Computation and Language · Computer Science 2023-12-18 Zoltan Csaki , Pian Pawakapan , Urmish Thakker , Qiantong Xu

The scarcity of non-English data limits the development of non-English large language models (LLMs). Transforming English-centric LLMs to non-English has been identified as an effective and resource-efficient method. Previous works start…

Large Language Models (LLMs) have demonstrated significant capabilities in machine translation. However, their translation quality is sometimes questioned, as the generated outputs may deviate from expressions typically used by native…

Computation and Language · Computer Science 2024-12-10 Ke-Ching Chang , Chung-Chi Chen , An-Zi Yen

This paper examines the effectiveness of Large Language Models (LLMs) in translating the low-resource Lebanese dialect, focusing on the impact of culturally authentic data versus larger translated datasets. We compare three fine-tuning…

Computation and Language · Computer Science 2025-05-02 Silvana Yakhni , Ali Chehab

Large language models have demonstrated exceptional performance across multiple crosslingual NLP tasks, including machine translation (MT). However, persistent challenges remain in addressing context-sensitive units (CSUs), such as…

Computation and Language · Computer Science 2025-05-30 Qiuyu Ding , Zhiqiang Cao , Hailong Cao , Tiejun Zhao

Researchers working on low-resource languages face persistent challenges due to limited data availability and restricted access to computational resources. Although most large language models (LLMs) are predominantly trained in…

Computation and Language · Computer Science 2025-05-27 Odunayo Ogundepo , Akintunde Oladipo , Kelechi Ogueji , Esther Adenuga , David Ifeoluwa Adelani , Jimmy Lin

Large language models (LLMs) are transforming society, powering applications from smartphone assistants to autonomous driving. Yet cloud-based LLM services alone cannot serve a growing class of applications, including those operating under…

Signal Processing · Electrical Eng. & Systems 2026-05-12 Liangqi Yuan , Wenzhi Fang , Shiqiang Wang , H. Vincent Poor , Christopher G. Brinton

How to achieve neural machine translation with limited parallel data? Existing techniques often rely on large-scale monolingual corpora, which is impractical for some low-resource languages. In this paper, we turn to connect several…

Computation and Language · Computer Science 2022-10-14 Zhe Yang , Qingkai Fang , Yang Feng

While large language models (LLMs) exhibit state-of-the-art performance in various tasks, recent studies have revealed their struggle for code translation. This is because they haven't been extensively pre-trained with parallel multilingual…

Software Engineering · Computer Science 2024-10-15 Qingxiao Tao , Tingrui Yu , Xiaodong Gu , Beijun Shen

Large Language Models (LLMs) excel in translation among other things, demonstrating competitive performance for many language pairs in zero- and few-shot settings. But unlike dedicated neural machine translation models, LLMs are not trained…

Computation and Language · Computer Science 2025-12-16 Yuri Balashov

Large language models respond well in high-resource languages like English but struggle in low-resource languages. It may arise from the lack of high-quality instruction following data in these languages. Directly translating English…

Computation and Language · Computer Science 2024-05-31 Chong Li , Wen Yang , Jiajun Zhang , Jinliang Lu , Shaonan Wang , Chengqing Zong

Translation into severely low-resource languages has both the cultural goal of saving and reviving those languages and the humanitarian goal of assisting the everyday needs of local communities that are accelerated by the recent COVID-19…

Computation and Language · Computer Science 2024-01-31 Zhong Zhou

Extremely low-resource (XLR) languages lack substantial corpora for training NLP models, motivating the use of all available resources such as dictionaries and grammar books. Machine Translation from One Book (Tanzer et al., 2024) suggests…

Computation and Language · Computer Science 2025-04-25 Seth Aycock , David Stap , Di Wu , Christof Monz , Khalil Sima'an

Although LLMs have attained significant success in high-resource languages, their capacity in low-resource linguistic environments like Kannada and Arabic is not yet fully understood. This work benchmarking the performance of multilingual…

Computation and Language · Computer Science 2025-07-29 Maitha Alshehhi , Ahmed Sharshar , Mohsen Guizani

Large Language Models (LLMs) are increasingly used to generate synthetic textual data for training smaller specialized models. However, a comparison of various generation strategies for low-resource language settings is lacking. While…

Computation and Language · Computer Science 2025-09-22 Tatiana Anikina , Jan Cegin , Jakub Simko , Simon Ostermann

This paper addresses the limited transfer and adaptation capabilities of large language models in low-resource language scenarios. It proposes a unified framework that combines a knowledge transfer module with parameter-efficient…

Computation and Language · Computer Science 2025-07-03 Shuangquan Lyu , Yingnan Deng , Guiran Liu , Zhen Qi , Ruotong Wang

As the performance of Large-scale Vision Language Models (LVLMs) improves, they are increasingly capable of responding in multiple languages, and there is an expectation that the demand for explanations generated by LVLMs will grow.…

Computation and Language · Computer Science 2025-02-17 Shintaro Ozaki , Kazuki Hayashi , Yusuke Sakai , Hidetaka Kamigaito , Katsuhiko Hayashi , Taro Watanabe

Large Language Models (LLMs) trained on extensive textual corpora have emerged as leading solutions for a broad array of Natural Language Processing (NLP) tasks. Despite their notable performance, these models are prone to certain…

Computation and Language · Computer Science 2023-07-25 Yufei Wang , Wanjun Zhong , Liangyou Li , Fei Mi , Xingshan Zeng , Wenyong Huang , Lifeng Shang , Xin Jiang , Qun Liu
‹ Prev 1 3 4 5 6 7 10 Next ›