English
Related papers

Related papers: Improving Low-Resource Retrieval Effectiveness usi…

200 papers

Cross-lingual transfer from related high-resource languages is a well-established strategy to enhance low-resource language technologies. Prior work has shown that adapters show promise for, e.g., improving low-resource machine translation…

Computation and Language · Computer Science 2025-06-02 Marcell Fekete , Nathaniel R. Robinson , Ernests Lavrinovics , E. Djeride Jean-Baptiste , Raj Dabre , Johannes Bjerva , Heather Lent

Aligning parallel sentences in multilingual corpora is essential to curating data for downstream applications such as Machine Translation. In this work, we present OneAligner, an alignment model specially designed for sentence retrieval…

Computation and Language · Computer Science 2022-05-19 Tong Niu , Kazuma Hashimoto , Yingbo Zhou , Caiming Xiong

Multilingual Neural Machine Translation (NMT) models are capable of translating between multiple source and target languages. Despite various approaches to train such models, they have difficulty with zero-shot translation: translating…

Computation and Language · Computer Science 2019-03-19 Naveen Arivazhagan , Ankur Bapna , Orhan Firat , Roee Aharoni , Melvin Johnson , Wolfgang Macherey

The expanding influence of social media platforms over the past decade has impacted the way people communicate. The level of obscurity provided by social media and easy accessibility of the internet has facilitated the spread of hate…

Computation and Language · Computer Science 2024-12-02 Susmita Das , Arpita Dutta , Kingshuk Roy , Abir Mondal , Arnab Mukhopadhyay

The lack of annotated data in many languages is a well-known challenge within the field of multilingual natural language processing (NLP). Therefore, many recent studies focus on zero-shot transfer learning and joint training across…

Computation and Language · Computer Science 2019-12-24 Niels van der Heijden , Samira Abnar , Ekaterina Shutova

Recent studies show that large language models (LLMs) are powerful tools for working with natural language, bringing advances in many areas of computational linguistics. However, these models face challenges when applied to low-resource…

Computation and Language · Computer Science 2024-12-09 Zhaojun Ding , Zhengliang Liu , Hanqi Jiang , Yizhu Gao , Xiaoming Zhai , Tianming Liu , Ninghao Liu

The contrast between the need for large amounts of data for current Natural Language Processing (NLP) techniques, and the lack thereof, is accentuated in the case of African languages, most of which are considered low-resource. To help…

Computation and Language · Computer Science 2020-04-22 Machel Reid , Edison Marrese-Taylor , Yutaka Matsuo

The central bottleneck for low-resource NLP is typically regarded to be the quantity of accessible data, overlooking the contribution of data quality. This is particularly seen in the development and evaluation of low-resource systems via…

Computation and Language · Computer Science 2022-11-15 Maartje ter Hoeve , David Grangier , Natalie Schluter

Large language models (LLMs) have achieved state-of-the-art performance in various software engineering tasks, including error detection, clone detection, and code translation, primarily leveraging high-resource programming languages like…

Computation and Language · Computer Science 2025-06-11 Razan Baltaji , Saurabh Pujar , Louis Mandel , Martin Hirzel , Luca Buratti , Lav Varshney

In-context learning (ICL) empowers large language models (LLMs) to perform diverse tasks in underrepresented languages using only short in-context information, offering a crucial avenue for narrowing the gap between high-resource and…

Computation and Language · Computer Science 2024-06-26 Samuel Cahyawijaya , Holy Lovenia , Pascale Fung

Unsupervised translation has reached impressive performance on resource-rich language pairs such as English-French and English-German. However, early studies have shown that in more realistic settings involving low-resource, rare languages,…

Computation and Language · Computer Science 2021-03-15 Xavier Garcia , Aditya Siddhant , Orhan Firat , Ankur P. Parikh

Translation to or from low-resource languages LRLs poses challenges for machine translation in terms of both adequacy and fluency. Data augmentation utilizing large amounts of monolingual data is regarded as an effective way to alleviate…

Computation and Language · Computer Science 2019-06-11 Mengzhou Xia , Xiang Kong , Antonios Anastasopoulos , Graham Neubig

Recent advances in training multilingual language models on large datasets seem to have shown promising results in knowledge transfer across languages and achieve high performance on downstream tasks. However, we question to what extent the…

Computation and Language · Computer Science 2024-02-06 Sara Rajaee , Christof Monz

Despite advances in the multilingual capabilities of Large Language Models (LLMs), their performance varies substantially across different languages and tasks. In multilingual retrieval-augmented generation (RAG)-based systems, knowledge…

Computation and Language · Computer Science 2025-08-01 Aman Gupta , Yingying Zhuang , Zhou Yu , Ziji Zhang , Anurag Beniwal

Despite the widespread multilingual deployment of large language models, post-training pipelines remain predominantly English-centric, contributing to performance disparities across languages. We present a systematic, controlled study of…

Computation and Language · Computer Science 2026-04-16 Mehak Dhaliwal , Shashwat Chaurasia , Yao Qin , Dezhi Hong , Thomas Butler

Zero-shot neural machine translation is an attractive goal because of the high cost of obtaining data and building translation systems for new translation directions. However, previous papers have reported mixed success in zero-shot…

Computation and Language · Computer Science 2020-11-04 Annette Rios , Mathias Müller , Rico Sennrich

Automatic speech recognition (ASR) performance has improved drastically in recent years, mainly enabled by self-supervised learning (SSL) based acoustic models such as wav2vec2 and large-scale multi-lingual training like Whisper. A huge…

This work investigates the in-context learning abilities of pretrained large language models (LLMs) when instructed to translate text from a low-resource language into a high-resource language as part of an automated machine translation…

Computation and Language · Computer Science 2024-10-28 Sara Court , Micha Elsner

Despite the recent popularity of Large Language Models (LLMs) in Machine Translation (MT), their performance in low-resource languages (LRLs) still lags significantly behind Neural Machine Translation (NMT) models. In this work, we explore…

Computation and Language · Computer Science 2024-10-07 Vivek Iyer , Bhavitvya Malik , Pavel Stepachev , Pinzhen Chen , Barry Haddow , Alexandra Birch

Zero-shot cross-lingual transfer utilizing multilingual LLMs has become a popular learning paradigm for low-resource languages with no labeled training data. However, for NLP tasks that involve fine-grained predictions on words and phrases,…

Computation and Language · Computer Science 2024-02-06 Duong Minh Le , Yang Chen , Alan Ritter , Wei Xu