English
Related papers

Related papers: Enabling Low-Resource Language Retrieval: Establis…

200 papers

LLMs are predominantly trained on English data, which leads to a significant drop in performance on low-resource languages. Understanding how LLMs handle these languages is crucial for improving their effectiveness. This study focuses on…

Computation and Language · Computer Science 2025-02-04 Taaha Saleem Bajwa

Providing access to information across languages has been a goal of Information Retrieval (IR) for decades. While progress has been made on Cross Language IR (CLIR) where queries are expressed in one language and documents in another, the…

Information Retrieval · Computer Science 2023-02-10 Dawn Lawrie , Eugene Yang , Douglas W. Oard , James Mayfield

In Retrieval-Augmented Generation (RAG) tasks using Large Language Models (LLMs), the quality of retrieved information is critical to the final output. This paper introduces the IRSC benchmark for evaluating the performance of embedding…

Information Retrieval · Computer Science 2024-09-27 Hai Lin , Shaoxiong Zhan , Junyou Su , Haitao Zheng , Hui Wang

Neural retrieval methods using transformer-based pre-trained language models have advanced multilingual and cross-lingual retrieval. However, their effectiveness for low-resource, morphologically rich languages such as Amharic remains…

Information Retrieval · Computer Science 2025-06-11 Kidist Amde Mekonnen , Yosef Worku Alemneh , Maarten de Rijke

In recent years, low-resource Machine Reading Comprehension (MRC) has made significant progress, with models getting remarkable performance on various language datasets. However, none of these models have been customized for the Urdu…

Computation and Language · Computer Science 2021-11-04 Samreen Kazi , Shakeel Khoja

There has been a recent spike in interest in multi-modal Language and Vision problems. On the language side, most of these models primarily focus on English since most multi-modal datasets are monolingual. We try to bridge this gap with a…

Computation and Language · Computer Science 2020-12-10 Pranav Aggarwal , Ajinkya Kale

Existing neural information retrieval (IR) models have often been studied in homogeneous and narrow settings, which has considerably limited insights into their out-of-distribution (OOD) generalization capabilities. To address this, and to…

Information Retrieval · Computer Science 2021-10-22 Nandan Thakur , Nils Reimers , Andreas Rücklé , Abhishek Srivastava , Iryna Gurevych

Information Retrieval (IR) is the task of obtaining pieces of data (such as documents) that are relevant to a particular query or need from a large repository of information. IR is a valuable component of several downstream Natural Language…

Information Retrieval · Computer Science 2020-08-05 Samarth Rawal

Pre-trained Language Models have recently emerged in Information Retrieval as providing the backbone of a new generation of neural systems that outperform traditional methods on a variety of tasks. However, it is still unclear to what…

Information Retrieval · Computer Science 2023-01-26 Simon Lupart , Thibault Formal , Stéphane Clinchant

We introduce RusBEIR, a comprehensive benchmark designed for zero-shot evaluation of information retrieval (IR) models in the Russian language. Comprising 17 datasets from various domains, it integrates adapted, translated, and newly…

Information Retrieval · Computer Science 2025-04-18 Grigory Kovalev , Mikhail Tikhomirov , Evgeny Kozhevnikov , Max Kornilov , Natalia Loukachevitch

The BEIR dataset is a large, heterogeneous benchmark for Information Retrieval (IR) in zero-shot settings, garnering considerable attention within the research community. However, BEIR and analogous datasets are predominantly restricted to…

Information Retrieval · Computer Science 2024-05-17 Konrad Wojtasik , Vadim Shishkin , Kacper Wołowiec , Arkadiusz Janz , Maciej Piasecki

Large Language Models (LLMs) are now capable of generating text that closely resembles human writing, making them powerful tools for content creation, but this growing ability has also made it harder to tell whether a piece of text was…

Computation and Language · Computer Science 2025-10-21 Muhammad Ammar , Hadiya Murad Hadi , Usman Majeed Butt

Urdu, as a low-resource language, lacks effective semantic content recommendation systems, particularly in the domain of personalized news retrieval. Existing approaches largely rely on lexical matching or language-agnostic techniques,…

Information Retrieval · Computer Science 2026-02-27 Alishbah Bashir , Fatima Qaiser , Ijaz Hussain

Bank supervisors face the complex task of ensuring that new measures are consistently aligned with historical precedents. To address this challenge, we introduce a novel Information Retrieval (IR) System tailored to assist supervisors in…

Information Retrieval · Computer Science 2025-08-06 Ilias Aarab

Instruction tuning enhances large language models (LLMs) by aligning them with human preferences across diverse tasks. Traditional approaches to create instruction tuning datasets face serious challenges for low-resource languages due to…

Computation and Language · Computer Science 2024-09-20 Abdullatif Köksal , Marion Thaler , Ayyoob Imani , Ahmet Üstün , Anna Korhonen , Hinrich Schütze

Developing Information Retrieval (IR) tools and techniques in African languages suffers from the dual problems of a lack of algorithms and very small test data collections. This affects the creation of practical IR systems and limits the…

Information Retrieval · Computer Science 2018-06-14 Hussein Suleman

This study evaluates the feasibility of lightweight Whisper models (Tiny, Base, Small) for Urdu speech recognition in low-resource settings. Despite Urdu being the 10th most spoken language globally with over 230 million speakers, its…

Computation and Language · Computer Science 2025-08-14 Abdul Rehman Antall , Naveed Akhtar

This study investigates the potential of Large Language Models (LLMs), particularly GPT-4o, for Optical Character Recognition (OCR) in low-resource scripts such as Urdu, Albanian, and Tajik, with English serving as a benchmark. Using a…

Machine Learning · Computer Science 2024-12-23 Muhammad Abdullah Sohail , Salaar Masood , Hamza Iqbal

This literature review surveys the advancements of keyword spotting (KWS) technologies, specifically focusing on Urdu, Pakistan's low-resource language (LRL), which has complex phonetics. Despite the global strides in speech technology,…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-26 Syed Muhammad Aqdas Rizvi

While billions of non-English speaking users rely on search engines every day, the problem of ad-hoc information retrieval is rarely studied for non-English languages. This is primarily due to a lack of data set that are suitable to train…

Information Retrieval · Computer Science 2020-05-01 Sean MacAvaney , Luca Soldaini , Nazli Goharian