English
Related papers

Related papers: Improving Semantic Proximity in Information Retrie…

200 papers

Prior work on English monolingual retrieval has shown that a cross-encoder trained using a large number of relevance judgments for query-document pairs can be used as a teacher to train more efficient, but similarly effective, dual-encoder…

Information Retrieval · Computer Science 2024-01-11 Eugene Yang , Dawn Lawrie , James Mayfield , Douglas W. Oard , Scott Miller

A key stumbling block for neural cross-language information retrieval (CLIR) systems has been the paucity of training data. The appearance of the MS MARCO monolingual training set led to significant advances in the state of the art in…

Information Retrieval · Computer Science 2023-05-02 James Mayfield , Eugene Yang , Dawn Lawrie , Samuel Barham , Orion Weller , Marc Mason , Suraj Nair , Scott Miller

Cross-lingual document search is an information retrieval task in which the queries' language differs from the documents' language. In this paper, we study the instability of neural document search models and propose a novel end-to-end…

Information Retrieval · Computer Science 2020-11-03 Jiapeng Liu , Xiao Zhang , Dan Goldwasser , Xiao Wang

Multi-stage information retrieval (IR) has become a widely-adopted paradigm in search. While Large Language Models (LLMs) have been extensively evaluated as second-stage reranking models for monolingual IR, a systematic large-scale…

Computation and Language · Computer Science 2025-09-19 Longfei Zuo , Pingjun Hong , Oliver Kraus , Barbara Plank , Robert Litschko

Despite advances in neural machine translation, cross-lingual retrieval tasks in which queries and documents live in different natural language spaces remain challenging. Although neural translation models may provide an intuitive approach…

Information Retrieval · Computer Science 2021-07-30 Zhizhong Chen , Carsten Eickhoff

One of the important factors that affects the performance of Cross Language Information Retrieval(CLIR)is the quality of translations being employed in CLIR. In order to improve the quality of translations, it is important to exploit…

Information Retrieval · Computer Science 2014-05-22 Hosein Azarbonyad , Azadeh Shakery , Heshaam Faili

Multilingual information retrieval (MLIR) considers the problem of ranking documents in several languages for a query expressed in a language that may differ from any of those languages. Recent work has observed that approaches such as…

Information Retrieval · Computer Science 2024-05-03 Eugene Yang , Thomas Jänich , James Mayfield , Dawn Lawrie

The advent of multilingual language models has generated a resurgence of interest in cross-lingual information retrieval (CLIR), which is the task of searching documents in one language with queries from another. However, the rapid pace of…

Retrieval systems generally focus on web-style queries that are short and underspecified. However, advances in language models have facilitated the nascent rise of retrieval models that can understand more complex queries with diverse…

This study finds that existing information retrieval (IR) models show significant biases based on the linguistic complexity of input queries, performing well on linguistically simpler (or more complex) queries while underperforming on…

Computation and Language · Computer Science 2025-04-11 Jiali Cheng , Hadi Amiri

Cross-lingual cross-modal retrieval (CCR) aims to retrieve visually relevant content based on non-English queries, without relying on human-labeled cross-modal data pairs during training. One popular approach involves utilizing machine…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Yabing Wang , Le Wang , Qiang Zhou , Zhibin Wang , Hao Li , Gang Hua , Wei Tang

Recent studies have demonstrated the cross-lingual alignment ability of multilingual pretrained language models. In this work, we found that the cross-lingual alignment can be further improved by training seq2seq models on sentence pairs…

Computation and Language · Computer Science 2020-10-28 Chau Tran , Yuqing Tang , Xian Li , Jiatao Gu

Translation ambiguity, out of vocabulary words and missing some translations in bilingual dictionaries make dictionary-based Cross-language Information Retrieval (CLIR) a challenging task. Moreover, in agglutinative languages which do not…

Information Retrieval · Computer Science 2014-11-06 Javid Dadashkarimi , Azadeh Shakery , Heshaam Faili

Despite their strong ability to retrieve knowledge in English, current large language models show imbalance abilities in different languages. Two approaches are proposed to address this, i.e., multilingual pretraining and multilingual…

Computation and Language · Computer Science 2024-04-09 Changjiang Gao , Hongda Hu , Peng Hu , Jiajun Chen , Jixing Li , Shujian Huang

Multilingual proficiency presents a significant challenge for large language models (LLMs). English-centric models are usually suboptimal in other languages, particularly those that are linguistically distant from English. This performance…

Computation and Language · Computer Science 2025-01-07 Geyu Lin , Bin Wang , Zhengyuan Liu , Nancy F. Chen

Document alignment aims to identify pairs of documents in two distinct languages that are of comparable content or translations of each other. Such aligned data can be used for a variety of NLP tasks from training cross-lingual…

Computation and Language · Computer Science 2020-10-13 Ahmed El-Kishky , Francisco Guzmán

Cross-lingual document alignment aims to identify pairs of documents in two distinct languages that are of comparable content or translations of each other. In this paper, we exploit the signals embedded in URLs to label web documents at…

Computation and Language · Computer Science 2020-10-13 Ahmed El-Kishky , Vishrav Chaudhary , Francisco Guzman , Philipp Koehn

Despite recent advancements in Multilingual Information Retrieval (MLIR), a significant gap remains between research and practical deployment. Many studies assess MLIR performance in isolated settings, limiting their applicability to…

Information Retrieval · Computer Science 2025-10-15 Vera Pavlova , Mohammed Makhlouf

Multilingual Information Retrieval is increasingly important in real-world search settings, where users issue queries over mixed-language corpora. Existing evaluations mainly reward language-agnostic semantic relevance, treating relevant…

Information Retrieval · Computer Science 2026-05-11 Youngjoon Jang , Seongtae Hong , Hyeonseok Moon , Heuiseok Lim

As a crucial role in cross-language information retrieval (CLIR), query translation has three main challenges: 1) the adequacy of translation; 2) the lack of in-domain parallel training data; and 3) the requisite of low latency. To this…

Computation and Language · Computer Science 2020-10-27 Liang Yao , Baosong Yang , Haibo Zhang , Weihua Luo , Boxing Chen