English
Related papers

Related papers: Improving Low-Resource Cross-lingual Document Retr…

200 papers

Recently, the retrieval models based on dense representations have been gradually applied in the first stage of the document retrieval tasks, showing better performance than traditional sparse vector space models. To obtain high efficiency,…

Information Retrieval · Computer Science 2021-08-20 Hongyin Tang , Xingwu Sun , Beihong Jin , Jingang Wang , Fuzheng Zhang , Wei Wu

In monolingual dense retrieval, lots of works focus on how to distill knowledge from cross-encoder re-ranker to dual-encoder retriever and these methods achieve better performance due to the effectiveness of cross-encoder re-ranker.…

Information Retrieval · Computer Science 2023-03-28 Houxing Ren , Linjun Shou , Ning Wu , Ming Gong , Daxin Jiang

Cross-lingual text representations have gained popularity lately and act as the backbone of many tasks such as unsupervised machine translation and cross-lingual information retrieval, to name a few. However, evaluation of such…

Computation and Language · Computer Science 2021-05-12 Mikhail Fain , Niall Twomey , Danushka Bollegala

Retrieval-augmented generation (RAG) is a common way to ground language models in external documents and up-to-date information. Classical retrieval systems relied on lexical methods such as BM25, which rank documents by term overlap with…

Computation and Language · Computer Science 2026-03-05 Martin Asenov , Kenza Benkirane , Dan Goldwater , Aneiss Ghodsi

The great majority of languages in the world are considered under-resourced for the successful application of deep learning methods. In this work, we propose a meta-learning approach to document classification in limited-resource setting…

Computation and Language · Computer Science 2021-04-27 Niels van der Heijden , Helen Yannakoudakis , Pushkar Mishra , Ekaterina Shutova

Cross-lingual information retrieval (CLIR) ~\cite{shi2021cross, asai2021one, jiang2020cross} for example, can find relevant text in any language such as English(high resource) or Telugu (low resource) even when the query is posed in a…

Computation and Language · Computer Science 2025-01-09 Navya Yarrabelly , Saloni Mittal , Ketan Todi , Kimihiro Hasegawa

Multiple neural language models have been developed recently, e.g., BERT and XLNet, and achieved impressive results in various NLP tasks including sentence classification, question answering and document ranking. In this paper, we explore…

Information Retrieval · Computer Science 2020-04-29 Zhuolin Jiang , Amro El-Jaroudi , William Hartmann , Damianos Karakos , Lingjun Zhao

We explore ways of incorporating bilingual dictionaries to enable semi-supervised neural machine translation. Conventional back-translation methods have shown success in leveraging target side monolingual data. However, since the quality of…

Computation and Language · Computer Science 2020-04-07 Sreyashi Nag , Mihir Kale , Varun Lakshminarasimhan , Swapnil Singhavi

Search engines often follow a two-phase paradigm where in the first stage (the retrieval stage) an initial set of documents is retrieved and in the second stage (the re-ranking stage) the documents are re-ranked to obtain the final result…

Information Retrieval · Computer Science 2020-10-06 Saar Kuzi , Mingyang Zhang , Cheng Li , Michael Bendersky , Marc Najork

Multilingual e-commerce search suffers from severe data imbalance across languages, label noise, and limited supervision for low-resource languages--challenges that impede the cross-lingual generalization of relevance models despite the…

Information Retrieval · Computer Science 2025-10-27 Yabo Yin , Yang Xi , Jialong Wang , Shanqi Wang , Jiateng Hu

Benefiting from transformer-based pre-trained language models, neural ranking models have made significant progress. More recently, the advent of multilingual pre-trained language models provides great support for designing neural…

Computation and Language · Computer Science 2023-01-31 Zhiqi Huang , Puxuan Yu , James Allan

Cross-lingual transfer of word embeddings aims to establish the semantic mappings among words in different languages by learning the transformation functions over the corresponding word embedding spaces. Successfully solving this problem…

Computation and Language · Computer Science 2018-09-12 Ruochen Xu , Yiming Yang , Naoki Otani , Yuexin Wu

Cross-Lingual Word Embeddings (CLWEs) are a key component to transfer linguistic information learnt from higher-resource settings into lower-resource ones. Recent research in cross-lingual representation learning has focused on offline…

Computation and Language · Computer Science 2022-03-29 Sonal Sannigrahi , Jesse Read

Models such as latent semantic analysis and those based on neural embeddings learn distributed representations of text, and match the query against the document in the latent semantic space. In traditional information retrieval models, on…

Information Retrieval · Computer Science 2016-10-27 Bhaskar Mitra , Fernando Diaz , Nick Craswell

It is very challenging to work with low-resource languages due to the inadequate availability of data. Using a dictionary to map independently trained word embeddings into a shared vector space has proved to be very useful in learning…

Computation and Language · Computer Science 2019-10-16 Sourav Dutta

Pre-trained language models (PLMs) have proven to be effective for document re-ranking task. However, they lack the ability to fully interpret the semantics of biomedical and health-care queries and often rely on simplistic patterns for…

Computation and Language · Computer Science 2023-05-09 Deepak Gupta , Dina Demner-Fushman

We apply cross-lingual Latent Semantic Indexing to the Bilingual Document Alignment Task at WMT16. Reduced-rank singular value decomposition of a bilingual term-document matrix derived from known English/French page pairs in the training…

Computation and Language · Computer Science 2017-08-01 Ulrich Germann

Multilingual sentence representations pose a great advantage for low-resource languages that do not have enough data to build monolingual models on their own. These multilingual sentence representations have been separately exploited by few…

Computation and Language · Computer Science 2021-06-15 Dilan Sachintha , Lakmali Piyarathna , Charith Rajitha , Surangika Ranathunga

With the recent advancements in information technology there has been a huge surge in amount of data available. But information retrieval technology has not been able to keep up with this pace of information generation resulting in over…

Computation and Language · Computer Science 2017-10-24 Nishant Nikhil , Muktabh Mayank Srivastava

In this work we present a systematic empirical study focused on the suitability of the state-of-the-art multilingual encoders for cross-lingual document and sentence retrieval tasks across a number of diverse language pairs. We first treat…

Computation and Language · Computer Science 2021-12-22 Robert Litschko , Ivan Vulić , Simone Paolo Ponzetto , Goran Glavaš