English
Related papers

Related papers: DynamicRetriever: A Pre-training Model-based IR Sy…

200 papers

Many techniques have been developed, such as model compression, to make Deep Neural Networks (DNNs) inference more efficiently. Nevertheless, DNNs still lack excellent run-time dynamic inference capability to enable users trade-off accuracy…

Computer Vision and Pattern Recognition · Computer Science 2020-09-15 Li Yang , Zhezhi He , Yu Cao , Deliang Fan

Developing a universal model that can efficiently and effectively respond to a wide range of information access requests -- from retrieval to recommendation to question answering -- has been a long-lasting goal in the information retrieval…

Information Retrieval · Computer Science 2023-04-27 Hansi Zeng , Surya Kallumadi , Zaid Alibadi , Rodrigo Nogueira , Hamed Zamani

Although synthetic data has changed various aspects of information retrieval (IR) pipelines, the main training paradigm remains: contrastive learning with binary relevance labels, where one positive document is compared against several…

Information Retrieval · Computer Science 2025-11-05 Reza Esfandiarpoor , George Zerveas , Ruochen Zhang , Macton Mgonzo , Carsten Eickhoff , Stephen H. Bach

Continual learning refers to the capability of a machine learning model to learn and adapt to new information, without compromising its performance on previously learned tasks. Although several studies have investigated continual learning…

Information Retrieval · Computer Science 2024-06-21 Jingrui Hou , Georgina Cosma , Axel Finke

Contrastive learning has been the dominant approach to training dense retrieval models. In this work, we investigate the impact of ranking context - an often overlooked aspect of learning dense retrieval models. In particular, we examine…

Information Retrieval · Computer Science 2023-10-24 George Zerveas , Navid Rekabsaz , Daniel Cohen , Carsten Eickhoff

Current state-of-the-art approaches to cross-modal retrieval process text and visual input jointly, relying on Transformer-based architectures with cross-attention mechanisms that attend over all words and objects in an image. While…

Computer Vision and Pattern Recognition · Computer Science 2022-02-22 Gregor Geigle , Jonas Pfeiffer , Nils Reimers , Ivan Vulić , Iryna Gurevych

What if Information Retrieval (IR) systems did not just retrieve relevant information that is stored in their indices, but could also "understand" it and synthesise it into a single document? We present a preliminary study that makes a…

Information Retrieval · Computer Science 2016-06-28 Christina Lioma , Birger Larsen , Casper Petersen , Jakob Grue Simonsen

We propose the new problem of choosing which dense retrieval model to use when searching on a new collection for which no labels are available, i.e. in a zero-shot setting. Many dense retrieval models are readily available. Each model…

Information Retrieval · Computer Science 2023-09-19 Ekaterina Khramtsova , Shengyao Zhuang , Mahsa Baktashmotlagh , Xi Wang , Guido Zuccon

Many early neural Information Retrieval (NeurIR) methods are re-rankers that rely on a traditional first-stage retriever due to expensive query time computations. Recently, representation-based retrievers have gained much attention, which…

Information Retrieval · Computer Science 2023-11-28 Sibo Dong , Justin Goldstein , Grace Hui Yang

In this paper, we demonstrate that information retrieval can be accomplished with a single Transformer, in which all information about the corpus is encoded in the parameters of the model. To this end, we introduce the Differentiable Search…

Computation and Language · Computer Science 2022-10-24 Yi Tay , Vinh Q. Tran , Mostafa Dehghani , Jianmo Ni , Dara Bahri , Harsh Mehta , Zhen Qin , Kai Hui , Zhe Zhao , Jai Gupta , Tal Schuster , William W. Cohen , Donald Metzler

Building dense retrievers requires a series of standard procedures, including training and validating neural models and creating indexes for efficient search. However, these procedures are often misaligned in that training objectives do not…

Computation and Language · Computer Science 2022-10-26 Gyuwan Kim , Jinhyuk Lee , Barlas Oguz , Wenhan Xiong , Yizhe Zhang , Yashar Mehdad , William Yang Wang

Information Retrieval (IR) systems are crucial tools for users to access information, which have long been dominated by traditional methods relying on similarity matching. With the advancement of pre-trained language models, generative…

Information Retrieval · Computer Science 2025-03-05 Xiaoxi Li , Jiajie Jin , Yujia Zhou , Yuyao Zhang , Peitian Zhang , Yutao Zhu , Zhicheng Dou

Information retrieval plays a crucial role in resource localization. Current dense retrievers retrieve the relevant documents within a corpus via embedding similarities, which compute similarities between dense vectors mainly depending on…

Information Retrieval · Computer Science 2025-05-30 Ganlin Xu , Zhoujia Zhang , Wangyi Mei , Jiaqing Liang , Weijia Lu , Xiaodong Zhang , Zhifei Yang , Xiaofeng Ma , Yanghua Xiao , Deqing Yang

In a dynamic retrieval system, documents must be ingested as they arrive, and be immediately findable by queries. Our purpose in this paper is to describe an index structure and processing regime that accommodates that requirement for…

Information Retrieval · Computer Science 2023-01-12 Alistair Moffat , Joel Mackenzie

Despite the advantages of their low-resource settings, traditional sparse retrievers depend on exact matching approaches between high-dimensional bag-of-words (BoW) representations of both the queries and the collection. As a result,…

Information Retrieval · Computer Science 2022-08-11 Dahlia Shehata , Negar Arabzadeh , Charles L. A. Clarke

Dense Retrieval (DR) models have proven to be effective for Document Retrieval and Information Grounding tasks. Usually, these models are trained and optimized for improving the relevance of top-ranked documents for a given query. Previous…

Information Retrieval · Computer Science 2025-08-12 Stefano Campese , Alessandro Moschitti , Ivano Lauriola

In order to adopt deep learning for information retrieval, models are needed that can capture all relevant information required to assess the relevance of a document to a given user query. While previous works have successfully captured…

Information Retrieval · Computer Science 2017-07-25 Kai Hui , Andrew Yates , Klaus Berberich , Gerard de Melo

Modern dense information retrieval (IR) models usually rely on costly large-scale pretraining. In this paper, we introduce LLM2IR, an efficient unsupervised contrastive learning framework to convert any decoder-only large language model…

Information Retrieval · Computer Science 2026-01-12 Xiaocong Yang

Information retrieval (IR) plays a crucial role in locating relevant resources from vast amounts of data, and its applications have evolved from traditional knowledge bases to modern retrieval models (RMs). The emergence of large language…

Computation and Language · Computer Science 2023-12-13 Jiazhan Feng , Chongyang Tao , Xiubo Geng , Tao Shen , Can Xu , Guodong Long , Dongyan Zhao , Daxin Jiang

This decade has seen a great deal of progress in the development of information retrieval systems. Unfortunately, we still lack a systematic understanding of the behavior of the systems and their relationship with documents. In this paper…

Information Retrieval · Computer Science 2007-05-23 Myung Ho Kim