English
Related papers

Related papers: Pre-training Methods in Information Retrieval

200 papers

Recently, the emergence of pre-trained models (PTMs) has brought natural language processing (NLP) to a new era. In this survey, we provide a comprehensive review of PTMs for NLP. We first briefly introduce language representation learning…

Computation and Language · Computer Science 2021-06-24 Xipeng Qiu , Tianxiang Sun , Yige Xu , Yunfan Shao , Ning Dai , Xuanjing Huang

The emergence of Pre-trained Language Models (PLMs) has achieved tremendous success in the field of Natural Language Processing (NLP) by learning universal representations on large corpora in a self-supervised manner. The pre-trained models…

Information Retrieval · Computer Science 2023-09-14 Peng Liu , Lemei Zhang , Jon Atle Gulla

Information retrieval (IR) plays a crucial role in locating relevant resources from vast amounts of data, and its applications have evolved from traditional knowledge bases to modern retrieval models (RMs). The emergence of large language…

Computation and Language · Computer Science 2023-12-13 Jiazhan Feng , Chongyang Tao , Xiubo Geng , Tao Shen , Can Xu , Guodong Long , Dongyan Zhao , Daxin Jiang

Finetuning Pretrained Language Models (PLM) for IR has been de facto the standard practice since their breakthrough effectiveness few years ago. But, is this approach well understood? In this paper, we study the impact of the pretraining…

Information Retrieval · Computer Science 2023-01-26 Carlos Lassance , Hervé Déjean , Stéphane Clinchant

Large-scale pre-trained models (PTMs) such as BERT and GPT have recently achieved great success and become a milestone in the field of artificial intelligence (AI). Owing to sophisticated pre-training objectives and huge model parameters,…

A recent "third wave" of Neural Network (NN) approaches now delivers state-of-the-art performance in many machine learning tasks, spanning speech recognition, computer vision, and natural language processing. Because these modern NNs often…

The goal of text ranking is to generate an ordered list of texts retrieved from a corpus in response to a query. Although the most common formulation of text ranking is search, instances of the task can also be found in many natural…

Information Retrieval · Computer Science 2021-08-20 Jimmy Lin , Rodrigo Nogueira , Andrew Yates

Large language models (LLMs) fine-tuned for text-retrieval have demonstrated state-of-the-art results across several information retrieval (IR) benchmarks. However, supervised training for improving these models requires numerous labeled…

Information Retrieval · Computer Science 2024-06-24 William Fleshman , Benjamin Van Durme

In this paper we look beyond metrics-based evaluation of Information Retrieval systems, to explore the reasons behind ranking results. We present the content-focused Neural-IR-Explorer, which empowers users to browse through retrieval…

Information Retrieval · Computer Science 2019-12-11 Sebastian Hofstätter , Markus Zlabinger , Allan Hanbury

Axiomatic information retrieval (IR) seeks a set of principle properties desirable in IR models. These properties when formally expressed provide guidance in the search for better relevance estimation functions. Neural ranking models…

Information Retrieval · Computer Science 2019-04-16 Corby Rosset , Bhaskar Mitra , Chenyan Xiong , Nick Craswell , Xia Song , Saurabh Tiwary

Ranking models are the main components of information retrieval systems. Several approaches to ranking are based on traditional machine learning algorithms using a set of hand-crafted features. Recently, researchers have leveraged deep…

Information Retrieval · Computer Science 2021-11-03 Mohamed Trabelsi , Zhiyu Chen , Brian D. Davison , Jeff Heflin

The strong capability of large language models (LLMs) has been applied to information extraction (IE) through either retrieval augmented prompting or instruction tuning (IT). However, the best way to incorporate information with LLMs for IE…

Computation and Language · Computer Science 2024-12-03 Tingyu Xie , Jian Zhang , Yan Zhang , Yuanyuan Liang , Qi Li , Hongwei Wang

Text retrieval is a long-standing research topic on information seeking, where a system is required to return relevant information resources to user's queries in natural language. From classic retrieval methods to learning-based ranking…

Information Retrieval · Computer Science 2022-11-29 Wayne Xin Zhao , Jing Liu , Ruiyang Ren , Ji-Rong Wen

Universal Information Extraction~(Universal IE) aims to solve different extraction tasks in a uniform text-to-structure generation manner. Such a generation procedure tends to struggle when there exist complex information structures to be…

Computation and Language · Computer Science 2023-06-21 Xin Cong. Bowen Yu , Mengcheng Fang , Tingwen Liu , Haiyang Yu , Zhongkai Hu , Fei Huang , Yongbin Li , Bin Wang

Information retrieval systems are crucial for enabling effective access to large document collections. Recent approaches have leveraged Large Language Models (LLMs) to enhance retrieval performance through query augmentation, but often rely…

Information Retrieval · Computer Science 2025-04-15 Pengcheng Jiang , Jiacheng Lin , Lang Cao , Runchu Tian , SeongKu Kang , Zifeng Wang , Jimeng Sun , Jiawei Han

In this paper, we provide a detailed overview of the models used for information retrieval in the first and second stages of the typical processing chain. We discuss the current state-of-the-art models, including methods based on terms,…

Information Retrieval · Computer Science 2024-02-16 Kailash A. Hambarde , Hugo Proenca

While interests in tabular deep learning has significantly grown, conventional tree-based models still outperform deep learning methods. To narrow this performance gap, we explore the innovative retrieval mechanism, a methodology that…

Machine Learning · Computer Science 2023-11-14 Felix den Breejen , Sangmin Bae , Stephen Cha , Tae-Young Kim , Seoung Hyun Koh , Se-Young Yun

Information retrieval has long focused on ranking documents by semantic relatedness. Yet many real-world information needs demand more: enforcement of logical constraints, multi-step inference, and synthesis of multiple pieces of evidence.…

Information Retrieval · Computer Science 2026-02-04 Mohanna Hoveyda , Panagiotis Efstratiadis , Arjen de Vries , Maarten de Rijke

Recently, pre-trained language models such as BERT have been applied to document ranking for information retrieval, which first pre-train a general language model on an unlabeled large corpus and then conduct ranking-specific fine-tuning on…

Information Retrieval · Computer Science 2021-08-13 Lin Bo , Liang Pang , Gang Wang , Jun Xu , XiuQiang He , Ji-Rong Wen

Recent information retrieval (IR) models are pre-trained and instruction-tuned on massive datasets and tasks, enabling them to perform well on a wide range of tasks and potentially generalize to unseen tasks with instructions. However,…

Information Retrieval · Computer Science 2024-10-15 Weiwei Sun , Zhengliang Shi , Jiulong Wu , Lingyong Yan , Xinyu Ma , Yiding Liu , Min Cao , Dawei Yin , Zhaochun Ren