English
Related papers

Related papers: Towards Better Web Search Performance: Pre-trainin…

200 papers

The core of information retrieval (IR) is to identify relevant information from large-scale resources and return it as a ranked list to respond to the user's information need. In recent years, the resurgence of deep learning has greatly…

Information Retrieval · Computer Science 2022-04-26 Yixing Fan , Xiaohui Xie , Yinqiong Cai , Jia Chen , Xinyu Ma , Xiangsheng Li , Ruqing Zhang , Jiafeng Guo

As the heart of a search engine, the ranking system plays a crucial role in satisfying users' information demands. More recently, neural rankers fine-tuned from pre-trained language models (PLMs) establish state-of-the-art ranking…

Information Retrieval · Computer Science 2021-06-28 Lixin Zou , Shengqiang Zhang , Hengyi Cai , Dehong Ma , Suqi Cheng , Daiting Shi , Zhifan Zhu , Weiyue Su , Shuaiqiang Wang , Zhicong Cheng , Dawei Yin

Fine-tuning in information retrieval systems using pre-trained language models (PLM-based IR) requires learning query representations and query-document relations, in addition to downstream task-specific learning. This study introduces…

Information Retrieval · Computer Science 2024-03-28 Atsushi Keyaki , Ribeka Keyaki

In information retrieval (IR) and related tasks, term weighting approaches typically consider the frequency of the term in the document and in the collection in order to compute a score reflecting the importance of the term for the…

Machine Learning · Computer Science 2021-09-22 Alejandro Moreo Fernández , Andrea Esuli , Fabrizio Sebastiani

The goal of text ranking is to generate an ordered list of texts retrieved from a corpus in response to a query. Although the most common formulation of text ranking is search, instances of the task can also be found in many natural…

Information Retrieval · Computer Science 2021-08-20 Jimmy Lin , Rodrigo Nogueira , Andrew Yates

In this paper, we introduce Rank-R1, a novel LLM-based reranker that performs reasoning over both the user query and candidate documents before performing the ranking task. Existing document reranking methods based on large language models…

Information Retrieval · Computer Science 2025-03-11 Shengyao Zhuang , Xueguang Ma , Bevan Koopman , Jimmy Lin , Guido Zuccon

One technique to improve the retrieval effectiveness of a search engine is to expand documents with terms that are related or representative of the documents' content.From the perspective of a question answering system, this might comprise…

Information Retrieval · Computer Science 2019-09-26 Rodrigo Nogueira , Wei Yang , Jimmy Lin , Kyunghyun Cho

Quality pretraining data is often seen as the key to high-performance language models. However, progress in understanding pretraining data has been slow due to the costly pretraining runs required for data selection experiments. We present…

Computation and Language · Computer Science 2025-03-11 Tristan Thrush , Christopher Potts , Tatsunori Hashimoto

This paper introduces a deep learning model tailored for document information analysis, emphasizing document classification, entity relation extraction, and document visual question answering. The proposed model leverages transformer-based…

Computer Vision and Pattern Recognition · Computer Science 2023-10-26 Tofik Ali , Partha Pratim Roy

Recently, pre-trained language models such as BERT have been applied to document ranking for information retrieval, which first pre-train a general language model on an unlabeled large corpus and then conduct ranking-specific fine-tuning on…

Information Retrieval · Computer Science 2021-08-13 Lin Bo , Liang Pang , Gang Wang , Jun Xu , XiuQiang He , Ji-Rong Wen

The Web is a canonical example of a competitive retrieval setting where many documents' authors consistently modify their documents to promote them in rankings. We present an automatic method for quality-preserving modification of document…

Information Retrieval · Computer Science 2020-06-30 Gregory Goren , Oren Kurland , Moshe Tennenholtz , Fiana Raiber

This is the second year of the TREC Deep Learning Track, with the goal of studying ad hoc ranking in the large training data regime. We again have a document retrieval task and a passage retrieval task, each with hundreds of thousands of…

Information Retrieval · Computer Science 2021-02-16 Nick Craswell , Bhaskar Mitra , Emine Yilmaz , Daniel Campos

Ranking models are the main components of information retrieval systems. Several approaches to ranking are based on traditional machine learning algorithms using a set of hand-crafted features. Recently, researchers have leveraged deep…

Information Retrieval · Computer Science 2021-11-03 Mohamed Trabelsi , Zhiyu Chen , Brian D. Davison , Jeff Heflin

Conventional methods for query autocompletion aim to predict which completed query a user will select from a list. A shortcoming of this approach is that users often do not know which query will provide the best retrieval performance on the…

Information Retrieval · Computer Science 2022-04-26 Adam Block , Rahul Kidambi , Daniel N. Hill , Thorsten Joachims , Inderjit S. Dhillon

Learning to rank has been intensively studied and widely applied in information retrieval. Typically, a global ranking function is learned from a set of labeled data, which can achieve good performance on average but may be suboptimal for…

Information Retrieval · Computer Science 2018-04-25 Qingyao Ai , Keping Bi , Jiafeng Guo , W. Bruce Croft

The goal of this paper is to investigate the connection between the performance gain that can be obtained by selftraining and the similarity between the corpora used in this approach. Self-training is a semi-supervised technique designed to…

Computation and Language · Computer Science 2016-01-14 Vincent Van Asch , Walter Daelemans

Neural approaches to learning term embeddings have led to improved computation of similarity and ranking in information retrieval (IR). So far neural representation learning has not been extended to meta-textual information that is readily…

Information Retrieval · Computer Science 2021-02-03 Toshitaka Kuwa , Shigehiko Schamoni , Stefan Riezler

The recent literature on online learning to rank (LTR) has established the utility of prior knowledge to Bayesian ranking bandit algorithms. However, a major limitation of existing work is the requirement for the prior used by the algorithm…

Machine Learning · Computer Science 2023-02-27 Javad Azizi , Ofer Meshi , Masrour Zoghi , Maryam Karimzadehgan

In this paper, we present our solution to the Multilingual Information Retrieval Across a Continuum of Languages (MIRACL) challenge of WSDM CUP 2023\footnote{https://project-miracl.github.io/}. Our solution focuses on enhancing the ranking…

Information Retrieval · Computer Science 2023-02-15 Qi Zhang , Zijian Yang , Yilun Huang , Ze Chen , Zijian Cai , Kangxu Wang , Jiewen Zheng , Jiarong He , Jin Gao

Misogyny and sexism are growing problems in social media. Advances have been made in online sexism detection but the systems are often uninterpretable. SemEval-2023 Task 10 on Explainable Detection of Online Sexism aims at increasing…

Computation and Language · Computer Science 2023-06-09 Konstantin Chernyshev , Ekaterina Garanina , Duygu Bayram , Qiankun Zheng , Lukas Edman