English
Related papers

Related papers: Towards Better Web Search Performance: Pre-trainin…

200 papers

Large language models (LMs) are currently trained to predict tokens given document prefixes, enabling them to directly perform long-form generation and prompting-style tasks which can be reduced to document completion. Existing pretraining…

In learning-to-rank for information retrieval, a ranking model is automatically learned from the data and then utilized to rank the sets of retrieved documents. Therefore, an ideal ranking model would be a mapping from a document set to a…

Information Retrieval · Computer Science 2020-05-08 Liang Pang , Jun Xu , Qingyao Ai , Yanyan Lan , Xueqi Cheng , Jirong Wen

Reranking algorithms have made progress in improving document retrieval quality by efficiently aggregating relevance judgments generated by large language models (LLMs). However, identifying relevant documents for queries that require…

Information Retrieval · Computer Science 2025-11-04 Jerry Huang , Siddarth Madala , Cheng Niu , Julia Hockenmaier , Tong Zhang

This paper describes a test collection (benchmark data) for retrieval systems driven by spoken queries. This collection was produced in the subtask of the NTCIR-3 Web retrieval task, which was performed in a TREC-style evaluation workshop.…

Computation and Language · Computer Science 2007-05-23 Atsushi Fujii , Katunobu Itou

Existing neural relevance models do not give enough consideration for query and item context information which diversifies the search results to adapt for personal preference. To bridge this gap, this paper presents a neural learning…

Information Retrieval · Computer Science 2023-09-12 Deguang Kong , Daniel Zhou , Zhiheng Huang , Steph Sigalas

Query-by-document (QBD) retrieval is an Information Retrieval task in which a seed document acts as the query and the goal is to retrieve related documents -- it is particular common in professional search tasks. In this work we improve the…

Information Retrieval · Computer Science 2022-05-25 Amin Abolghasemi , Suzan Verberne , Leif Azzopardi

In light of the success of the pre-trained language models (PLMs), continual pre-training of generic PLMs has been the paradigm of domain adaption. In this paper, we propose QUERT, A Continual Pre-trained Language Model for QUERy…

Computation and Language · Computer Science 2023-06-13 Jian Xie , Yidan Liang , Jingping Liu , Yanghua Xiao , Baohua Wu , Shenghua Ni

Text embedding models serve as a fundamental component in real-world search applications. By mapping queries and documents into a shared embedding space, they deliver competitive retrieval performance with high efficiency. However, their…

Computation and Language · Computer Science 2025-11-03 Qi Liu , Yanzhao Zhang , Mingxin Li , Dingkun Long , Pengjun Xie , Jiaxin Mao

Language model pretraining involves training on extensive corpora, where data quality plays a pivotal role. In this work, we aim to directly estimate the contribution of data during pretraining and select pretraining data in an efficient…

Computation and Language · Computer Science 2025-08-05 Kashun Shum , Yuzhen Huang , Hongjian Zou , Qi Ding , Yixuan Liao , Xiaoxin Chen , Qian Liu , Junxian He

Bipartite ranking aims to learn a real-valued ranking function that orders positive instances before negative instances. Recent efforts of bipartite ranking are focused on optimizing ranking accuracy at the top of the ranked list. Most…

Machine Learning · Computer Science 2020-07-07 Nan Li , Rong Jin , Zhi-Hua Zhou

The task of expert finding has been getting increasing attention in information retrieval literature. However, the current state-of-the-art is still lacking in principled approaches for combining different sources of evidence in an optimal…

Information Retrieval · Computer Science 2013-02-05 Catarina Moreira , Pável Calado , Bruno Martins

We propose an extensible deep learning method that uses reinforcement learning to train neural networks for offline ranking in information retrieval (IR). We call our method BanditRank as it treats ranking as a contextual bandit problem. In…

Information Retrieval · Computer Science 2019-10-24 Phanideep Gampa , Sumio Fujita

Pre-trained language models (PLMs) have proven to be effective for document re-ranking task. However, they lack the ability to fully interpret the semantics of biomedical and health-care queries and often rely on simplistic patterns for…

Computation and Language · Computer Science 2023-05-09 Deepak Gupta , Dina Demner-Fushman

We consider algorithm selection in the context of ad-hoc information retrieval. Given a query and a pair of retrieval methods, we propose a meta-learner that predicts how to combine the methods' relevance scores into an overall relevance…

Information Retrieval · Computer Science 2019-04-12 Siddhant Arora , Andrew Yates

We present our method for tackling the legal case retrieval task of the Competition on Legal Information Extraction/Entailment 2019. Our approach is based on the idea that summarization is important for retrieval. On one hand, we adopt a…

Computation and Language · Computer Science 2020-09-30 Vu Tran , Minh Le Nguyen , Ken Satoh

Selecting high-quality pre-training data is important for creating capable language models, but existing methods rely on simple heuristics. We introduce QuRating, a method for selecting pre-training data that can capture human intuitions…

Computation and Language · Computer Science 2024-07-19 Alexander Wettig , Aatmik Gupta , Saumya Malik , Danqi Chen

In this paper we look beyond metrics-based evaluation of Information Retrieval systems, to explore the reasons behind ranking results. We present the content-focused Neural-IR-Explorer, which empowers users to browse through retrieval…

Information Retrieval · Computer Science 2019-12-11 Sebastian Hofstätter , Markus Zlabinger , Allan Hanbury

Machine Learning algorithms have been extensively researched throughout the last decade, leading to unprecedented advances in a broad range of applications, such as image classification and reconstruction, object recognition, and text…

Artificial Intelligence · Computer Science 2022-12-20 Gustavo H. de Rosa , Mateus Roder , João Paulo Papa , Claudio F. G. dos Santos

In e-commerce platforms such as Amazon and TaoBao, ranking items in a search session is a typical multi-step decision-making problem. Learning to rank (LTR) methods have been widely applied to ranking problems. However, such methods often…

Machine Learning · Computer Science 2018-05-24 Yujing Hu , Qing Da , Anxiang Zeng , Yang Yu , Yinghui Xu

In this paper we present our approach and the system description for Sub Task A of SemEval 2019 Task 9: Suggestion Mining from Online Reviews and Forums. Given a sentence, the task asks to predict whether the sentence consists of a…

Computation and Language · Computer Science 2019-04-22 Sarthak Anand , Debanjan Mahata , Kartik Aggarwal , Laiba Mehnaz , Simra Shahid , Haimin Zhang , Yaman Kumar , Rajiv Ratn Shah , Karan Uppal