English
Related papers

Related papers: Contrastive Information Transfer for Pre-Ranking S…

200 papers

Supervised machine learning models and their evaluation strongly depends on the quality of the underlying dataset. When we search for a relevant piece of information it may appear anywhere in a given passage. However, we observe a bias in…

Information Retrieval · Computer Science 2021-01-19 Sebastian Hofstätter , Aldo Lipani , Sophia Althammer , Markus Zlabinger , Allan Hanbury

Multi-stage information retrieval (IR) has become a widely-adopted paradigm in search. While Large Language Models (LLMs) have been extensively evaluated as second-stage reranking models for monolingual IR, a systematic large-scale…

Computation and Language · Computer Science 2025-09-19 Longfei Zuo , Pingjun Hong , Oliver Kraus , Barbara Plank , Robert Litschko

Learning-to-rank (LTR) algorithms are ubiquitous and necessary to explore the extensive catalogs of media providers. To avoid the user examining all the results, its preferences are used to provide a subset of relatively small size. The…

Pretrained language models such as BERT, GPT have shown great effectiveness in language understanding. The auxiliary predictive tasks in existing pretraining approaches are mostly defined on tokens, thus may not be able to capture…

Computation and Language · Computer Science 2020-06-19 Hongchao Fang , Sicheng Wang , Meng Zhou , Jiayuan Ding , Pengtao Xie

The Composed Image Retrieval (CIR) task aims to retrieve target images using a composed query consisting of a reference image and a modified text. Advanced methods often utilize contrastive learning as the optimization objective, which…

Computer Vision and Pattern Recognition · Computer Science 2024-08-08 Zhangchi Feng , Richong Zhang , Zhijie Nie

Unsupervised sentence representation learning aims to transform input sentences into fixed-length vectors enriched with intricate semantic information while obviating the reliance on labeled data. Recent strides within this domain have been…

Computation and Language · Computer Science 2024-06-21 Bowen Zhang , Kehua Chang , Chunping Li

Effective science mapping relies on high-quality representations of scientific documents. As an important task in scientometrics and information studies, science mapping is often challenged by the complex and heterogeneous nature of…

Digital Libraries · Computer Science 2025-12-16 Zhentao Liang , Nees Jan van Eck , Xuehua Wu , Jin Mao , Gang Li

Personal assistant systems, such as Apple Siri, Google Assistant, Amazon Alexa, and Microsoft Cortana, are becoming ever more widely used. Understanding user intent such as clarification questions, potential answers and user feedback in…

Information Retrieval · Computer Science 2020-02-06 Liu Yang , Minghui Qiu , Chen Qu , Cen Chen , Jiafeng Guo , Yongfeng Zhang , W. Bruce Croft , Haiqing Chen

Counterfactual fairness methods address the question: How would the prediction change if the sensitive identity attributes referenced in the text instance were different? These methods are entirely based on generating counterfactuals for…

Computation and Language · Computer Science 2022-03-08 Mohit Wadhwa , Mohan Bhambhani , Ashvini Jindal , Uma Sawant , Ramanujam Madhavan

Counterfactual Learning to Rank (LTR) algorithms learn a ranking model from logged user interactions, often collected using a production system. Employing such an offline learning approach has many benefits compared to an online one, but it…

Machine Learning · Computer Science 2020-05-22 Rolf Jagerman , Maarten de Rijke

In recent years, large pre-trained transformers have led to substantial gains in performance over traditional retrieval models and feedback approaches. However, these results are primarily based on the MS Marco/TREC Deep Learning Track…

Information Retrieval · Computer Science 2022-04-18 David Rau , Jaap Kamps

Unbiased Learning to Rank (ULTR) that learns to rank documents with biased user feedback data is a well-known challenge in information retrieval. Existing methods in unbiased learning to rank typically rely on click modeling or inverse…

Information Retrieval · Computer Science 2023-02-09 Dan Luo , Lixin Zou , Qingyao Ai , Zhiyu Chen , Dawei Yin , Brian D. Davison

Reranking is a critical stage in contemporary information retrieval (IR) systems, improving the relevance of the user-presented final results by honing initial candidate sets. This paper is a thorough guide to examine the changing reranker…

Information Retrieval · Computer Science 2025-12-19 Tejul Pandit , Sakshi Mahendru , Meet Raval , Dhvani Upadhyay

ChatGPT has achieved remarkable success in natural language understanding. Considering that recommendation is indeed a conversation between users and the system with items as words, which has similar underlying pattern with ChatGPT, we…

Information Retrieval · Computer Science 2024-04-16 Yabin Zhang , Wenhui Yu , Erhan Zhang , Xu Chen , Lantao Hu , Peng Jiang , Kun Gai

The pre-training models such as BERT have achieved great results in various natural language processing problems. However, a large number of parameters need significant amounts of memory and the consumption of inference time, which makes it…

Computation and Language · Computer Science 2020-12-15 Hao Fu , Shaojun Zhou , Qihong Yang , Junjie Tang , Guiquan Liu , Kaikui Liu , Xiaolong Li

Learning to Rank (LTR) from user interactions is challenging as user feedback often contains high levels of bias and noise. At the moment, two methodologies for dealing with bias prevail in the field of LTR: counterfactual methods that…

Information Retrieval · Computer Science 2019-07-16 Rolf Jagerman , Harrie Oosterhuis , Maarten de Rijke

Despite the development of ranking optimization techniques, pointwise loss remains the dominating approach for click-through rate prediction. It can be attributed to the calibration ability of the pointwise loss since the prediction can be…

Information Retrieval · Computer Science 2023-05-30 Xiang-Rong Sheng , Jingyue Gao , Yueyao Cheng , Siran Yang , Shuguang Han , Hongbo Deng , Yuning Jiang , Jian Xu , Bo Zheng

This paper describes a machine learning algorithm for document (re)ranking, in which queries and documents are firstly encoded using BERT [1], and on top of that a learning-to-rank (LTR) model constructed with TF-Ranking (TFR) [2] is…

Information Retrieval · Computer Science 2020-06-11 Shuguang Han , Xuanhui Wang , Mike Bendersky , Marc Najork

Transferability estimation has emerged as an important problem in transfer learning. A transferability estimation method takes as inputs a set of pre-trained models and decides which pre-trained model can deliver the best transfer learning…

Machine Learning · Computer Science 2024-05-06 Yunhui Guo

We consider the task of learning from both positive and negative feedback in a sequential recommendation scenario, as both types of feedback are often present in user interactions. Meanwhile, conventional sequential learning models usually…

Information Retrieval · Computer Science 2025-08-21 Veronika Ivanova , Evgeny Frolov , Alexey Vasilev