English
Related papers

Related papers: Unconfounded Propensity Estimation for Unbiased Ra…

200 papers

Counterfactual learning to rank (CLTR) relies on exposure-based inverse propensity scoring (IPS), a LTR-specific adaptation of IPS to correct for position bias. While IPS can provide unbiased and consistent estimates, it often suffers from…

Information Retrieval · Computer Science 2023-05-03 Shashank Gupta , Harrie Oosterhuis , Maarten de Rijke

Off-policy Learning to Rank (LTR) aims to optimize a ranker from data collected by a deployed logging policy. However, existing off-policy learning to rank methods often make strong assumptions about how users generate the click data, i.e.,…

Machine Learning · Computer Science 2023-10-31 Zeyu Zhang , Yi Su , Hui Yuan , Yiran Wu , Rishab Balasubramanian , Qingyun Wu , Huazheng Wang , Mengdi Wang

Online Learning to Rank (OLTR) optimises ranking models using implicit user feedback, such as clicks. Unlike traditional Learning to Rank (LTR) methods that rely on a static set of training data with relevance judgements to learn a ranking…

Machine Learning · Computer Science 2024-12-30 Shuyi Wang

Although click data is widely used in search systems in practice, so far the inherent bias, most notably position bias, has prevented it from being used in training of a ranker for search, i.e., learning-to-rank. Recently, a number of…

Information Retrieval · Computer Science 2019-02-28 Ziniu Hu , Yang Wang , Qu Peng , Hang Li

Additive two-tower models are popular learning-to-rank methods for handling biased user feedback in industry settings. Recent studies, however, report a concerning phenomenon: training two-tower models on clicks collected by well-performing…

Information Retrieval · Computer Science 2025-09-01 Philipp Hager , Onno Zoeter , Maarten de Rijke

Additive two-tower models are popular learning-to-rank methods for handling biased user feedback in industry settings. Recent studies, however, report a concerning phenomenon: training two-tower models on clicks collected by well-performing…

Information Retrieval · Computer Science 2025-06-26 Philipp Hager , Onno Zoeter , Maarten de Rijke

In modern recommendation systems, unbiased learning-to-rank (LTR) is crucial for prioritizing items from biased implicit user feedback, such as click data. Several techniques, such as Inverse Propensity Weighting (IPW), have been proposed…

Information Retrieval · Computer Science 2023-07-21 Keisho Oh , Naoki Nishimura , Minje Sung , Ken Kobayashi , Kazuhide Nakata

Counterfactual learning to rank (CLTR) has attracted extensive attention in the IR community for its ability to leverage massive logged user interaction data to train ranking models. While the CLTR models can be theoretically unbiased when…

Machine Learning · Computer Science 2025-08-29 Zechun Niu , Zhilin Zhang , Jiaxin Mao , Qingyao Ai , Ji-Rong Wen

Learning-to-rank (LTR) is a class of supervised learning techniques that apply to ranking problems dealing with a large number of features. The popularity and widespread application of LTR models in prioritizing information in a variety of…

Machine Learning · Computer Science 2020-05-19 Jaspreet Singh , Zhenye Wang , Megha Khosla , Avishek Anand

Existing multi-label ranking (MLR) frameworks only exploit information deduced from the bipartition of labels into positive and negative sets. Therefore, they do not benefit from ranking among positive labels, which is the novel MLR…

Machine Learning · Computer Science 2025-09-12 V. Bugra Yesilkaynak , Emine Dari , Alican Mertan , Gozde Unal

The Unbiased Learning-to-Rank framework has been recently proposed as a general approach to systematically remove biases, such as position bias, from learning-to-rank models. The method takes two steps - estimating click propensities and…

Information Retrieval · Computer Science 2019-10-23 Grigor Aslanyan , Utkarsh Porwal

This paper reports on findings from a comparative study on the effectiveness and efficiency of federated unlearning strategies within Federated Online Learning to Rank (FOLTR), with specific attention to systematically analysing the…

Information Retrieval · Computer Science 2025-05-20 Yiling Tao , Shuyi Wang , Jiaxi Yang , Guido Zuccon

Counterfactual learning to rank (CLTR) can be risky and, in various circumstances, can produce sub-optimal models that hurt performance when deployed. Safe CLTR was introduced to mitigate these risks when using inverse propensity scoring to…

Machine Learning · Computer Science 2024-09-17 Shashank Gupta , Harrie Oosterhuis , Maarten de Rijke

Counterfactual Learning to Rank (LTR) algorithms learn a ranking model from logged user interactions, often collected using a production system. Employing such an offline learning approach has many benefits compared to an online one, but it…

Machine Learning · Computer Science 2020-05-22 Rolf Jagerman , Maarten de Rijke

Learning to Rank (LTR) is one of the most widely used machine learning applications. It is a key component in platforms with profound societal impacts, including job search, healthcare information retrieval, and social media content feeds.…

Machine Learning · Computer Science 2024-02-09 My H. Dinh , James Kotary , Ferdinando Fioretto

Ranked search results have become the main mechanism by which we find content, products, places, and people online. Thus their ordering contributes not only to the satisfaction of the searcher, but also to career and business opportunities,…

Information Retrieval · Computer Science 2020-05-28 Meike Zehlike , Carlos Castillo

In learning-to-rank (LTR), optimizing only the relevance (or the expected ranking utility) can cause representational harm to certain categories of items. Moreover, if there is implicit bias in the relevance scores, LTR models may fail to…

Machine Learning · Computer Science 2023-08-28 Sruthi Gorantla , Eshaan Bhansali , Amit Deshpande , Anand Louis

Despite the popularity of the two-tower model for unbiased learning to rank (ULTR) tasks, recent work suggests that it suffers from a major limitation that could lead to its collapse in industry applications: the problem of logging policy…

Information Retrieval · Computer Science 2024-09-19 Morris de Haan , Philipp Hager

Contrastive learning-based recommendation algorithms have significantly advanced the field of self-supervised recommendation, particularly with BPR as a representative ranking prediction task that dominates implicit collaborative filtering.…

Information Retrieval · Computer Science 2024-03-13 Shipeng Song , Bin Liu , Fei Teng , Tianrui Li

This paper studies human preference learning based on partially revealed choice behavior and formulates the problem as a generalized Bradley-Terry-Luce (BTL) ranking model that accounts for heterogeneous preferences. Specifically, we assume…

Methodology · Statistics 2025-09-03 Jianqing Fan , Hyukjun Kwon , Xiaonan Zhu