English
Related papers

Related papers: Model-based Unbiased Learning to Rank

200 papers

Nowadays, recommender systems already impact almost every facet of peoples lives. To provide personalized high quality recommendation results, conventional systems usually train pointwise rankers to predict the absolute value of objectives…

Information Retrieval · Computer Science 2021-12-01 Yi Ren , Hongyan Tang , Siwen Zhu

Online learning to rank (OLTR) aims to learn a ranker directly from implicit feedback derived from users' interactions, such as clicks. Clicks however are a biased signal: specifically, top-ranked documents are likely to attract more clicks…

Information Retrieval · Computer Science 2022-01-06 Shengyao Zhuang , Zhihao Qiao , Guido Zuccon

Unbiased learning to rank (ULTR) aims to train an unbiased ranking model from biased user click logs. Most of the current ULTR methods are based on the examination hypothesis (EH), which assumes that the click probability can be factorized…

Information Retrieval · Computer Science 2022-06-14 Mouxiang Chen , Chenghao Liu , Zemin Liu , Jianling Sun

Implicit feedback data, such as user clicks, is commonly used in learning-to-rank (LTR) systems because it is easy to collect and it often reflects user preferences. However, this data is prone to various biases, and training an LTR…

Information Retrieval · Computer Science 2026-01-30 Md Aminul Islam , Kathryn Vasilaky , Elena Zheleva

In modern recommendation systems, unbiased learning-to-rank (LTR) is crucial for prioritizing items from biased implicit user feedback, such as click data. Several techniques, such as Inverse Propensity Weighting (IPW), have been proposed…

Information Retrieval · Computer Science 2023-07-21 Keisho Oh , Naoki Nishimura , Minje Sung , Ken Kobayashi , Kazuhide Nakata

Unbiased Learning to Rank (ULTR) studies the problem of learning a ranking function based on biased user interactions. In this framework, ULTR algorithms have to rely on a large amount of user data that are collected, stored, and aggregated…

Information Retrieval · Computer Science 2021-05-12 Chang Li , Hua Ouyang

Pairwise debiasing is one of the most effective strategies in reducing position bias in learning-to-rank (LTR) models. However, limiting the scope of this strategy, are the underlying assumptions required by many pairwise debiasing…

Information Retrieval · Computer Science 2022-07-19 Alexey Kurennoy , John Coleman , Ian Harris , Alice Lynch , Oisin Mac Fhearai , Daphne Tsatsoulis

An effective ranking model usually requires a large amount of training data to learn the relevance between documents and queries. User clicks are often used as training data since they can indicate relevance and are cheap to collect, but…

Information Retrieval · Computer Science 2023-02-21 Xiaojie Sun , Lulu Yu , Yiting Wang , Keping Bi , Jiafeng Guo

Clicks on rankings suffer from position-bias: generally items on lower ranks are less likely to be examined - and thus clicked - by users, in spite of their actual preferences between items. The prevalent approach to unbiased click-based…

Machine Learning · Computer Science 2022-11-01 Harrie Oosterhuis

Learning to Rank (LTR) models learn from historical user interactions, such as user clicks. However, there is an inherent bias in the clicks of users due to position bias, i.e., users are more likely to click highly-ranked documents than…

Information Retrieval · Computer Science 2025-07-11 Zeyan Liang , Graham McDonald , Iadh Ounis

Generally speaking, the model training for recommender systems can be based on two types of data, namely explicit feedback and implicit feedback. Moreover, because of its general availability, we see wide adoption of implicit feedback data,…

Information Retrieval · Computer Science 2023-04-17 Yi Ren , Hongyan Tang , Jiangpeng Rong , Siwen Zhu

Learning-to-rank (LTR) algorithms are ubiquitous and necessary to explore the extensive catalogs of media providers. To avoid the user examining all the results, its preferences are used to provide a subset of relatively small size. The…

Recent advances in unbiased learning to rank (LTR) count on Inverse Propensity Scoring (IPS) to eliminate bias in implicit feedback. Though theoretically sound in correcting the bias introduced by treating clicked documents as relevant, IPS…

Information Retrieval · Computer Science 2021-11-16 Nan Wang , Zhen Qin , Xuanhui Wang , Hongning Wang

Despite the impressive improvements achieved by unsupervised deep neural networks in computer vision and NLP tasks, such improvements have not yet been observed in ranking for information retrieval. The reason may be the complexity of the…

Information Retrieval · Computer Science 2017-05-30 Mostafa Dehghani , Hamed Zamani , Aliaksei Severyn , Jaap Kamps , W. Bruce Croft

Counterfactual learning to rank (CLTR) has attracted extensive attention in the IR community for its ability to leverage massive logged user interaction data to train ranking models. While the CLTR models can be theoretically unbiased when…

Machine Learning · Computer Science 2025-08-29 Zechun Niu , Zhilin Zhang , Jiaxin Mao , Qingyao Ai , Ji-Rong Wen

Ranking items regarding individual user interests is a core technique of multiple downstream tasks such as recommender systems. Learning such a personalized ranker typically relies on the implicit feedback from users' past click-through…

Information Retrieval · Computer Science 2024-01-24 Jiarui Jin , Zexue He , Mengyue Yang , Weinan Zhang , Yong Yu , Jun Wang , Julian McAuley

Learning-to-Rank (LTR) is a supervised machine learning approach that constructs models specifically designed to order a set of items or documents based on their relevance or importance to a given query or context. Despite significant…

Information Retrieval · Computer Science 2026-04-17 Camilo Gomez , Pengyang Wang , Yanjie Fu

Unbiased learning to rank has been proposed to alleviate the biases in the search ranking, making it possible to train ranking models with user interaction data. In real applications, search engines are designed to display only the most…

Information Retrieval · Computer Science 2024-06-14 Haiyuan Zhao , Jun Xu , Xiao Zhang , Guohao Cai , Zhenhua Dong , Ji-Rong Wen

Increasing users' positive interactions, such as purchases or clicks, is an important objective of recommender systems. Recommenders typically aim to select items that users will interact with. If the recommended items are purchased, an…

Machine Learning · Computer Science 2020-09-24 Masahiro Sato , Sho Takemori , Janmajay Singh , Tomoko Ohkuma

This tutorial covers and contrasts the two main methodologies in unbiased Learning to Rank (LTR): Counterfactual LTR and Online LTR. There has long been an interest in LTR from user interactions, however, this form of implicit feedback is…

Information Retrieval · Computer Science 2019-07-18 Harrie Oosterhuis , Rolf Jagerman , Maarten de Rijke