English
Related papers

Related papers: Ranker-agnostic Contextual Position Bias Estimatio…

200 papers

Recommender and search systems commonly rely on Learning To Rank models trained on logged user interactions to order items by predicted relevance. However, such interaction data is often subject to position bias, as users are more likely to…

Information Retrieval · Computer Science 2025-09-05 Aleksandr V. Petrov , Michael Murtagh , Karthik Nagesh

The goal of unbiased learning to rank (ULTR) is to leverage implicit user feedback for optimizing learning-to-rank systems. Among existing solutions, automatic ULTR algorithms that jointly learn user bias models (i.e., propensity models)…

Information Retrieval · Computer Science 2023-07-11 Dan Luo , Lixin Zou , Qingyao Ai , Zhiyu Chen , Chenliang Li , Dawei Yin , Brian D. Davison

Clicks on rankings suffer from position-bias: generally items on lower ranks are less likely to be examined - and thus clicked - by users, in spite of their actual preferences between items. The prevalent approach to unbiased click-based…

Machine Learning · Computer Science 2022-11-01 Harrie Oosterhuis

Online learning to rank (OLTR) aims to learn a ranker directly from implicit feedback derived from users' interactions, such as clicks. Clicks however are a biased signal: specifically, top-ranked documents are likely to attract more clicks…

Information Retrieval · Computer Science 2022-01-06 Shengyao Zhuang , Zhihao Qiao , Guido Zuccon

Unbiased Learning to Rank (ULTR) that learns to rank documents with biased user feedback data is a well-known challenge in information retrieval. Existing methods in unbiased learning to rank typically rely on click modeling or inverse…

Information Retrieval · Computer Science 2023-02-09 Dan Luo , Lixin Zou , Qingyao Ai , Zhiyu Chen , Dawei Yin , Brian D. Davison

Web applications where users are presented with a limited selection of items have long employed ranking models to put the most relevant results first. Any feedback received from users is typically assumed to reflect a relative judgement on…

Information Retrieval · Computer Science 2023-06-12 Maarten Buyl , Paul Missault , Pierre-Antoine Sondag

Ranking items regarding individual user interests is a core technique of multiple downstream tasks such as recommender systems. Learning such a personalized ranker typically relies on the implicit feedback from users' past click-through…

Information Retrieval · Computer Science 2024-01-24 Jiarui Jin , Zexue He , Mengyue Yang , Weinan Zhang , Yong Yu , Jun Wang , Julian McAuley

Unbiased learning to rank (ULTR) studies the problem of mitigating various biases from implicit user feedback data such as clicks, and has been receiving considerable attention recently. A popular ULTR approach for real-world applications…

Information Retrieval · Computer Science 2023-06-06 Yunan Zhang , Le Yan , Zhen Qin , Honglei Zhuang , Jiaming Shen , Xuanhui Wang , Michael Bendersky , Marc Najork

Position bias is a critical problem in information retrieval when dealing with implicit yet biased user feedback data. Unbiased ranking methods typically rely on causality models and debias the user feedback through inverse propensity…

Information Retrieval · Computer Science 2020-05-27 Jiarui Jin , Yuchen Fang , Weinan Zhang , Kan Ren , Guorui Zhou , Jian Xu , Yong Yu , Jun Wang , Xiaoqiang Zhu , Kun Gai

Learning to Rank (LTR) models learn from historical user interactions, such as user clicks. However, there is an inherent bias in the clicks of users due to position bias, i.e., users are more likely to click highly-ranked documents than…

Information Retrieval · Computer Science 2025-07-11 Zeyan Liang , Graham McDonald , Iadh Ounis

Unbiased learning to rank (ULTR), which aims to learn unbiased ranking models from biased user behavior logs, plays an important role in Web search. Previous research on ULTR has studied a variety of biases in users' clicks, such as…

Information Retrieval · Computer Science 2025-08-29 Zechun Niu , Lang Mei , Liu Yang , Ziyuan Zhao , Qiang Yan , Jiaxin Mao , Ji-Rong Wen

Learning to rank is a key component of many e-commerce search engines. In learning to rank, one is interested in optimising the global ordering of a list of items according to their utility for users.Popular approaches learn a scoring…

Information Retrieval · Computer Science 2021-05-25 Przemysław Pobrotyn , Tomasz Bartczak , Mikołaj Synowiec , Radosław Białobrzeski , Jarosław Bojar

Besides position bias, which has been well-studied, trust bias is another type of bias prevalent in user interactions with rankings: users are more likely to click incorrectly w.r.t. their preferences on highly ranked items because they…

Information Retrieval · Computer Science 2020-09-10 Ali Vardasbi , Harrie Oosterhuis , Maarten de Rijke

Learning-to-rank (LTR) has become a key technology in E-commerce applications. Most existing LTR approaches follow a supervised learning paradigm from offline labeled data collected from the online system. However, it has been noticed that…

Machine Learning · Computer Science 2021-01-01 Guangda Huzhang , Zhen-Jia Pang , Yongqing Gao , Yawen Liu , Weijie Shen , Wen-Ji Zhou , Qing Da , An-Xiang Zeng , Han Yu , Yang Yu , Zhi-Hua Zhou

When using LLMs to rank items based on given criteria, or evaluate answers, the order of candidate items can influence the model's final decision. This sensitivity to item positioning in a LLM's prompt is known as position bias. Prior…

Machine Learning · Computer Science 2025-07-25 Ali Vardasbi , Gustavo Penha , Claudia Hauff , Hugues Bouchard

Large Language Models (LLMs) are being increasingly explored as general-purpose tools for recommendation tasks, enabling zero-shot and instruction-following capabilities without the need for task-specific training. While the research…

Information Retrieval · Computer Science 2025-08-05 Ethan Bito , Yongli Ren , Estrid He

Most existing unbiased learning-to-rank (ULTR) approaches are based on the user examination hypothesis, which assumes that users will click a result only if it is both relevant and observed (typically modeled by position). However, in…

Information Retrieval · Computer Science 2025-02-19 Lulu Yu , Keping Bi , Jiafeng Guo , Shihao Liu , Dawei Yin , Xueqi Cheng

Understanding what users like is relatively straightforward; understanding what users dislike, however, remains a challenging and underexplored problem. Research into users' negative preferences has gained increasing importance in modern…

Information Retrieval · Computer Science 2026-01-23 Xinda Chen , Jiawei Wu , Yishuang Liu , Jialin Zhu , Shuwen Xiao , Junjun Zheng , Xiangheng Kong , Yuning Jiang

Clickthrough data is a particularly inexpensive and plentiful resource to obtain implicit relevance feedback for improving and personalizing search engines. However, it is well known that the probability of a user clicking on a result is…

Information Retrieval · Computer Science 2007-05-23 Filip Radlinski , Thorsten Joachims

Recommender systems widely use implicit feedback such as click data because of its general availability. Although the presence of clicks signals the users' preference to some extent, the lack of such clicks does not necessarily indicate a…

Machine Learning · Statistics 2022-06-16 Yuta Saito , Suguru Yaginuma , Yuta Nishino , Hayato Sakata , Kazuhide Nakata