English
Related papers

Related papers: Handling Position Bias for Unbiased Learning to Ra…

200 papers

Recommendation based on user preferences is a common task for e-commerce websites. New recommendation algorithms are often evaluated by offline comparison to baseline algorithms such as recommending random or the most popular items. Here,…

Unbiased Learning to Rank (ULTR) aims to leverage biased implicit user feedback (e.g., click) to optimize an unbiased ranking model. The effectiveness of the existing ULTR methods has primarily been validated on synthetic datasets. However,…

Information Retrieval · Computer Science 2024-08-20 Lulu Yu , Keping Bi , Shiyu Ni , Jiafeng Guo

Unbiased Learning to Rank (ULTR) studies the problem of learning a ranking function based on biased user interactions. In this framework, ULTR algorithms have to rely on a large amount of user data that are collected, stored, and aggregated…

Information Retrieval · Computer Science 2021-05-12 Chang Li , Hua Ouyang

Unbiased learning to rank (ULTR) studies the problem of mitigating various biases from implicit user feedback data such as clicks, and has been receiving considerable attention recently. A popular ULTR approach for real-world applications…

Information Retrieval · Computer Science 2023-06-06 Yunan Zhang , Le Yan , Zhen Qin , Honglei Zhuang , Jiaming Shen , Xuanhui Wang , Michael Bendersky , Marc Najork

We propose a neural network architecture for learning vector representations of hotels. Unlike previous works, which typically only use user click information for learning item embeddings, we propose a framework that combines several…

Information Retrieval · Computer Science 2019-10-10 Ali Sadeghian , Shervin Minaee , Ioannis Partalas , Xinxin Li , Daisy Zhe Wang , Brooke Cowan

Besides position bias, which has been well-studied, trust bias is another type of bias prevalent in user interactions with rankings: users are more likely to click incorrectly w.r.t. their preferences on highly ranked items because they…

Information Retrieval · Computer Science 2020-09-10 Ali Vardasbi , Harrie Oosterhuis , Maarten de Rijke

When using LLMs to rank items based on given criteria, or evaluate answers, the order of candidate items can influence the model's final decision. This sensitivity to item positioning in a LLM's prompt is known as position bias. Prior…

Machine Learning · Computer Science 2025-07-25 Ali Vardasbi , Gustavo Penha , Claudia Hauff , Hugues Bouchard

Retrieving target information based on input query is of fundamental importance in many real-world applications. In practice, it is not uncommon for the initial search to fail, where additional feedback information is needed to guide the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Zeyu Wang , Yu Wu

Pairwise debiasing is one of the most effective strategies in reducing position bias in learning-to-rank (LTR) models. However, limiting the scope of this strategy, are the underlying assumptions required by many pairwise debiasing…

Information Retrieval · Computer Science 2022-07-19 Alexey Kurennoy , John Coleman , Ian Harris , Alice Lynch , Oisin Mac Fhearai , Daphne Tsatsoulis

Position bias, i.e., users' preference of an item is affected by its placing position, is well studied in the recommender system literature. However, most existing methods ignore the widely coupled ranking bias, which is also related to the…

Information Retrieval · Computer Science 2024-05-30 Yao Zhao , Zhining Liu , Tianchi Cai , Haipeng Zhang , Chenyi Zhuang , Jinjie Gu

Learning the optimal ordering of content is an important challenge in website design. The learning to rank (LTR) framework models this problem as a sequential problem of selecting lists of content and observing where users decide to click.…

Machine Learning · Computer Science 2023-05-12 James A. Grant , David S. Leslie

This paper presents a novel approach for using clickthrough data to learn ranked retrieval functions for web search results. We observe that users searching the web often perform a sequence, or chain, of queries with a similar information…

Machine Learning · Computer Science 2007-05-23 Filip Radlinski , Thorsten Joachims

Eliciting user preferences from purchase records for performing purchase prediction is challenging because negative feedback is not explicitly observed, and because treating all non-purchased items equally as negative feedback is…

Information Retrieval · Computer Science 2020-06-01 Chanyoung Park , Donghyun Kim , Min-Chul Yang , Jung-Tae Lee , Hwanjo Yu

How to obtain an unbiased ranking model by learning to rank with biased user feedback is an important research question for IR. Existing work on unbiased learning to rank (ULTR) can be broadly categorized into two groups -- the studies on…

Information Retrieval · Computer Science 2020-12-03 Qingyao Ai , Tao Yang , Huazheng Wang , Jiaxin Mao

Counterfactual Learning to Rank (LTR) methods optimize ranking systems using logged user interactions that contain interaction biases. Existing methods are only unbiased if users are presented with all relevant items in every ranking. There…

Information Retrieval · Computer Science 2021-04-12 Harrie Oosterhuis , Maarten de Rijke

Traditional ranking systems optimize offline proxy objectives that rely on oversimplified assumptions about user behavior, often neglecting factors such as position bias and item diversity. Consequently, these models fail to improve true…

Information Retrieval · Computer Science 2025-10-21 Gaurav Bhatt , Kiran Koshy Thekumparampil , Tanmay Gangwani , Tesi Xiao , Leonid Sigal

Recent advances in unbiased learning to rank (LTR) count on Inverse Propensity Scoring (IPS) to eliminate bias in implicit feedback. Though theoretically sound in correcting the bias introduced by treating clicked documents as relevant, IPS…

Information Retrieval · Computer Science 2021-11-16 Nan Wang , Zhen Qin , Xuanhui Wang , Hongning Wang

Conventional bidding strategies for online display ad auction heavily relies on observed performance indicators such as clicks or conversions. A bidding strategy naively pursuing these easily observable metrics, however, fails to optimize…

Machine Learning · Computer Science 2020-07-10 Daisuke Moriwaki , Yuta Hayakawa , Isshu Munemasa , Yuta Saito , Akira Matsui

While recent years have witnessed a rapid growth of research papers on recommender system (RS), most of the papers focus on inventing machine learning models to better fit user behavior data. However, user behavior data is observational…

Information Retrieval · Computer Science 2021-12-30 Jiawei Chen , Hande Dong , Xiang Wang , Fuli Feng , Meng Wang , Xiangnan He

Modern web-based platforms show ranked lists of recommendations to users, attempting to maximise user satisfaction or business metrics. Typically, the goal of such systems boils down to maximising the exposure probability for items that are…

Information Retrieval · Computer Science 2023-07-27 Olivier Jeunen