English
Related papers

Related papers: Correcting for Position Bias in Learning to Rank: …

200 papers

Existing online learning to rank (OL2R) solutions are limited to linear models, which are incompetent to capture possible non-linear relations between queries and documents. In this work, to unleash the power of representation learning in…

Information Retrieval · Computer Science 2022-01-19 Yiling Jia , Hongning Wang

Optimizing ranking systems based on user interactions is a well-studied problem. State-of-the-art methods for optimizing ranking systems based on user interactions are divided into online approaches - that learn by directly interacting with…

Information Retrieval · Computer Science 2020-12-09 Harrie Oosterhuis , Maarten de Rijke

Unbiased learning to rank (ULTR), which aims to learn unbiased ranking models from biased user behavior logs, plays an important role in Web search. Previous research on ULTR has studied a variety of biases in users' clicks, such as…

Information Retrieval · Computer Science 2025-08-29 Zechun Niu , Lang Mei , Liu Yang , Ziyuan Zhao , Qiang Yan , Jiaxin Mao , Ji-Rong Wen

Many platforms on the web present ranked lists of content to users, typically optimized for engagement-, satisfaction- or retention- driven metrics. Advances in the Learning-to-Rank (LTR) research literature have enabled rapid growth in…

Information Retrieval · Computer Science 2024-01-09 Hitesh Sagtani , Olivier Jeunen , Aleksei Ustimenko

Presentation bias is one of the key challenges when learning from implicit feedback in search engines, as it confounds the relevance signal. While it was recently shown how counterfactual learning-to-rank (LTR) approaches…

Information Retrieval · Computer Science 2018-12-14 Aman Agarwal , Ivan Zaitsev , Xuanhui Wang , Cheng Li , Marc Najork , Thorsten Joachims

Ranking is at the core of many artificial intelligence (AI) applications, including search engines, recommender systems, etc. Modern ranking systems are often constructed with learning-to-rank (LTR) models built from user behavior signals.…

Information Retrieval · Computer Science 2023-05-29 Tao Yang , Cuize Han , Chen Luo , Parth Gupta , Jeff M. Phillips , Qingyao Ai

The goal of unbiased learning to rank (ULTR) is to leverage implicit user feedback for optimizing learning-to-rank systems. Among existing solutions, automatic ULTR algorithms that jointly learn user bias models (i.e., propensity models)…

Information Retrieval · Computer Science 2023-07-11 Dan Luo , Lixin Zou , Qingyao Ai , Zhiyu Chen , Chenliang Li , Dawei Yin , Brian D. Davison

Rankings are the primary interface through which many online platforms match users to items (e.g. news, products, music, video). In these two-sided markets, not only the users draw utility from the rankings, but the rankings also determine…

Information Retrieval · Computer Science 2020-06-01 Marco Morik , Ashudeep Singh , Jessica Hong , Thorsten Joachims

Recent advances in unbiased learning to rank (LTR) count on Inverse Propensity Scoring (IPS) to eliminate bias in implicit feedback. Though theoretically sound in correcting the bias introduced by treating clicked documents as relevant, IPS…

Information Retrieval · Computer Science 2021-11-16 Nan Wang , Zhen Qin , Xuanhui Wang , Hongning Wang

The Unbiased Learning-to-Rank framework has been recently proposed as a general approach to systematically remove biases, such as position bias, from learning-to-rank models. The method takes two steps - estimating click propensities and…

Information Retrieval · Computer Science 2019-10-23 Grigor Aslanyan , Utkarsh Porwal

Learning to Rank (LTR) models learn from historical user interactions, such as user clicks. However, there is an inherent bias in the clicks of users due to position bias, i.e., users are more likely to click highly-ranked documents than…

Information Retrieval · Computer Science 2025-07-11 Zeyan Liang , Graham McDonald , Iadh Ounis

Learning the optimal ordering of content is an important challenge in website design. The learning to rank (LTR) framework models this problem as a sequential problem of selecting lists of content and observing where users decide to click.…

Machine Learning · Computer Science 2023-05-12 James A. Grant , David S. Leslie

Ranking systems form the basis for online search engines and recommendation services. They process large collections of items, for instance web pages or e-commerce products, and present the user with a small ordered selection. The goal of a…

Information Retrieval · Computer Science 2020-12-14 Harrie Oosterhuis

A well-known problem when learning from user clicks are inherent biases prevalent in the data, such as position or trust bias. Click models are a common method for extracting information from user clicks, such as document relevance in web…

Information Retrieval · Computer Science 2024-12-17 Romain Deffayet , Philipp Hager , Jean-Michel Renders , Maarten de Rijke

Ranked search results have become the main mechanism by which we find content, products, places, and people online. Thus their ordering contributes not only to the satisfaction of the searcher, but also to career and business opportunities,…

Information Retrieval · Computer Science 2020-05-28 Meike Zehlike , Carlos Castillo

Fairness is a popular research topic in recent years. A research topic closely related to fairness is bias and debiasing. Among different types of bias problems, position bias is one of the most widely encountered symptoms. Position bias…

Information Retrieval · Computer Science 2024-01-31 Hao Wang

The purpose of modeling document relevance for search engines is to rank better in subsequent searches. Document-specific historical click-through rates can be important features in a dynamic ranking system which updates as we accumulate…

Information Retrieval · Computer Science 2024-02-06 Richard Demsyn-Jones

Learning-to-rank (LTR) is a class of supervised learning techniques that apply to ranking problems dealing with a large number of features. The popularity and widespread application of LTR models in prioritizing information in a variety of…

Machine Learning · Computer Science 2020-05-19 Jaspreet Singh , Zhenye Wang , Megha Khosla , Avishek Anand

For industrial learning-to-rank (LTR) systems, it is common that the output of a ranking model is modified, either as a results of post-processing logic that enforces business requirements, or as a result of unforeseen design flaws or bugs…

Information Retrieval · Computer Science 2023-11-06 Matej Jakimov , Alexander Buchholz , Yannik Stein , Thorsten Joachims

Large Language Models (LLMs) are being increasingly explored as general-purpose tools for recommendation tasks, enabling zero-shot and instruction-following capabilities without the need for task-specific training. While the research…

Information Retrieval · Computer Science 2025-08-05 Ethan Bito , Yongli Ren , Estrid He