English
Related papers

Related papers: Unbiased Learning-to-Rank with Biased Feedback

200 papers

A well-known problem when learning from user clicks are inherent biases prevalent in the data, such as position or trust bias. Click models are a common method for extracting information from user clicks, such as document relevance in web…

Information Retrieval · Computer Science 2024-12-17 Romain Deffayet , Philipp Hager , Jean-Michel Renders , Maarten de Rijke

Ranked search results have become the main mechanism by which we find content, products, places, and people online. Thus their ordering contributes not only to the satisfaction of the searcher, but also to career and business opportunities,…

Information Retrieval · Computer Science 2020-05-28 Meike Zehlike , Carlos Castillo

Counterfactual Learning to Rank (LTR) algorithms learn a ranking model from logged user interactions, often collected using a production system. Employing such an offline learning approach has many benefits compared to an online one, but it…

Machine Learning · Computer Science 2020-05-22 Rolf Jagerman , Maarten de Rijke

Recommendation is the task of improving customer experience through personalized recommendation based on users' past feedback. In this paper, we investigate the most common scenario: the user-item (U-I) matrix of implicit feedback. Even…

Machine Learning · Computer Science 2017-07-21 Peng Yang , Peilin Zhao , Xin Gao , Yong Liu

This paper evaluates the robustness of learning from implicit feedback in web search. In particular, we create a model of user behavior by drawing upon user studies in laboratory and real-world settings. The model is used to understand the…

Machine Learning · Computer Science 2007-05-23 Filip Radlinski , Thorsten Joachims

Existing online learning to rank (OL2R) solutions are limited to linear models, which are incompetent to capture possible non-linear relations between queries and documents. In this work, to unleash the power of representation learning in…

Information Retrieval · Computer Science 2022-01-19 Yiling Jia , Hongning Wang

In this paper, we propose a robust sequential learning strategy for training large-scale Recommender Systems (RS) over implicit feedback mainly in the form of clicks. Our approach relies on the minimization of a pairwise ranking loss over…

Information Retrieval · Computer Science 2021-09-15 Alexandra Burashnikova , Yury Maximov , Massih-Reza Amini

Leveraging biased click data for optimizing learning to rank systems has been a popular approach in information retrieval. Because click data is often noisy and biased, a variety of methods have been proposed to construct unbiased learning…

Information Retrieval · Computer Science 2020-08-21 Tao Yang , Shikai Fang , Shibo Li , Yulan Wang , Qingyao Ai

Unbiased Learning to Rank (ULTR) aims to train unbiased ranking models from biased click logs, by explicitly modeling a generation process for user behavior and fitting click data based on examination hypothesis. Previous research found…

Information Retrieval · Computer Science 2024-05-27 Mouxiang Chen , Chenghao Liu , Zemin Liu , Zhuo Li , Jianling Sun

We propose a new online learning model for learning with preference feedback. The model is especially suited for applications like web search and recommender systems, where preference data is readily available from implicit user feedback…

Machine Learning · Computer Science 2011-11-04 Pannagadatta K. Shivaswamy , Thorsten Joachims

Many platforms on the web present ranked lists of content to users, typically optimized for engagement-, satisfaction- or retention- driven metrics. Advances in the Learning-to-Rank (LTR) research literature have enabled rapid growth in…

Information Retrieval · Computer Science 2024-01-09 Hitesh Sagtani , Olivier Jeunen , Aleksei Ustimenko

Users' clicks on Web search results are one of the key signals for evaluating and improving web search quality and have been widely used as part of current state-of-the-art Learning-To-Rank(LTR) models. With a large volume of search logs…

Information Retrieval · Computer Science 2021-05-24 Jianghong Zhou , Sayyed M. Zahiri , Simon Hughes , Khalifeh Al Jadda , Surya Kallumadi , Eugene Agichtein

Unbiased learning to rank has been proposed to alleviate the biases in the search ranking, making it possible to train ranking models with user interaction data. In real applications, search engines are designed to display only the most…

Information Retrieval · Computer Science 2024-06-14 Haiyuan Zhao , Jun Xu , Xiao Zhang , Guohao Cai , Zhenhua Dong , Ji-Rong Wen

Rankings are the primary interface through which many online platforms match users to items (e.g. news, products, music, video). In these two-sided markets, not only the users draw utility from the rankings, but the rankings also determine…

Information Retrieval · Computer Science 2020-06-01 Marco Morik , Ashudeep Singh , Jessica Hong , Thorsten Joachims

Information retrieval systems, such as online marketplaces, news feeds, and search engines, are ubiquitous in today's digital society. They facilitate information discovery by ranking retrieved items on predicted relevance, i.e. likelihood…

Econometrics · Economics 2022-05-16 Rina Friedberg , Karthik Rajkumar , Jialiang Mao , Qian Yao , YinYin Yu , Min Liu

Implicit feedback has been widely used to build commercial recommender systems. Because observed feedback represents users' click logs, there is a semantic gap between true relevance and observed feedback. More importantly, observed…

Information Retrieval · Computer Science 2022-07-27 Jae-woong Lee , Seongmin Park , Joonseok Lee , Jongwuk Lee

Item recommendation is the task of predicting a personalized ranking on a set of items (e.g. websites, movies, products). In this paper, we investigate the most common scenario with implicit feedback (e.g. clicks, purchases). There are many…

Information Retrieval · Computer Science 2012-05-14 Steffen Rendle , Christoph Freudenthaler , Zeno Gantner , Lars Schmidt-Thieme

Selection bias is prevalent in the data for training and evaluating recommendation systems with explicit feedback. For example, users tend to rate items they like. However, when rating an item concerning a specific user, most of the…

Information Retrieval · Computer Science 2021-09-14 Weishen Pan , Sen Cui , Hongyi Wen , Kun Chen , Changshui Zhang , Fei Wang

Recent work in recommender systems has emphasized the importance of fairness, with a particular interest in bias and transparency, in addition to predictive accuracy. In this paper, we focus on the state of the art pairwise ranking model,…

Information Retrieval · Computer Science 2021-08-02 Khalil Damak , Sami Khenissi , Olfa Nasraoui

As learning-to-rank models are increasingly deployed for decision-making in areas with profound life implications, the FairML community has been developing fair learning-to-rank (LTR) models. These models rely on the availability of…

Machine Learning · Computer Science 2024-07-25 Oluseun Olulana , Kathleen Cachel , Fabricio Murai , Elke Rundensteiner