English
Related papers

Related papers: An Offline Metric for the Debiasedness of Click Mo…

200 papers

Click-based learning to rank (LTR) tackles the mismatch between click frequencies on items and their actual relevance. The approach of previous work has been to assume a model of click behavior and to subsequently introduce a method for…

Information Retrieval · Computer Science 2022-06-27 Harrie Oosterhuis

Implicit feedback (e.g., clicks, dwell times, etc.) is an abundant source of data in human-interactive systems. While implicit feedback has many advantages (e.g., it is inexpensive to collect, user centric, and timely), its inherent biases…

Information Retrieval · Computer Science 2016-08-17 Thorsten Joachims , Adith Swaminathan , Tobias Schnabel

Although click data is widely used in search systems in practice, so far the inherent bias, most notably position bias, has prevented it from being used in training of a ranker for search, i.e., learning-to-rank. Recently, a number of…

Information Retrieval · Computer Science 2019-02-28 Ziniu Hu , Yang Wang , Qu Peng , Hang Li

Learning-to-Rank (LTR) models trained from implicit feedback (e.g. clicks) suffer from inherent biases. A well-known one is the position bias -- documents in top positions are more likely to receive clicks due in part to their position…

Information Retrieval · Computer Science 2020-07-21 Mucun Tian , Chun Guo , Vito Ostuni , Zhen Zhu

Users' clicks on Web search results are one of the key signals for evaluating and improving web search quality and have been widely used as part of current state-of-the-art Learning-To-Rank(LTR) models. With a large volume of search logs…

Information Retrieval · Computer Science 2021-05-24 Jianghong Zhou , Sayyed M. Zahiri , Simon Hughes , Khalifeh Al Jadda , Surya Kallumadi , Eugene Agichtein

Unbiased Learning to Rank (ULTR) that learns to rank documents with biased user feedback data is a well-known challenge in information retrieval. Existing methods in unbiased learning to rank typically rely on click modeling or inverse…

Information Retrieval · Computer Science 2023-02-09 Dan Luo , Lixin Zou , Qingyao Ai , Zhiyu Chen , Dawei Yin , Brian D. Davison

Implicit feedback data, such as user clicks, is commonly used in learning-to-rank (LTR) systems because it is easy to collect and it often reflects user preferences. However, this data is prone to various biases, and training an LTR…

Information Retrieval · Computer Science 2026-01-30 Md Aminul Islam , Kathryn Vasilaky , Elena Zheleva

Learning to rank with biased click data is a well-known challenge. A variety of methods has been explored to debias click data for learning to rank such as click models, result interleaving and, more recently, the unbiased learning-to-rank…

Information Retrieval · Computer Science 2018-04-25 Qingyao Ai , Keping Bi , Cheng Luo , Jiafeng Guo , W. Bruce Croft

The purpose of modeling document relevance for search engines is to rank better in subsequent searches. Document-specific historical click-through rates can be important features in a dynamic ranking system which updates as we accumulate…

Information Retrieval · Computer Science 2024-02-06 Richard Demsyn-Jones

News recommendation is critical for personalized news access. Existing news recommendation methods usually infer users' personal interest based on their historical clicked news, and train the news recommendation models by predicting future…

Information Retrieval · Computer Science 2021-04-16 Jingwei Yi , Fangzhao Wu , Chuhan Wu , Qifei Li , Guangzhong Sun , Xing Xie

Click-through data has proven to be a valuable resource for improving search-ranking quality. Search engines can easily collect click data, but biases introduced in the data can make it difficult to use the data effectively. In order to…

Machine Learning · Computer Science 2020-02-13 Yingcheng Sun , Richard Kolacinski , Kenneth Loparo

Many web systems rank and present a list of items to users, from recommender systems to search and advertising. An important problem in practice is to evaluate new ranking policies offline and optimize them before they are deployed. We…

Machine Learning · Computer Science 2018-06-15 Shuai Li , Yasin Abbasi-Yadkori , Branislav Kveton , S. Muthukrishnan , Vishwa Vinay , Zheng Wen

News recommendation is important for improving news reading experience of users. Users' news click behaviors are widely used for inferring user interests and predicting future clicks. However, click behaviors are heavily affected by the…

Information Retrieval · Computer Science 2021-06-14 Chuhan Wu , Fangzhao Wu , Yongfeng Huang

In web search and recommendation systems, user clicks are widely used to train ranking models. However, click data is heavily biased, i.e., users tend to click higher-ranked items (position bias), choose only what was shown to them…

Artificial Intelligence · Computer Science 2026-01-12 Haoming Gong , Qingyao Ai , Zhihao Tao , Yongfeng Zhang

Nowadays, search ranking and recommendation systems rely on a lot of data to train machine learning models such as Learning-to-Rank (LTR) models to rank results for a given query, and implicit user feedbacks (e.g. click data) have become…

Information Retrieval · Computer Science 2020-03-02 Yinxiao Li

Optimizing an interactive system against a predefined online metric is particularly challenging, when the metric is computed from user feedback such as clicks and payments. The key challenge is the counterfactual nature: in the case of Web…

Machine Learning · Computer Science 2014-03-13 Lihong Li , Shunbao Chen , Jim Kleban , Ankur Gupta

Additive two-tower models are popular learning-to-rank methods for handling biased user feedback in industry settings. Recent studies, however, report a concerning phenomenon: training two-tower models on clicks collected by well-performing…

Information Retrieval · Computer Science 2025-09-01 Philipp Hager , Onno Zoeter , Maarten de Rijke

Eliciting user preferences from purchase records for performing purchase prediction is challenging because negative feedback is not explicitly observed, and because treating all non-purchased items equally as negative feedback is…

Information Retrieval · Computer Science 2020-06-01 Chanyoung Park , Donghyun Kim , Min-Chul Yang , Jung-Tae Lee , Hwanjo Yu

Considerable efforts to measure and mitigate gender bias in recent years have led to the introduction of an abundance of tasks, datasets, and metrics used in this vein. In this position paper, we assess the current paradigm of gender bias…

Computation and Language · Computer Science 2022-10-21 Hadas Orgad , Yonatan Belinkov

This thesis contributes a structured inquiry into the open actuarial mathematics problem of modelling user behaviour using machine learning methods, in order to predict purchase intent of non-life insurance products. It is valuable for a…

Information Retrieval · Computer Science 2021-12-06 Simone Borg Bruun
‹ Prev 1 2 3 10 Next ›