English
Related papers

Related papers: De-Biased Modelling of Search Click Behavior with …

200 papers

Although click data is widely used in search systems in practice, so far the inherent bias, most notably position bias, has prevented it from being used in training of a ranker for search, i.e., learning-to-rank. Recently, a number of…

Information Retrieval · Computer Science 2019-02-28 Ziniu Hu , Yang Wang , Qu Peng , Hang Li

An effective ranking model usually requires a large amount of training data to learn the relevance between documents and queries. User clicks are often used as training data since they can indicate relevance and are cheap to collect, but…

Information Retrieval · Computer Science 2023-02-21 Xiaojie Sun , Lulu Yu , Yiting Wang , Keping Bi , Jiafeng Guo

Clickthrough data is a particularly inexpensive and plentiful resource to obtain implicit relevance feedback for improving and personalizing search engines. However, it is well known that the probability of a user clicking on a result is…

Information Retrieval · Computer Science 2007-05-23 Filip Radlinski , Thorsten Joachims

Modern information retrieval systems, including web search, ads placement, and recommender systems, typically rely on learning from user feedback. Click models, which study how users interact with a ranked list of items, provide a useful…

Information Retrieval · Computer Science 2021-04-20 Xinyi Dai , Jianghao Lin , Weinan Zhang , Shuai Li , Weiwen Liu , Ruiming Tang , Xiuqiang He , Jianye Hao , Jun Wang , Yong Yu

Reinforcement learning (RL) agents improve through trial-and-error, but when reward is sparse and the agent cannot discover successful action sequences, learning stagnates. This has been a notable problem in training deep RL agents to…

Artificial Intelligence · Computer Science 2018-02-27 Evan Zheran Liu , Kelvin Guu , Panupong Pasupat , Tianlin Shi , Percy Liang

Unbiased learning to rank (ULTR) aims to mitigate various biases existing in user clicks, such as position bias, trust bias, presentation bias, and learn an effective ranker. In this paper, we introduce our winning approach for the…

Information Retrieval · Computer Science 2023-02-16 Lulu Yu , Yiting Wang , Xiaojie Sun , Keping Bi , Jiafeng Guo

Click-through rate (CTR) Prediction is of great importance in real-world online ads systems. One challenge for the CTR prediction task is to capture the real interest of users from their clicked items, which is inherently biased by…

Information Retrieval · Computer Science 2022-04-04 Congcong Liu , Yuejiang Li , Jian Zhu , Xiwei Zhao , Changping Peng , Zhangang Lin , Jingping Shao

Most existing unbiased learning-to-rank (ULTR) approaches are based on the user examination hypothesis, which assumes that users will click a result only if it is both relevant and observed (typically modeled by position). However, in…

Information Retrieval · Computer Science 2025-02-19 Lulu Yu , Keping Bi , Jiafeng Guo , Shihao Liu , Dawei Yin , Xueqi Cheng

Unbiased Learning to Rank (ULTR) that learns to rank documents with biased user feedback data is a well-known challenge in information retrieval. Existing methods in unbiased learning to rank typically rely on click modeling or inverse…

Information Retrieval · Computer Science 2023-02-09 Dan Luo , Lixin Zou , Qingyao Ai , Zhiyu Chen , Dawei Yin , Brian D. Davison

Ranking systems form the basis for online search engines and recommendation services. They process large collections of items, for instance web pages or e-commerce products, and present the user with a small ordered selection. The goal of a…

Information Retrieval · Computer Science 2020-12-14 Harrie Oosterhuis

Counterfactual learning to rank (CLTR) has attracted extensive attention in the IR community for its ability to leverage massive logged user interaction data to train ranking models. While the CLTR models can be theoretically unbiased when…

Machine Learning · Computer Science 2025-08-29 Zechun Niu , Zhilin Zhang , Jiaxin Mao , Qingyao Ai , Ji-Rong Wen

With the rapid growth of user historical behavior data, user interest modeling has become a prominent aspect in Click-Through Rate (CTR) prediction, focusing on learning user intent representations. However, this complexity poses…

Information Retrieval · Computer Science 2025-05-09 Xin Song , Xiaochen Li , Jinxin Hu , Hong Wen , Zulong Chen , Yu Zhang , Xiaoyi Zeng , Jing Zhang

Large-scale supervised data is essential for training modern ranking models, but obtaining high-quality human annotations is costly. Click data has been widely used as a low-cost alternative, and with recent advances in large language…

Information Retrieval · Computer Science 2025-11-11 Lulu Yu , Keping Bi , Jiafeng Guo , Shihao Liu , Shuaiqiang Wang , Dawei Yin , Xueqi Cheng

User interaction data is an important source of supervision in counterfactual learning to rank (CLTR). Such data suffers from presentation bias. Much work in unbiased learning to rank (ULTR) focuses on position bias, i.e., items at higher…

Information Retrieval · Computer Science 2023-05-02 Fatemeh Sarvi , Ali Vardasbi , Mohammad Aliannejadi , Sebastian Schelter , Maarten de Rijke

Unbiased learning to rank has been proposed to alleviate the biases in the search ranking, making it possible to train ranking models with user interaction data. In real applications, search engines are designed to display only the most…

Information Retrieval · Computer Science 2024-06-14 Haiyuan Zhao , Jun Xu , Xiao Zhang , Guohao Cai , Zhenhua Dong , Ji-Rong Wen

Unbiased learning to rank (ULTR) studies the problem of mitigating various biases from implicit user feedback data such as clicks, and has been receiving considerable attention recently. A popular ULTR approach for real-world applications…

Information Retrieval · Computer Science 2023-06-06 Yunan Zhang , Le Yan , Zhen Qin , Honglei Zhuang , Jiaming Shen , Xuanhui Wang , Michael Bendersky , Marc Najork

Click prediction is one of the fundamental problems in sponsored search. Most of existing studies took advantage of machine learning approaches to predict ad click for each event of ad view independently. However, as observed in the…

Information Retrieval · Computer Science 2014-07-29 Yuyu Zhang , Hanjun Dai , Chang Xu , Jun Feng , Taifeng Wang , Jiang Bian , Bin Wang , Tie-Yan Liu

Off-policy Learning to Rank (LTR) aims to optimize a ranker from data collected by a deployed logging policy. However, existing off-policy learning to rank methods often make strong assumptions about how users generate the click data, i.e.,…

Machine Learning · Computer Science 2023-10-31 Zeyu Zhang , Yi Su , Hui Yuan , Yiran Wu , Rishab Balasubramanian , Qingyun Wu , Huazheng Wang , Mengdi Wang

Search, recommendation, and online advertising are the three most important information-providing mechanisms on the web. These information seeking techniques, satisfying users' information needs by suggesting users personalized objects…

Information Retrieval · Computer Science 2020-01-20 Xiangyu Zhao , Long Xia , Jiliang Tang , Dawei Yin

Unbiased Learning to Rank (ULTR) aims to leverage biased implicit user feedback (e.g., click) to optimize an unbiased ranking model. The effectiveness of the existing ULTR methods has primarily been validated on synthetic datasets. However,…

Information Retrieval · Computer Science 2024-08-20 Lulu Yu , Keping Bi , Shiyu Ni , Jiafeng Guo