English
Related papers

Related papers: Confidence Ranking for CTR Prediction

200 papers

We present the Learned Ranking Function (LRF), a system that takes short-term user-item behavior predictions as input and outputs a slate of recommendations that directly optimizes for long-term user satisfaction. Most previous work is…

Machine Learning · Computer Science 2024-08-14 Yi Wu , Daryl Chang , Jennifer She , Zhe Zhao , Li Wei , Lukasz Heldt

An effective ranking model usually requires a large amount of training data to learn the relevance between documents and queries. User clicks are often used as training data since they can indicate relevance and are cheap to collect, but…

Information Retrieval · Computer Science 2023-02-21 Xiaojie Sun , Lulu Yu , Yiting Wang , Keping Bi , Jiafeng Guo

Counterfactual learning to rank (CLTR) relies on exposure-based inverse propensity scoring (IPS), a LTR-specific adaptation of IPS to correct for position bias. While IPS can provide unbiased and consistent estimates, it often suffers from…

Information Retrieval · Computer Science 2023-05-03 Shashank Gupta , Harrie Oosterhuis , Maarten de Rijke

We study how standard auction objectives in sponsored search markets change with refinements in the prediction of the relevance (click-through rates) of ads. We study mechanisms that optimize for a convex combination of efficiency and…

Computer Science and Game Theory · Computer Science 2013-02-28 Mukund Sundararajan , Inbal Talgam-Cohen

Real-word search and recommender systems usually adopt a multi-stage ranking architecture, including matching, pre-ranking, ranking, and re-ranking. Previous works mainly focus on the ranking stage while very few focus on the pre-ranking…

Information Retrieval · Computer Science 2022-07-08 Yue Cao , XiaoJiang Zhou , Peihao Huang , Yao Xiao , Dayao Chen , Sheng Chen

Besides position bias, which has been well-studied, trust bias is another type of bias prevalent in user interactions with rankings: users are more likely to click incorrectly w.r.t. their preferences on highly ranked items because they…

Information Retrieval · Computer Science 2020-09-10 Ali Vardasbi , Harrie Oosterhuis , Maarten de Rijke

Practical machine learning systems often operate in multiple sequential stages, as seen in ranking and recommendation systems, which typically include a retrieval phase followed by a ranking phase. Effectively assessing prediction…

Information Retrieval · Computer Science 2025-02-04 Yunpeng Xu , Mufang Ying , Wenge Guo , Zhi Wei

Ranking models are extensively used in e-commerce for relevance estimation. These models often suffer from poor interpretability and no scale calibration, particularly when trained with typical ranking loss functions. This paper addresses…

Information Retrieval · Computer Science 2026-01-14 Piotr Bajger , Roman Dusek , Krzysztof Galias , Paweł Młyniec , Aleksander Wawer , Paweł Zawistowski

Click-Through Rate (CTR) prediction holds a pivotal place in online advertising and recommender systems since CTR prediction performance directly influences the overall satisfaction of the users and the revenue generated by companies. Even…

Information Retrieval · Computer Science 2024-05-22 Serdarcan Dilbaz , Hasan Saribas

Recommendation Systems have become integral to modern user experiences, but lack transparency in their decision-making processes. Existing explainable recommendation methods are hindered by reliance on a post-hoc paradigm, wherein…

Information Retrieval · Computer Science 2024-12-04 Xiaohan Yu , Li Zhang , Chong Chen

Ranking is a key aspect of many applications, such as information retrieval, question answering, ad placement and recommender systems. Learning to rank has the goal of estimating a ranking model automatically from training data. In…

Information Retrieval · Computer Science 2015-02-10 Truyen Tran , Dinh Phung , Svetha Venkatesh

Listwise learning-to-rank methods form a powerful class of ranking algorithms that are widely adopted in applications such as information retrieval. These algorithms learn to rank a set of items by optimizing a loss that is a function of…

Machine Learning · Computer Science 2021-02-08 Sebastian Bruch

Talent search is a cornerstone of modern recruitment systems, yet existing approaches often struggle to capture nuanced job-specific preferences, model recruiter behavior at a fine-grained level, and mitigate noise from subjective human…

Information Retrieval · Computer Science 2025-12-02 Jihang Li , Bing Xu , Zulong Chen , Chuanfei Xu , Minping Chen , Suyu Liu , Ying Zhou , Zeyi Wen

Intuitively, an ideal collaborative filtering (CF) model should learn from users' full rankings over all items to make optimal top-K recommendations. Due to the absence of such full rankings in practice, most CF models rely on pairwise loss…

Information Retrieval · Computer Science 2024-12-25 Yuhan Zhao , Rui Chen , Li Chen , Shuang Zhang , Qilong Han , Hongtao Song

Click-through rate (CTR) estimation plays as a core function module in various personalized online services, including online advertising, recommender systems, and web search etc. From 2015, the success of deep learning started to benefit…

Information Retrieval · Computer Science 2021-04-22 Weinan Zhang , Jiarui Qin , Wei Guo , Ruiming Tang , Xiuqiang He

Position bias, i.e., users' preference of an item is affected by its placing position, is well studied in the recommender system literature. However, most existing methods ignore the widely coupled ranking bias, which is also related to the…

Information Retrieval · Computer Science 2024-05-30 Yao Zhao , Zhining Liu , Tianchi Cai , Haipeng Zhang , Chenyi Zhuang , Jinjie Gu

Confidence estimation, a task that aims to evaluate the trustworthiness of the model's prediction output during deployment, has received lots of research attention recently, due to its importance for the safe deployment of deep models.…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Haoxuan Qu , Yanchao Li , Lin Geng Foo , Jason Kuen , Jiuxiang Gu , Jun Liu

Ranking is a core task in recommender systems, which aims at providing an ordered list of items to users. Typically, a ranking function is learned from the labeled dataset to optimize the global performance, which produces a ranking score…

Information Retrieval · Computer Science 2019-07-24 Changhua Pei , Yi Zhang , Yongfeng Zhang , Fei Sun , Xiao Lin , Hanxiao Sun , Jian Wu , Peng Jiang , Wenwu Ou

Ranking is a crucial module using in the recommender system. In particular, the ranking module using in our YoungTao recommendation scenario is to provide an ordered list of items to users, to maximize the click number throughout the…

Information Retrieval · Computer Science 2023-08-29 Shaowei Liu , Yangjun Liu

Traditional ranking systems optimize offline proxy objectives that rely on oversimplified assumptions about user behavior, often neglecting factors such as position bias and item diversity. Consequently, these models fail to improve true…

Information Retrieval · Computer Science 2025-10-21 Gaurav Bhatt , Kiran Koshy Thekumparampil , Tanmay Gangwani , Tesi Xiao , Leonid Sigal