English
Related papers

Related papers: Offline A/B testing for Recommender Systems

200 papers

Recommender system practitioners are facing increasing pressure to explain recommendations. We explore how to explain recommendations using counterfactual logic, i.e. "Had you not interacted with the following items, we would not recommend…

Artificial Intelligence · Computer Science 2023-02-10 Yuanshun Yao , Chong Wang , Hang Li

Learning to Rank (LTR) from user interactions is challenging as user feedback often contains high levels of bias and noise. At the moment, two methodologies for dealing with bias prevail in the field of LTR: counterfactual methods that…

Information Retrieval · Computer Science 2019-07-16 Rolf Jagerman , Harrie Oosterhuis , Maarten de Rijke

Recommender systems are gaining increasing and critical impacts on human and society since a growing number of users use them for information seeking and decision making. Therefore, it is crucial to address the potential unfairness problems…

Information Retrieval · Computer Science 2021-11-08 Yunqi Li , Hanxiong Chen , Shuyuan Xu , Yingqiang Ge , Yongfeng Zhang

We study counterfactual regression, which aims to map input features to outcomes under hypothetical scenarios that differ from those observed in the data. This is particularly useful for decision-making when adapting to sudden shifts in…

Methodology · Statistics 2025-04-08 Kwangho Kim

Off-policy learning, referring to the procedure of policy optimization with access only to logged feedback data, has shown importance in various real-world applications, such as search engines, recommender systems, and etc. While the…

Machine Learning · Computer Science 2023-09-28 Xiaoying Zhang , Junpu Chen , Hongning Wang , Hong Xie , Yang Liu , John C. S. Lui , Hang Li

Evaluation of policies in recommender systems typically involves A/B testing using live experiments on real users to assess a new policy's impact on relevant metrics. This ``gold standard'' comes at a high cost, however, in terms of cycle…

Information Retrieval · Computer Science 2024-09-27 Chih-Wei Hsu , Martin Mladenov , Ofer Meshi , James Pine , Hubert Pham , Shane Li , Xujian Liang , Anton Polishko , Li Yang , Ben Scheetz , Craig Boutilier

Off-policy evaluation (OPE) is critical for applying contextual bandit algorithms to high-stakes decision-making settings such as healthcare, where new treatment policies must be evaluated prior to deployment. Unfortunately, OPE techniques…

Machine Learning · Computer Science 2026-05-28 Aishwarya Mandyam , Shengpu Tang , Jiayu Yao , Jenna Wiens , Barbara E. Engelhardt

We study the problem of online learning in adversarial bandit problems under a partial observability model called off-policy feedback. In this sequential decision making problem, the learner cannot directly observe its rewards, but instead…

Machine Learning · Computer Science 2022-07-20 Germano Gabbianelli , Matteo Papini , Gergely Neu

Recommender systems have generated tremendous value for both users and businesses, drawing significant attention from academia and industry alike. However, due to practical constraints, academic research remains largely confined to offline…

Information Retrieval · Computer Science 2025-09-09 Kuan Zou , Aixin Sun

In many domains, the exploration process of reinforcement learning will be too costly as it requires trying out suboptimal policies, resulting in a need for off-policy evaluation, in which a target policy is evaluated based on data…

Machine Learning · Computer Science 2024-05-07 David M. Bossens , Philip S. Thomas

In Recommender System (RS), explanations help users understand why items are recommended and can enhance a system's transparency, persuasiveness, engagement, and trust, which are known as explanation goals. However, evaluating the…

Information Retrieval · Computer Science 2025-12-17 André Levi Zanon , Marcelo Garcia Manzato , Leonardo Rocha

With a vast number of items, web-pages, and news to choose from, online services and the customers both benefit tremendously from personalized recommender systems. Such systems however provide great opportunities for targeted…

Information Retrieval · Computer Science 2015-04-16 Subhashini Krishnasamy , Rajat Sen , Sewoong Oh , Sanjay Shakkottai

Off-policy Evaluation (OPE), or offline evaluation in general, evaluates the performance of hypothetical policies leveraging only offline log data. It is particularly useful in applications where the online interaction involves high stakes…

Machine Learning · Statistics 2021-09-01 Yuta Saito , Takuma Udagawa , Haruka Kiyohara , Kazuki Mogi , Yusuke Narita , Kei Tateno

Online recommender systems often deal with continuous, potentially fast and unbounded flows of data. Ensemble methods for recommender systems have been used in the past in batch algorithms, however they have never been studied with…

Information Retrieval · Computer Science 2018-03-28 João Vinagre , Alípio Mário Jorge , João Gama

A/B testing, or online experiment is a standard business strategy to compare a new product with an old one in pharmaceutical, technological, and traditional industries. Major challenges arise in online experiments of two-sided marketplace…

Machine Learning · Computer Science 2022-11-04 Chengchun Shi , Xiaoyu Wang , Shikai Luo , Hongtu Zhu , Jieping Ye , Rui Song

By providing explanations for users and system designers to facilitate better understanding and decision making, explainable recommendation has been an important research problem. In this paper, we propose Counterfactual Explainable…

Information Retrieval · Computer Science 2023-02-21 Juntao Tan , Shuyuan Xu , Yingqiang Ge , Yunqi Li , Xu Chen , Yongfeng Zhang

Abstaining classifiers have the option to abstain from making predictions on inputs that they are unsure about. These classifiers are becoming increasingly popular in high-stakes decision-making problems, as they can withhold uncertain…

Machine Learning · Statistics 2023-11-10 Yo Joong Choe , Aditya Gangrade , Aaditya Ramdas

We present and prove properties of a new offline policy evaluator for an exploration learning setting which is superior to previous evaluators. In particular, it simultaneously and correctly incorporates techniques from importance…

Machine Learning · Computer Science 2012-10-19 Miroslav Dudik , Dumitru Erhan , John Langford , Lihong Li

As counterfactual examples become increasingly popular for explaining decisions of deep learning models, it is essential to understand what properties quantitative evaluation metrics do capture and equally important what they do not…

Machine Learning · Computer Science 2021-11-02 Frederik Hvilshøj , Alexandros Iosifidis , Ira Assent

Uplift modeling estimates the causal effect of an intervention as the difference between potential outcomes under treatment and control, whereas counterfactual identification aims to recover the joint distribution of these potential…

Machine Learning · Computer Science 2025-12-10 Théo Verhelst , Gianluca Bontempi