English
Related papers

Related papers: Towards Resolving Propensity Contradiction in Offl…

200 papers

A straightforward application of semi-supervised machine learning to the problem of treatment effect estimation would be to consider data as "unlabeled" if treatment assignment and covariates are observed but outcomes are unobserved.…

Methodology · Statistics 2020-09-15 Andrew Herren , P. Richard Hahn

Most recommender systems optimize the model on observed interaction data, which is affected by the previous exposure mechanism and exhibits many biases like popularity bias. The loss functions, such as the mostly used pointwise Binary…

Information Retrieval · Computer Science 2022-04-27 Qi Wan , Xiangnan He , Xiang Wang , Jiancan Wu , Wei Guo , Ruiming Tang

Learning from implicit feedback is a fundamental problem in modern recommender systems, where only positive interactions are observed and explicit negative signals are unavailable. In such settings, negative sampling plays a critical role…

Information Retrieval · Computer Science 2026-02-24 Chen Chen , Haobo Lin , Yuanbo Xu

Offline evaluations of recommender systems attempt to estimate users' satisfaction with recommendations using static data from prior user interactions. These evaluations provide researchers and developers with first approximations of the…

Information Retrieval · Computer Science 2020-01-28 Mucun Tian , Michael D. Ekstrand

Modern personalized recommendation services often rely on user feedback, either explicit or implicit, to improve the quality of services. Explicit feedback refers to behaviors like ratings, while implicit feedback refers to behaviors like…

Information Retrieval · Computer Science 2023-11-22 Guanyu Lin , Chen Gao , Yu Zheng , Yinfeng Li , Jianxin Chang , Yanan Niu , Yang Song , Kun Gai , Zhiheng Li , Depeng Jin , Yong Li

Matching users based on mutual preferences is a fundamental aspect of services driven by reciprocal recommendations, such as job search and dating applications. Although A/B tests remain the gold standard for evaluating new policies in…

Machine Learning · Computer Science 2025-07-21 Yudai Hayashi , Shuhei Goda , Yuta Saito

Ranking functions return ranked lists of items, and users often interact with these items. How to evaluate ranking functions using historical interaction logs, also known as off-policy evaluation, is an important but challenging problem.…

Information Retrieval · Computer Science 2018-10-15 Aman Agarwal , Xuanhui Wang , Cheng Li , Michael Bendersky , Marc Najork

Bidirectional Transformer architectures are state-of-the-art sequential recommendation models that use a bi-directional representation capacity based on the Cloze task, a.k.a. Masked Language Modeling. The latter aims to predict randomly…

Machine Learning · Computer Science 2023-01-24 Khalil Damak , Sami Khenissi , Olfa Nasraoui

Counterfactual Learning to Rank (LTR) algorithms learn a ranking model from logged user interactions, often collected using a production system. Employing such an offline learning approach has many benefits compared to an online one, but it…

Machine Learning · Computer Science 2020-05-22 Rolf Jagerman , Maarten de Rijke

Recommender systems predict what items a user will interact with next, based on their past interactions. The problem is often approached through supervised learning, but recent advancements have shifted towards policy optimization of…

Machine Learning · Computer Science 2023-04-28 Dawen Liang , Nikos Vlassis

Unbiased recommender learning (URL) and off-policy evaluation/learning (OPE/L) techniques are effective in addressing the data bias caused by display position and logging policies, thereby consistently improving the performance of…

Machine Learning · Statistics 2025-02-14 Tatsuki Takahashi , Chihiro Maru , Hiroko Shoji

In recommender systems, a common problem is the presence of various biases in the collected data, which deteriorates the generalization ability of the recommendation models and leads to inaccurate predictions. Doubly robust (DR) learning…

Information Retrieval · Computer Science 2022-12-20 Haoxuan Li , Quanyu Dai , Yuru Li , Yan Lyu , Zhenhua Dong , Xiao-Hua Zhou , Peng Wu

Accurately evaluating new policies (e.g. ad-placement models, ranking functions, recommendation functions) is one of the key prerequisites for improving interactive systems. While the conventional approach to evaluation relies on online A/B…

Machine Learning · Computer Science 2017-06-27 Aman Agarwal , Soumya Basu , Tobias Schnabel , Thorsten Joachims

We study the problem of online learning in adversarial bandit problems under a partial observability model called off-policy feedback. In this sequential decision making problem, the learner cannot directly observe its rewards, but instead…

Machine Learning · Computer Science 2022-07-20 Germano Gabbianelli , Matteo Papini , Gergely Neu

The field of generating recommendations within the framework of causal inference has seen a recent surge, with recommendations being likened to treatments. This approach enhances insights into the influence of recommendations on user…

Information Retrieval · Computer Science 2023-08-21 Guanglin Zhou , Chengkai Huang , Xiaocong Chen , Xiwei Xu , Chen Wang , Liming Zhu , Lina Yao

Learning under one-sided feedback (i.e., where we only observe the labels for examples we predicted positively on) is a fundamental problem in machine learning -- applications include lending and recommendation systems. Despite this, there…

Machine Learning · Computer Science 2020-10-14 Heinrich Jiang , Qijia Jiang , Aldo Pacchiano

Recommendation systems leverage user interaction data to suggest relevant items while filtering out irrelevant (negative) ones. The rise of large language models (LLMs) has garnered increasing attention for their potential in recommendation…

Information Retrieval · Computer Science 2025-08-14 Chenlu Ding , Daoxuan Liu , Jiancan Wu , Xingyu Hu , Junkang Wu , Haitao Wang , Yongkang Wang , Xingxing Wang , Xiang Wang

The feedback data of recommender systems are often subject to what was exposed to the users; however, most learning and evaluation methods do not account for the underlying exposure mechanism. We first show in theory that applying…

Information Retrieval · Computer Science 2020-12-07 Da Xu , Chuanwei Ruan , Evren Korpeoglu , Sushant Kumar , Kannan Achan

A reciprocal recommendation problem is one where the goal of learning is not just to predict a user's preference towards a passive item (e.g., a book), but to recommend the targeted user on one side another user from the other side such…

Machine Learning · Computer Science 2018-06-05 Fabio Vitale , Nikos Parotsidis , Claudio Gentile

Recommendation systems (RS) aim to provide personalized content, but they face a challenge in unbiased learning due to selection bias, where users only interact with items they prefer. This bias leads to a distorted representation of user…

Machine Learning · Computer Science 2025-06-10 Shuqiang Zhang , Yuchao Zhang , Jinkun Chen , Haochen Sui