English
Related papers

Related papers: Towards Robust Offline Evaluation: A Causal and In…

200 papers

Modern large-scale recommender systems employ multi-stage ranking funnel (Retrieval, Pre-ranking, Ranking) to balance engagement and computational constraints (latency, CPU). However, the initial retrieval stage, often relying on efficient…

Information Retrieval · Computer Science 2025-06-10 Amit Jaspal , Qian Dang , Ajantha Ramineni

Offline reinforcement learning (RL) has emerged as a prevalent and effective methodology for real-world recommender systems, enabling learning policies from historical data and capturing user preferences. In offline RL, reward shaping…

Information Retrieval · Computer Science 2025-07-01 Wenzheng Shu , Yanxiang Zeng , Yongxiang Tang , Teng Sha , Ning Luo , Yanhua Cheng , Xialong Liu , Fan Zhou , Peng Jiang

In a standard classification framework a set of trustworthy learning data are employed to build a decision rule, with the final aim of classifying unlabelled units belonging to the test set. Therefore, unreliable labelled observations,…

Applications · Statistics 2019-11-20 Andrea Cappozzo , Francesca Greselin , Thomas Brendan Murphy

Distributionally robust offline reinforcement learning (RL) aims to find a policy that performs the best under the worst environment within an uncertainty set using an offline dataset collected from a nominal model. While recent advances in…

Machine Learning · Computer Science 2025-01-07 Ruiquan Huang , Yingbin Liang , Jing Yang

Most data for evaluating and training recommender systems is subject to selection biases, either through self-selection by the users or through the actions of the recommendation system itself. In this paper, we provide a principled approach…

Machine Learning · Computer Science 2016-05-30 Tobias Schnabel , Adith Swaminathan , Ashudeep Singh , Navin Chandak , Thorsten Joachims

We study offline recommender learning from explicit rating feedback in the presence of selection bias. A current promising solution for the bias is the inverse propensity score (IPS) estimation. However, the performance of existing…

Machine Learning · Statistics 2022-04-22 Yuta Saito , Masahiro Nomura

Recommender systems operate in closed feedback loops, where user interactions reinforce popularity bias, leading to over-recommendation of already popular items while under-exposing niche or novel content. Existing bias mitigation methods,…

Information Retrieval · Computer Science 2025-06-10 Rahul Agarwal , Amit Jaspal , Saurabh Gupta , Omkar Vichare

This paper establishes a series of sensitivity analyses to investigate the impact of missing values in the electronic health records (EHR) that are possibly missing not at random (MNAR). EHRs have gained tremendous interest due to their…

Methodology · Statistics 2025-03-28 Jungwun Lee , Sebastien Haneuse , Rajarshi Mukherjee , Tanayott Thaweethai

Historical interactions are the default choice for recommender model training, which typically exhibit high sparsity, i.e., most user-item pairs are unobserved missing data. A standard choice is treating the missing data as negative…

Information Retrieval · Computer Science 2023-07-31 Chenxu Wang , Fuli Feng , Yang Zhang , Qifan Wang , Xunhan Hu , Xiangnan He

State-of-the-art reinforcement learning algorithms mostly rely on being allowed to directly interact with their environment to collect millions of observations. This makes it hard to transfer their success to industrial control problems,…

Machine Learning · Computer Science 2021-07-23 Phillip Swazinna , Steffen Udluft , Thomas Runkler

Ranking is at the core of many artificial intelligence (AI) applications, including search engines, recommender systems, etc. Modern ranking systems are often constructed with learning-to-rank (LTR) models built from user behavior signals.…

Information Retrieval · Computer Science 2023-05-29 Tao Yang , Cuize Han , Chen Luo , Parth Gupta , Jeff M. Phillips , Qingyao Ai

We consider offline Reinforcement Learning (RL), where the agent does not interact with the environment and must rely on offline data collected using a behavior policy. Previous works provide policy evaluation guarantees when the target…

Machine Learning · Computer Science 2023-05-26 Xumei Xi , Christina Lee Yu , Yudong Chen

Implicit feedback is central to modern recommender systems but is inherently noisy, often impairing model training and degrading user experience. At scale, such noise can mislead learning processes, reducing both recommendation accuracy and…

Information Retrieval · Computer Science 2025-10-13 Ze Liu , Xianquan Wang , Shuochen Liu , Jie Ma , Huibo Xu , Yupeng Han , Kai Zhang , Jun Zhou

Analysis of competing risks data is often complicated by the incomplete or selectively missing information on the cause of failure. Standard approaches typically assume that the cause of failure is missing at random (MAR), an assumption…

Missing values challenge data analysis because many supervised and unsupervised learning methods cannot be applied directly to incomplete data. Matrix completion based on low-rank assumptions are very powerful solution for dealing with…

Machine Learning · Statistics 2020-01-30 Aude Sportisse , Claire Boyer , Julie Josse

Approaches for appraising feature importance approximations, alternatively referred to as attribution methods, have been established across an extensive array of contexts. The development of resilient techniques for performance benchmarking…

Machine Learning · Computer Science 2026-01-06 Junhwa Song , Keumgang Cha , Junghoon Seo

Recent work in recommender systems has emphasized the importance of fairness, with a particular interest in bias and transparency, in addition to predictive accuracy. In this paper, we focus on the state of the art pairwise ranking model,…

Information Retrieval · Computer Science 2021-08-02 Khalil Damak , Sami Khenissi , Olfa Nasraoui

Modern large-scale ranking systems operate within a sophisticated landscape of competing objectives, operational constraints, and evolving product requirements. Progress in this domain is increasingly bottlenecked by the engineering context…

Artificial Intelligence · Computer Science 2026-05-26 Longfei Yun , Yihan Wu , Haoran Liu , Xiaoxuan Liu , Ziyun Xu , Yi Wang , Yang Xia , Pengfei Wang , Mingze Gao , Yunxiang Wang , Changfan Chen , Wenjie Fu , Hong Yan , Junfeng Pan

Modern recommendation systems rank candidates by aggregating multiple behavioral signals through a value model. However, many commonly used signals are inherently affected by heterogeneous biases. For example, watch time naturally favors…

Recommender systems research tends to evaluate model performance offline and on randomly sampled targets, yet the same systems are later used to predict user behavior sequentially from a fixed point in time. Simulating online recommender…

Information Retrieval · Computer Science 2021-09-07 Milena Filipovic , Blagoj Mitrevski , Diego Antognini , Emma Lejal Glaude , Boi Faltings , Claudiu Musat