English
Related papers

Related papers: Counterfactual Evaluation of Slate Recommendations…

200 papers

We study counterfactual regression, which aims to map input features to outcomes under hypothetical scenarios that differ from those observed in the data. This is particularly useful for decision-making when adapting to sudden shifts in…

Methodology · Statistics 2025-04-08 Kwangho Kim

In reinforcement learning with human feedback (RLHF), reward models can efficiently learn and amplify latent biases within multimodal datasets, which can lead to imperfect policy optimization through flawed reward signals and decreased…

Machine Learning · Computer Science 2025-08-28 Sheryl Mathew , N Harshit

Counterfactual explanations utilize feature perturbations to analyze the outcome of an original decision and recommend an actionable recourse. We argue that it is beneficial to provide several alternative explanations rather than a single…

Machine Learning · Computer Science 2023-01-24 Natraj Raman , Daniele Magazzeni , Sameena Shah

When applied in healthcare, reinforcement learning (RL) seeks to dynamically match the right interventions to subjects to maximize population benefit. However, the learned policy may disproportionately allocate efficacious actions to one…

Machine Learning · Statistics 2025-01-15 Jitao Wang , Chengchun Shi , John D. Piette , Joshua R. Loftus , Donglin Zeng , Zhenke Wu

Sequential recommendation methods play a crucial role in modern recommender systems because of their ability to capture a user's dynamic interest from her/his historical interactions. Despite their success, we argue that these approaches…

Information Retrieval · Computer Science 2021-03-02 Xu Xie , Fei Sun , Zhaoyang Liu , Shiwen Wu , Jinyang Gao , Bolin Ding , Bin Cui

Counterfactual evaluation can estimate Click-Through-Rate (CTR) differences between ranking systems based on historical interaction data, while mitigating the effect of position bias and item-selection bias. We introduce the novel…

Information Retrieval · Computer Science 2020-07-29 Harrie Oosterhuis , Maarten de Rijke

Bundle Recommendation (BR) aims at recommending bundled items on online content or e-commerce platform, such as song lists on a music platform or book lists on a reading website. Several graph based models have achieved state-of-the-art…

Information Retrieval · Computer Science 2022-12-22 Shixuan Zhu , Qi Shen , Yiming Zhang , Zhenwei Dong , Zhihua Wei

Building interpretable parameterizations of real-world decision-making on the basis of demonstrated behavior -- i.e. trajectories of observations and actions made by an expert maximizing some unknown reward function -- is essential for…

Machine Learning · Computer Science 2021-03-31 Ioana Bica , Daniel Jarrett , Alihan Hüyük , Mihaela van der Schaar

In session-based or sequential recommendation, it is important to consider a number of factors like long-term user engagement, multiple types of user-item interactions such as clicks, purchases etc. The current state-of-the-art supervised…

Machine Learning · Computer Science 2020-06-12 Xin Xin , Alexandros Karatzoglou , Ioannis Arapakis , Joemon M. Jose

Nowadays, research into personalization has been focusing on explainability and fairness. Several approaches proposed in recent works are able to explain individual recommendations in a post-hoc manner or by explanation paths. However,…

Information Retrieval · Computer Science 2024-03-26 Giacomo Medda , Francesco Fabbri , Mirko Marras , Ludovico Boratto , Gianni Fenu

In production systems, contextual bandit approaches often rely on direct reward models that take both action and context as input. However, these models can suffer from confounding, making it difficult to isolate the effect of the action…

Machine Learning · Computer Science 2025-09-16 Alexandre Gilotte , Otmane Sakhi , Imad Aouali , Benjamin Heymann

In real-world machine learning systems, labels are often derived from user behaviors that the system wishes to encourage. Over time, new models must be trained as new training examples and features become available. However, feedback loops…

Machine Learning · Computer Science 2023-11-01 Victoria Lin , Louis-Philippe Morency , Dimitrios Dimitriadis , Srinagesh Sharma

Recommendation strategies are typically evaluated by using previously logged data, employing off-policy evaluation methods to estimate their expected performance. However, for strategies that present users with slates of multiple items, the…

Information Retrieval · Computer Science 2023-12-29 Shreyas Chaudhari , David Arbour , Georgios Theocharous , Nikos Vlassis

In recent years there have been a growing interest in online auditing of information flow over social networks with the goal of monitoring undesirable effects, such as, misinformation and fake news. Most previous work on the subject, focus…

Machine Learning · Computer Science 2024-09-10 Daniel Toma , Wasim Huleihel

Traditional ranking systems optimize offline proxy objectives that rely on oversimplified assumptions about user behavior, often neglecting factors such as position bias and item diversity. Consequently, these models fail to improve true…

Information Retrieval · Computer Science 2025-10-21 Gaurav Bhatt , Kiran Koshy Thekumparampil , Tanmay Gangwani , Tesi Xiao , Leonid Sigal

Interleaving is an online evaluation approach for information retrieval systems that compares the effectiveness of ranking functions in interpreting the users' implicit feedback. Previous work such as Hofmann et al (2011) has evaluated the…

Information Retrieval · Computer Science 2023-03-20 Alessandro Benedetti , Anna Ruggero

Counterfactual thinking describes a psychological phenomenon that people re-infer the possible results with different solutions about things that have already happened. It helps people to gain more experience from mistakes and thus to…

Machine Learning · Computer Science 2019-08-19 Yue Wang , Yao Wan , Chenwei Zhang , Lixin Cui , Lu Bai , Philip S. Yu

We study a new model where the potential outcomes, corresponding to the values of a (possibly continuous) treatment, are linked through common factors. The factors can be estimated using a panel of regressors. We propose a procedure to…

Econometrics · Economics 2024-01-09 Jad Beyhum

Sequential modelling entails making sense of sequential data, which naturally occurs in a wide array of domains. One example is systems that interact with users, log user actions and behaviour, and make recommendations of items of potential…

Information Retrieval · Computer Science 2021-09-15 Christian Hansen

Uplift modeling estimates the causal effect of an intervention as the difference between potential outcomes under treatment and control, whereas counterfactual identification aims to recover the joint distribution of these potential…

Machine Learning · Computer Science 2025-12-10 Théo Verhelst , Gianluca Bontempi