English
Related papers

Related papers: Confounding is a Pervasive Problem in Real World R…

200 papers

Unobserved confounding is a central barrier to drawing causal inferences from observational data. Several authors have recently proposed that this barrier can be overcome in the case where one attempts to infer the effects of several…

Machine Learning · Statistics 2019-03-20 Alexander D'Amour

Recommender system usually faces popularity bias issues: from the data perspective, items exhibit uneven (long-tail) distribution on the interaction frequency; from the method perspective, collaborative filtering methods are prone to…

Information Retrieval · Computer Science 2021-05-14 Yang Zhang , Fuli Feng , Xiangnan He , Tianxin Wei , Chonggang Song , Guohui Ling , Yongdong Zhang

Unobserved confounding is a fundamental challenge for estimating causal effects. To address unobserved confounding, recent literature has turned to two different approaches -- proxy variables and the use of multiple treatments. The first…

Methodology · Statistics 2026-05-20 Aytijhya Saha , Stephen Bates , Devavrat Shah

Clinical machine learning applications are often plagued with confounders that can impact the generalizability and predictive performance of the learners. Confounding is especially problematic in remote digital health studies where the…

Recommender systems usually amplify the biases in the data. The model learned from historical interactions with imbalanced item distribution will amplify the imbalance by over-recommending items from the major groups. Addressing this issue…

Information Retrieval · Computer Science 2021-05-25 Wenjie Wang , Fuli Feng , Xiangnan He , Xiang Wang , Tat-Seng Chua

Confounding variables are a well known source of nuisance in biomedical studies. They present an even greater challenge when we combine them with black-box machine learning techniques that operate on raw data. This work presents two case…

Clinical machine learning applications are often plagued with confounders that are clinically irrelevant, but can still artificially boost the predictive performance of the algorithms. Confounding is especially problematic in mobile health…

Applications · Statistics 2018-11-29 Elias Chaibub Neto

Confounding seriously impairs our ability to learn about causal relations from observational data. Confounding can be defined as a statistical association between two variables due to inputs from a common source (the confounder). For…

Methodology · Statistics 2018-05-17 Anders Ledberg

Recently, interest has grown in the use of proxy variables of unobserved confounding for inferring the causal effect in the presence of unmeasured confounders from observational data. One difficulty inhibiting the practical use is finding…

Machine Learning · Computer Science 2024-05-28 Feng Xie , Zhengming Chen , Shanshan Luo , Wang Miao , Ruichu Cai , Zhi Geng

With a vast number of items, web-pages, and news to choose from, online services and the customers both benefit tremendously from personalized recommender systems. Such systems however provide great opportunities for targeted…

Information Retrieval · Computer Science 2015-04-16 Subhashini Krishnasamy , Rajat Sen , Sewoong Oh , Sanjay Shakkottai

We develop a novel method for personalized off-policy learning in scenarios with unobserved confounding. Thereby, we address a key limitation of standard policy learning: standard policy learning assumes unconfoundedness, meaning that no…

Machine Learning · Computer Science 2026-02-18 Konstantin Hess , Dennis Frauen , Valentyn Melnychuk , Stefan Feuerriegel

Recommender systems have generated tremendous value for both users and businesses, drawing significant attention from academia and industry alike. However, due to practical constraints, academic research remains largely confined to offline…

Information Retrieval · Computer Science 2025-09-09 Kuan Zou , Aixin Sun

Observational data is increasingly used as a means for making individual-level causal predictions and intervention recommendations. The foremost challenge of causal inference from observational data is hidden confounding, whose presence…

Machine Learning · Statistics 2018-10-30 Nathan Kallus , Aahlad Manas Puli , Uri Shalit

Recommender systems support decisions in various domains ranging from simple items such as books and movies to more complex items such as financial services, telecommunication equipment, and software systems. In this context,…

Information Retrieval · Computer Science 2021-02-15 Alexander Felfernig , Viet-Man Le , Andrei Popescu , Mathias Uta , Thi Ngoc Trang Tran , Müslüum Atas

Unobserved confounders are a long-standing issue in causal inference using propensity score methods. This study proposed nonparametric indices to quantify the impact of unobserved confounders through pseudo-experiments with an application…

Methodology · Statistics 2020-08-27 Beilin Jia , Donglin Zeng , Qing Yang , Wei Pan

Increasing users' positive interactions, such as purchases or clicks, is an important objective of recommender systems. Recommenders typically aim to select items that users will interact with. If the recommended items are purchased, an…

Machine Learning · Computer Science 2020-09-24 Masahiro Sato , Sho Takemori , Janmajay Singh , Tomoko Ohkuma

Human-AI collaboration has the potential to transform various domains by leveraging the complementary strengths of human experts and Artificial Intelligence (AI) systems. However, unobserved confounding can undermine the effectiveness of…

Human-Computer Interaction · Computer Science 2025-02-27 Ruijiang Gao , Mingzhang Yin

We consider causal inference in the presence of unobserved confounding. We study the case where a proxy is available for the unobserved confounding in the form of a network connecting the units. For example, the link structure of a social…

Machine Learning · Statistics 2019-06-03 Victor Veitch , Yixin Wang , David M. Blei

Recommender systems are central to modern online platforms, but a popular concern is that they may be pulling society in dangerous directions (e.g., towards filter bubbles). However, a challenge with measuring the effects of recommender…

Computers and Society · Computer Science 2021-10-25 Serina Chang , Johan Ugander

Convenient access to observational data enables us to learn causal effects without randomized experiments. This research direction draws increasing attention in research areas such as economics, healthcare, and education. For example, we…

Social and Information Networks · Computer Science 2019-12-03 Ruocheng Guo , Jundong Li , Huan Liu