English
Related papers

Related papers: Confounding is a Pervasive Problem in Real World R…

200 papers

Inferring the causal effect of a treatment on an outcome in an observational study requires adjusting for observed baseline confounders to avoid bias. However, adjusting for all observed baseline covariates, when only a subset are…

Methodology · Statistics 2021-02-04 Wen Wei Loh , Stijn Vansteelandt

In real-world studies, the collected confounders may suffer from measurement error. Although mismeasurement of confounders is typically unintentional -- originating from sources such as human oversight or imprecise machinery -- deliberate…

Methodology · Statistics 2024-09-20 Jeffrey Zhang , Junu Lee

No unmeasured confounding is often assumed in estimating treatment effects in observational data when using approaches such as propensity scores and inverse probability weighting. However, in many such studies due to the limitation of the…

Applications · Statistics 2019-08-06 Rong Huang , Ronghui Xu , Parambir S. Dulai

Selection bias in recommender system arises from the recommendation process of system filtering and the interactive process of user selection. Many previous studies have focused on addressing selection bias to achieve unbiased learning of…

Machine Learning · Computer Science 2024-05-01 Haoxuan Li , Chunyuan Zheng , Sihao Ding , Peng Wu , Zhi Geng , Fuli Feng , Xiangnan He

Recommender systems have become crucial in information filtering nowadays. Existing recommender systems extract user preferences based on the correlation in data, such as behavioral correlation in collaborative filtering, feature-feature,…

Information Retrieval · Computer Science 2023-12-18 Chen Gao , Yu Zheng , Wenjie Wang , Fuli Feng , Xiangnan He , Yong Li

Familiarity with a simulation platform can seduce modellers into accepting untested assumptions for convenience of implementation. These assumptions may have consequences greater than commonly suspected, and it is important that modellers…

Quantitative Methods · Quantitative Biology 2014-02-28 Jerome K Vanclay

The progress of recommender systems is hampered mainly by evaluation as it requires real-time interactions between humans and systems, which is too laborious and expensive. This issue is usually approached by utilizing the interaction…

Information Retrieval · Computer Science 2022-08-19 Chongming Gao , Shijun Li , Wenqiang Lei , Jiawei Chen , Biao Li , Peng Jiang , Xiangnan He , Jiaxin Mao , Tat-Seng Chua

A common assumption in causal inference from observational data is that there is no hidden confounding. Yet it is, in general, impossible to verify this assumption from a single dataset. Under the assumption of independent causal mechanisms…

Methodology · Statistics 2023-11-07 Rickard K. A. Karlsson , Jesse H. Krijthe

As recommendation systems become increasingly standard for online platforms, simulations provide an avenue for understanding the impacts of these systems on individuals and society. When constructing a recommendation system simulation,…

Information Retrieval · Computer Science 2021-09-07 Allison J. B. Chaney

In recommender systems, various latent confounding factors (e.g., user social environment and item public attractiveness) can affect user behavior, item exposure, and feedback in distinct ways. These factors may directly or indirectly…

Information Retrieval · Computer Science 2025-10-28 Zhirong Huang , Shichao Zhang , Debo Cheng , Jiuyong Li , Lin Liu , Guixian Zhang

In the era of fast-paced precision medicine, observational studies play a major role in properly evaluating new treatments in clinical practice. Yet, unobserved confounding can significantly compromise causal conclusions drawn from…

Machine Learning · Statistics 2026-03-20 Piersilvio De Bartolomeis , Javier Abad , Konstantin Donhauser , Fanny Yang

Inferring user preferences from the historical feedback of users is a valuable problem in recommender systems. Conventional approaches often rely on the assumption that user preferences in the feedback data are equivalent to the real user…

Information Retrieval · Computer Science 2025-05-07 Hangtong Xu , Yuanbo Xu , Chaozhuo Li , Fuzhen Zhuang

Recommendation systems are widespread, and through customized recommendations, promise to match users with options they will like. To that end, data on engagement is collected and used. Most recommendation systems are ranking-based, where…

Information Retrieval · Computer Science 2024-05-08 Omar Besbes , Yash Kanoria , Akshit Kumar

A major challenge in estimating treatment effects in observational studies is the reliance on untestable conditions such as the assumption of no unmeasured confounding. In this work, we propose an algorithm that can falsify the assumption…

Methodology · Statistics 2025-06-03 Rickard K. A. Karlsson , Jesse H. Krijthe

Recommender systems are known to suffer from the popularity bias problem: popular (i.e. frequently rated) items get a lot of exposure while less popular ones are under-represented in the recommendations. Research in this area has been…

Information Retrieval · Computer Science 2019-09-20 Himan Abdollahpouri , Masoud Mansoury , Robin Burke , Bamshad Mobasher

Detecting and measuring confounding effects from data is a key challenge in causal inference. Existing methods frequently assume causal sufficiency, disregarding the presence of unobserved confounding variables. Causal sufficiency is both…

Artificial Intelligence · Computer Science 2024-09-27 Abbavaram Gowtham Reddy , Vineeth N Balasubramanian

Recommender systems attempt to reduce information overload and retain customers by selecting a subset of items from a universal set based on user preferences. While research in recommender systems grew out of information retrieval and…

Information Retrieval · Computer Science 2007-05-23 Saverio Perugini , Marcos Andre Goncalves , Edward A. Fox

In a real expert system, one may have unreliable, unconfident, conflicting estimates of the value for a particular parameter. It is important for decision making that the information present in this aggregate somehow find its way into use.…

Artificial Intelligence · Computer Science 2013-04-15 Henry Hamburger

Observational studies of causal effects require adjustment for confounding factors. In the tabular setting, where these factors are well-defined, separate random variables, the effect of confounding is well understood. However, in public…

Machine Learning · Computer Science 2023-02-16 Connor T. Jerzak , Fredrik Johansson , Adel Daoud

Identification of treatment effects in the presence of unmeasured confounding is a persistent problem in the social, biological, and medical sciences. The problem of unmeasured confounding in settings with multiple treatments is most common…

Methodology · Statistics 2022-07-12 Wang Miao , Wenjie Hu , Elizabeth L. Ogburn , Xiaohua Zhou