English
Related papers

Related papers: Adjusting for Confounders with Text: Challenges an…

200 papers

Accurately predicting the relevance of items to users is crucial to the success of many social platforms. Conventional approaches train models on logged historical data; but recommendation systems, media services, and online marketplaces…

Machine Learning · Computer Science 2022-10-11 Amir Feder , Guy Horowitz , Yoav Wald , Roi Reichart , Nir Rosenfeld

Inferring the causal effect of a non-randomly assigned exposure on an outcome requires adjusting for common causes of the exposure and outcome to avoid biased conclusions. Notwithstanding the efforts investigators routinely make to measure…

Methodology · Statistics 2021-02-04 Wen Wei Loh , Stijn Vansteelandt

To discover new drugs is to seek and to prove causality. As an emerging approach leveraging human knowledge and creativity, data, and machine intelligence, causal inference holds the promise of reducing cognitive bias and improving decision…

Quantitative Methods · Quantitative Biology 2025-04-09 Tom Michoel , Jitao David Zhang

This work presents a conceptual synthesis of causal discovery and inference frameworks, with a focus on how foundational assumptions -- causal sufficiency, causal faithfulness, and the causal Markov condition -- are formalized and…

Methodology · Statistics 2025-04-23 Hannah E. Correia

This paper addresses the problem of measurement errors in causal inference and highlights several algebraic and graphical methods for eliminating systematic bias induced by such errors. In particulars, the paper discusses the control of…

Methodology · Statistics 2012-03-19 Judea Pearl

Confounding bias, missing data, and selection bias are three common obstacles to valid causal inference in the data sciences. Covariate adjustment is the most pervasive technique for recovering casual effects from confounding bias. In this…

Machine Learning · Computer Science 2019-09-17 Mojdeh Saadati , Jin Tian

The study of causal relationships between emotions and causes in texts has recently received much attention. Most works focus on extracting causally related clauses from documents. However, none of these works has considered that the causal…

Computation and Language · Computer Science 2023-11-29 Xinhong Chen , Zongxi Li , Yaowei Wang , Haoran Xie , Jianping Wang , Qing Li

Estimating long-term causal effects by combining long-term observational and short-term experimental data is a crucial but challenging problem in many real-world scenarios. In existing methods, several ideal assumptions, e.g. latent…

Machine Learning · Computer Science 2025-05-12 Ruichu Cai , Junjie Wan , Weilin Chen , Zeqin Yang , Zijian Li , Peng Zhen , Jiecheng Guo

When domain knowledge is limited and experimentation is restricted by ethical, financial, or time constraints, practitioners turn to observational causal discovery methods to recover the causal structure, exploiting the statistical…

In this paper, we describe an approach for modelling causal reasoning in natural language by detecting counterfactuals in text using multi-head self-attention weights. We use pre-trained transformer models to extract contextual embeddings…

Computation and Language · Computer Science 2020-06-02 Rajaswa Patil , Veeky Baths

Recommending the best course of action for an individual is a major application of individual-level causal effect estimation. This application is often needed in safety-critical domains such as healthcare, where estimating and communicating…

Machine Learning · Computer Science 2020-10-26 Andrew Jesson , Sören Mindermann , Uri Shalit , Yarin Gal

Explanations are a fundamental element of how people make sense of the political world. Citizens routinely ask and answer questions about why events happen, who is responsible, and what could or should be done differently. Yet despite their…

Computation and Language · Computer Science 2025-12-04 Paulina Garcia-Corral

Observational studies require adjustment for confounding factors that are correlated with both the treatment and outcome. In the setting where the observed variables are tabular quantities such as average income in a neighborhood, tools…

Machine Learning · Statistics 2023-01-31 Connor T. Jerzak , Fredrik Johansson , Adel Daoud

According to behavioral finance, stock market returns are influenced by emotional, social and psychological factors. Several recent works support this theory by providing evidence of correlation between stock market prices and collective…

Methodology · Statistics 2017-06-13 Fani Tsapeli , Mirco Musolesi , Peter Tino

This paper discusses an application of Shapley values in the causal inference field, specifically on how to select the top confounder variables for coarsened exact matching method in a scalable way. We use a dataset from an observational…

Machine Learning · Statistics 2022-06-08 Jilei Yang , Wentao Su

This work showcases a new approach for causal discovery by leveraging user experiments and recent advances in photo-realistic image editing, demonstrating a potential of identifying causal factors and understanding complex systems…

Computer Vision and Pattern Recognition · Computer Science 2021-08-23 Tao Li

Finding good educational policies requires sound estimates of their potential effects. Methods for making such estimates, i.e. finding causal estimands, have made great progress in the last few decades. Nevertheless, serious errors in…

Physics Education · Physics 2022-02-02 M. B. Weissman

This paper discusses the fundamental principles of causal inference - the area of statistics that estimates the effect of specific occurrences, treatments, interventions, and exposures on a given outcome from experimental and observational…

Methodology · Statistics 2021-12-03 Francesca Dominici , Falco J. Bargagli-Stoffi , Fabrizia Mealli

Despite substantial progress in abstractive text summarization to generate fluent and informative texts, the factual inconsistency in the generated summaries remains an important yet challenging problem to be solved. In this paper, we…

Computation and Language · Computer Science 2023-05-19 Chenhe Dong , Yuexiang Xie , Yaliang Li , Ying Shen

Causal inference from observational data provides strong evidence for the best action in decision-making without performing expensive randomized trials. The effect of an action is usually not identifiable under unobserved confounding, even…

Machine Learning · Computer Science 2026-02-02 Md Musfiqur Rahman , Ziwei Jiang , Hilaf Hasson , Murat Kocaoglu