English
Related papers

Related papers: Problems with information theoretic approaches to …

200 papers

Causal representation learning seeks to extract high-level latent factors from low-level sensory data. Most existing methods rely on observational data and structural assumptions (e.g., conditional independence) to identify the latent…

Machine Learning · Statistics 2024-02-26 Kartik Ahuja , Divyat Mahajan , Yixin Wang , Yoshua Bengio

Understanding predictions made by deep neural networks is notoriously difficult, but also crucial to their dissemination. As all machine learning based methods, they are as good as their training data, and can also capture unwanted biases.…

Computation and Language · Computer Science 2022-11-15 Amir Feder , Nadav Oved , Uri Shalit , Roi Reichart

Comparisons are made for the amount of agreement of the composite likelihood information criteria and their full likelihood counterparts when making decisions among the fits of different models, and some properties of penalty term for…

Statistics Theory · Mathematics 2014-10-17 Chi Tim Ng , Harry Joe

As artificial intelligence and machine learning tools become more accessible, and scientists face new obstacles to data collection (e.g. rising costs, declining survey response rates), researchers increasingly use predictions from…

Methodology · Statistics 2024-02-06 Kentaro Hoffman , Stephen Salerno , Awan Afiaz , Jeffrey T. Leek , Tyler H. McCormick

Causal structure learning is a key problem in many domains. Causal structures can be learnt by performing experiments on the system of interest. We address the largely unexplored problem of designing a batch of experiments that each…

Machine Learning · Computer Science 2021-11-25 Scott Sussex , Andreas Krause , Caroline Uhler

We consider the problem of using observational data to estimate the causal effects of linguistic properties. For example, does writing a complaint politely lead to a faster response time? How much will a positive product review increase…

Computation and Language · Computer Science 2021-06-15 Reid Pryzant , Dallas Card , Dan Jurafsky , Victor Veitch , Dhanya Sridhar

There are many scenarios where short- and long-term causal effects of an intervention are different. For example, low-quality ads may increase short-term ad clicks but decrease the long-term revenue via reduced clicks. This work, therefore,…

Applications · Statistics 2020-12-23 Lu Cheng , Ruocheng Guo , Huan Liu

We investigate the problem of inferring the causal predictors of a response $Y$ from a set of $d$ explanatory variables $(X^1,\dots,X^d)$. Classical ordinary least squares regression includes all predictors that reduce the variance of $Y$.…

Statistics Theory · Mathematics 2018-05-29 Niklas Pfister , Peter Bühlmann , Jonas Peters

Controversy about the significance of underdetermination of theories persists in the philosophy and conduct of science. The issue has practical import when research is used to inform decision making, because scientific uncertainty yields…

Econometrics · Economics 2026-04-09 Charles F. Manski

Adapting to latent confounded shift remains a core challenge in modern AI. This setting is driven by hidden variables that induce spurious correlations between inputs and outputs during training, leading models to rely on non-causal…

Machine Learning · Computer Science 2026-05-14 Jialin Yu , Yuxiang Zhou , Haoxuan Li , Junchi Yu , Mengyue Yang , Yulan He , Nevin L. Zhang , Philip Torr , Ricardo Silva

Causal Learning has emerged as a major theme of research in statistics and machine learning in recent years, promising specific computational techniques to apply to datasets that reveal the true nature of cause and effect in a number of…

Machine Learning · Computer Science 2025-06-04 Vyacheslav Kungurtsev , Leonardo Christov Moore , Gustav Sir , Martin Krutsky

Understanding the causal effects of text on downstream outcomes is a central task in many applications. Estimating such effects requires researchers to run controlled experiments that systematically vary textual features. While large…

Computation and Language · Computer Science 2026-02-18 Omri Feldman , Amar Venugopal , Jann Spiess , Amir Feder

Counterfactual (CF) explanations have been employed as one of the modes of explainability in explainable AI-both to increase the transparency of AI systems and to provide recourse. Cognitive science and psychology, however, have pointed out…

Artificial Intelligence · Computer Science 2022-12-14 Marko Tesic , Ulrike Hahn

The ability to make decisions based on data, with its inherent uncertainties and variability, is a complex and vital skill in the modern world. The need for such quantitative critical thinking occurs in many different contexts, and while it…

Physics Education · Physics 2015-08-21 N. G. Holmes , Carl E. Wieman , D. A. Bonn

Most existing debiasing methods for multimodal models, including causal intervention and inference methods, utilize approximate heuristics to represent the biases, such as shallow features from early stages of training or unimodal features…

Machine Learning · Computer Science 2023-11-29 Vaidehi Patil , Adyasha Maharana , Mohit Bansal

We introduce an information-theoretic method for quantifying causality in chaotic systems. The approach, referred to as IT-causality, quantifies causality by measuring the information gained about future events conditioned on the knowledge…

Fluid Dynamics · Physics 2023-11-01 Adrián Lozano-Durán , Gonzalo Arranz , Yuenong Ling

Despite the obvious advantage of simple life forms capable of fast replication, different levels of cognitive complexity have been achieved by living systems in terms of their potential to cope with environmental uncertainty. Against the…

Populations and Evolution · Quantitative Biology 2017-10-18 Luís F Seoane , Ricard Solé

Recent approaches to causal inference have focused on causal effects defined as contrasts between the distribution of counterfactual outcomes under hypothetical interventions on the nodes of a graphical model. In this article we develop…

Methodology · Statistics 2023-04-26 Iván Díaz

The abundance of data produced daily from large variety of sources has boosted the need of novel approaches on causal inference analysis from observational data. Observational data often contain noisy or missing entries. Moreover, causal…

Methodology · Statistics 2017-03-14 Fani Tsapeli , Peter Tino , Mirco Musolesi

Pursuing invariant prediction from heterogeneous environments opens the door to learning causality in a purely data-driven way and has several applications in causal discovery and robust transfer learning. However, existing methods such as…

Statistics Theory · Mathematics 2025-01-30 Yihong Gu , Cong Fang , Yang Xu , Zijian Guo , Jianqing Fan