English
Related papers

Related papers: Extracting individual variable information for the…

200 papers

Recent developments have linked causal inference with Algorithmic Information Theory, and methods have been developed that utilize Conditional Kolmogorov Complexity to determine causation between two random variables. We present a method…

Machine Learning · Computer Science 2019-11-11 Daniel Goldfarb , Scott Evans

Statistical prediction models are often trained on data from different probability distributions than their eventual use cases. One approach to proactively prepare for these shifts harnesses the intuition that causal mechanisms should…

Machine Learning · Computer Science 2023-08-02 Bijan Mazaheri , Atalanti Mastakouri , Dominik Janzing , Michaela Hardt

Estimation of mutual information between (multidimensional) real-valued variables is used in analysis of complex systems, biological systems, and recently also quantum systems. This estimation is a hard problem, and universally good…

Quantitative Methods · Quantitative Biology 2019-08-14 Caroline M. Holmes , Ilya Nemenman

Probabilities of causation are fundamental to individual-level explanation and decision making, yet they are inherently counterfactual and not point-identifiable from data in general. Existing bounds either disregard available covariates,…

Artificial Intelligence · Computer Science 2026-02-17 Yuxuan Xie , Ang Li

Important information on the structure of complex systems, consisting of more than one component, can be obtained by measuring to which extent the individual components exchange information among each other. Such knowledge is needed to…

Disordered Systems and Neural Networks · Physics 2009-11-13 Daniele Marinazzo , Mario Pellicoro , Sebastiano Stramaglia

A methodology is developed to extract $d$ invariant features $W=f(X)$ that predict a response variable $Y$ without being confounded by variables $Z$ that may influence both $X$ and $Y$. The methodology's main ingredient is the penalization…

Statistics Theory · Mathematics 2026-05-01 Ian Bounos , Pablo Groisman , Mariela Sued , Esteban Tabak

Granger causality is a statistical notion of causal influence based on prediction via vector autoregression. For Gaussian variables it is equivalent to transfer entropy, an information-theoretic measure of time-directed information transfer…

Quantitative Methods · Quantitative Biology 2021-02-17 Sebastiano Stramaglia , Tomas Scagliarini , Yuri Antonacci , Luca Faes

The paper considers variable selection in linear regression models where the number of covariates is possibly much larger than the number of observations. High dimensionality of the data brings in many complications, such as (possibly…

Methodology · Statistics 2016-11-29 Haeran Cho , Piotr Fryzlewicz

Longitudinal analysis is important in many disciplines, such as the study of behavioral transitions in social science. Only very recently, feature selection has drawn adequate attention in the context of longitudinal modeling. Standard…

Methodology · Statistics 2016-10-26 Tingyang Xu , Jiangwen Sun , Jinbo Bi

We propose a novel estimator of the mutual information between two ordinal vectors $x$ and $y$. Our approach is inductive (as opposed to deductive) in that it depends on the data generating distribution solely through some nonparametric…

Machine Learning · Statistics 2022-04-12 Yves-Laurent Kom Samo

Quantifying relationships between components of a complex system is critical to understanding the rich network of interactions that characterize the behavior of the system. Traditional methods for detecting pairwise dependence of time…

Data Analysis, Statistics and Probability · Physics 2024-04-10 Aria Nguyen , Oscar McMullin , Joseph T. Lizier , Ben D. Fulcher

Poly-trees are singly connected causal networks in which variables may arise from multiple causes. This paper develops a method of recovering ply-trees from empirically measured probability distributions of pairs of variables. The method…

Artificial Intelligence · Computer Science 2013-04-11 George Rebane , Judea Pearl

Causal inference from observational data requires assumptions. These assumptions range from measuring confounders to identifying instruments. Traditionally, causal inference assumptions have focused on estimation of effects for a single…

Machine Learning · Statistics 2019-03-04 Rajesh Ranganath , Adler Perotte

We propose two novel extensions of the Wyner common information optimization problem. Each relaxes one fundamental constraints in Wyner's formulation. The \textit{Variational Wyner Common Information} relaxes the matching constraint to the…

Information Theory · Computer Science 2024-02-23 Teng-Hui Huang , Hesham El Gamal

We propose a method to classify the causal relationship between two discrete variables given only the joint distribution of the variables, acknowledging that the method is subject to an inherent baseline error. We assume that the causal…

Machine Learning · Statistics 2016-11-07 Krzysztof Chalupka , Frederick Eberhardt , Pietro Perona

Designing an appropriate set of collective variables is crucial to the success of several enhanced sampling methods. Here we focus on how to obtain such variables from information limited to the metastable states. We characterize these…

Chemical Physics · Physics 2020-04-08 Luigi Bonati , Valerio Rizzi , Michele Parrinello

As an essential component of human cognition, cause-effect relations appear frequently in text, and curating cause-effect relations from text helps in building causal networks for predictive tasks. Existing causality extraction techniques…

Information Retrieval · Computer Science 2021-11-02 Jie Yang , Soyeon Caren Han , Josiah Poon

Paraphrasing is a useful natural language processing task that can contribute to more diverse generated or translated texts. Natural language inference (NLI) and paraphrasing share some similarities and can benefit from a joint approach. We…

Computation and Language · Computer Science 2021-11-16 Matej Klemen , Marko Robnik-Šikonja

One of the fundamental steps toward understanding a complex system is identifying variation at the scale of the system's components that is most relevant to behavior on a macroscopic scale. Mutual information provides a natural means of…

Machine Learning · Computer Science 2024-03-20 Kieran A. Murphy , Dani S. Bassett

Explaining artificial intelligence or machine learning models is increasingly important. To use such data-driven systems wisely we must understand how they interact with the world, including how they depend causally on data inputs. In this…

Machine Learning · Computer Science 2023-07-06 Joshua R. Loftus , Lucius E. J. Bynum , Sakina Hansen