English
Related papers

Related papers: Granger causality and transfer entropy are equival…

200 papers

This paper indicates causality as the tool that unifies the analysis of both activations and connectivity of brain areas, obtained with fMRI data. Causality analysis is commonly applied to study connectivity, so this work focuses on…

Methodology · Statistics 2011-02-25 Nevio Dubbini

A fundamental goal of scientific research is to learn about causal relationships. However, despite its critical role in the life and social sciences, causality has not had the same importance in Natural Language Processing (NLP), which has…

Many of the classical and recent relations between information and estimation in the presence of Gaussian noise can be viewed as identities between expectations of random quantities. These include the I-MMSE relationship of Guo et al.; the…

Information Theory · Computer Science 2012-05-02 Kartik Venkat , Tsachy Weissman

We consider the Granger causal structure learning problem from time series data. Granger causal algorithms predict a 'Granger causal effect' between two variables by testing if prediction error of one decreases significantly in the absence…

Entropy is a concept that has traditionally been reliant on a definite notion of causality. However, without a definite notion of causality, the concept of entropy is not all lost. Indefinite causal structure results from combining…

General Relativity and Quantum Cosmology · Physics 2011-07-13 Sonia Markes , Lucien Hardy

Inspired by Jang et al. (2022), we propose a Granger causality-in-the-mean test for bivariate $k-$Markov stationary processes based on a recently introduced class of non-linear models, i.e., vine copula models. By means of a simulation…

Econometrics · Economics 2025-05-08 Roberto Fuentes-Martínez , Irene Crimaldi , Armando Rungi

Causal inference is the process of estimating the effect or impact of a treatment on an outcome with other covariates as potential confounders (and mediators) that may need to be controlled. The vast majority of existing methods and systems…

Computation and Language · Computer Science 2022-05-05 Arun S. Maiya

There is a recent trend to leverage the power of graph neural networks (GNNs) for brain-network based psychiatric diagnosis, which,in turn, also motivates an urgent need for psychiatrists to fully understand the decision behavior of the…

Machine Learning · Statistics 2024-01-30 Kaizhong Zheng , Shujian Yu , Badong Chen

A data science task can be deemed as making sense of the data or testing a hypothesis about it. The conclusions inferred from data can greatly guide us to make informative decisions. Big data has enabled us to carry out countless prediction…

Machine Learning · Computer Science 2022-01-12 Wenhao Zhang , Ramin Ramezani , Arash Naeim

We investigate causal inference in the asymptotic regime as the number of variables approaches infinity using an information-theoretic framework. We define structural entropy of a causal model in terms of its description complexity measured…

Artificial Intelligence · Computer Science 2021-09-21 Sridhar Mahadevan

Transfer entropy measures directed information flow in time series, and it has become a fundamental quantity in applications spanning neuroscience, finance, and complex systems analysis. However, existing estimation methods suffer from the…

Machine Learning · Computer Science 2026-04-10 Simon Pedro Galeano Munoz , Mustapha Bounoua , Giulio Franzese , Pietro Michiardi , Maurizio Filippone

With the advancement of neural networks, diverse methods for neural Granger causality have emerged, which demonstrate proficiency in handling complex data, and nonlinear relationships. However, the existing framework of neural Granger…

Machine Learning · Computer Science 2024-05-15 Wanqi Zhou , Shuanghao Bai , Shujian Yu , Qibin Zhao , Badong Chen

Machine learning has revitalized causal inference by combining flexible models and principled estimators, yet robust benchmarking and evaluation remain challenging with real-world data. In this work, we introduce frengression, a deep…

Methodology · Statistics 2025-08-05 Linying Yang , Robin J. Evans , Xinwei Shen

Estimating causal relations is vital in understanding the complex interactions in multivariate time series. Non-linear coupling of variables is one of the major challenges inaccurate estimation of cause-effect relations. In this paper, we…

Machine Learning · Computer Science 2021-10-19 Wasim Ahmad , Maha Shadaydeh , Joachim Denzler

Inferring the effect of interventions within complex systems is a fundamental problem of statistics. A widely studied approach employs structural causal models that postulate noisy functional relations among a set of interacting variables.…

Methodology · Statistics 2024-02-14 David Strieder , Mathias Drton

There is increasing interest in identifying changes in the underlying states of brain networks. The availability of large scale neuroimaging data creates a strong need to develop fast, scalable methods for detecting and localizing in time…

Methodology · Statistics 2022-01-11 Peiliang Bai , Abolfazl Safikhani , George Michailidis

We aim to explicitly model the delayed Granger causal effects based on multivariate Hawkes processes. The idea is inspired by the fact that a causal event usually takes some time to exert an effect. Studying this time lag itself is of…

Machine Learning · Computer Science 2023-08-14 Chao Yang , Hengyuan Miao , Shuang Li

Identifying the causal structure of systems with multiple dynamic elements is critical to several scientific disciplines. The conventional approach is to conduct statistical tests of causality, for example with Granger Causality, between…

Machine Learning · Statistics 2022-03-22 Jacek P. Dmochowski

Entropic causal inference is a recent framework for learning the causal graph between two variables from observational data by finding the information-theoretically simplest structural explanation of the data, i.e., the model with smallest…

Machine Learning · Computer Science 2025-09-23 Spencer Compton , Kristjan Greenewald , Dmitriy Katz , Murat Kocaoglu

Understanding the dynamics of functional brain connectivity patterns using noninvasive neuroimaging techniques is an important focus in human neuroscience. Vector autoregressive (VAR) processes and Granger causality analysis (GCA) have been…

Applications · Statistics 2022-09-16 Jingjing Fan , Kevin Sitek , Bharath Chandrasekaran , Abhra Sarkar