English
Related papers

Related papers: Higher order definition of causality by optimally …

200 papers

We present a simple yet highly generalizable method for explaining interacting parts within a neural network's reasoning process. First, we design an algorithm based on cross derivatives for computing statistical interaction effects between…

Machine Learning · Computer Science 2021-10-12 Samuel Lerman , Chenliang Xu , Charles Venuto , Henry Kautz

Discussions on causal relations in real life often consider variables for which the definition of causality is unclear since the notion of interventions on the respective variables is obscure. Asking 'what qualifies an action for being an…

Methodology · Statistics 2022-11-17 Dominik Janzing , Sergio Hernan Garrido Mejia

A fundamental goal of scientific research is to learn about causal relationships. However, despite its critical role in the life and social sciences, causality has not had the same importance in Natural Language Processing (NLP), which has…

We define the concept of dependence among multiple variables using maximum entropy techniques and introduce a graphical notation to denote the dependencies. Direct inference of information theoretic quantities from data uncovers…

Quantitative Methods · Quantitative Biology 2007-07-13 Ilya Nemenman

Comparing networks is essential for a number of downstream tasks, from clustering to anomaly detection. Despite higher-order interactions being critical for understanding the dynamics of complex systems, traditional approaches for network…

Physics and Society · Physics 2025-11-03 Helcio Felippe , Alec Kirkley , Federico Battiston

Complex systems have interested researchers across a broad range of fields for many years and as computing has become more accesible and feasible, it is now possible to simulate aspects of these systems. A major point of research is how…

Multiagent Systems · Computer Science 2019-01-16 George Hassan-Coring

Characterising cause-effect relationships in complex systems is fundamental to understanding their underlying mechanisms. Granger causality (GC) remains a widely used computational tool for identifying causal relationships in time series…

Machine Learning · Statistics 2026-05-26 S. A. Adedayo

Causal inference in a nonlinear system of multivariate timeseries is instrumental in disentangling the intricate web of relationships among variables, enabling us to make more accurate predictions and gain deeper insights into real-world…

Machine Learning · Computer Science 2024-01-17 Wasim Ahmad , Maha Shadaydeh , Joachim Denzler

Objectives: We develop a framework for the analysis of synergy and redundancy in the pattern of information flow between subsystems of a complex network. Methods: The presence of redundancy and/or synergy in multivariate time series data…

Information Theory · Computer Science 2016-05-17 Sebastiano Stramaglia , Leonardo Angelini , Guorong Wu , Jesus M. Cortés , Luca Faes , Daniele Marinazzo

Discovering causal relationships is a hard task, often hindered by the need for intervention, and often requiring large amounts of data to resolve statistical uncertainty. However, humans quickly arrive at useful causal relationships. One…

Machine Learning · Statistics 2011-12-01 Pedro A. Ortega

We propose the Fourier-domain transfer entropy spectrum, a novel generalization of transfer entropy, as a model-free metric of causality. For arbitrary systems, this approach systematically quantifies the causality among their different…

Data Analysis, Statistics and Probability · Physics 2021-10-14 Yang Tian , Yaoyuan Wang , Ziyang Zhang , Pei Sun

Transfer entropy is an established method for quantifying directed statistical dependencies in neuroimaging and complex systems datasets. The pairwise (or bivariate) transfer entropy from a source to a target node in a network does not…

Information Theory · Computer Science 2020-05-05 Leonardo Novelli , Fatihcan M. Atay , Jürgen Jost , Joseph T. Lizier

Causal structure learning has long been the central task of inferring causal insights from data. Despite the abundance of real-world processes exhibiting higher-order mechanisms, however, an explicit treatment of interactions in causal…

Machine Learning · Computer Science 2025-11-07 James Enouen , Yujia Zheng , Ignavier Ng , Yan Liu , Kun Zhang

Temporal point process as the stochastic process on continuous domain of time is commonly used to model the asynchronous event sequence featuring with occurrence timestamps. Thanks to the strong expressivity of deep neural networks, they…

Machine Learning · Computer Science 2024-12-25 Haitao Lin , Cheng Tan , Lirong Wu , Zhangyang Gao , Zicheng Liu , Stan. Z. Li

A defining property of complex systems is that they have multiscale structure. How does this multiscale structure come about? We argue that within systems there emerges a hierarchy of scales that contribute to a system's causal workings. An…

Information Theory · Computer Science 2025-10-15 Abel Jansma , Erik Hoel

Machine learning algorithms are designed to capture complex relationships between features. In this context, the high dimensionality of data often results in poor model performance, with the risk of overfitting. Feature selection, the…

Machine Learning · Computer Science 2023-10-18 Paolo Bonetti , Alberto Maria Metelli , Marcello Restelli

Traditionally, statistical and causal inference on human subjects rely on the assumption that individuals are independently affected by treatments or exposures. However, recently there has been increasing interest in settings, such as…

Methodology · Statistics 2020-02-25 Elizabeth L. Ogburn , Ilya Shpitser , Youjin Lee

Qualitative causal relationships compactly express the direction, dependency, temporal constraints, and monotonicity constraints of discrete or continuous interactions in the world. In everyday or academic language, we may express…

Artificial Intelligence · Computer Science 2022-02-25 Scott Friedman , Ian Magnusson , Vasanth Sarathy , Sonja Schmer-Galunder

In this paper, we show through examples, how the existing definitions of information transfer, namely directed information and transfer entropy fail to capture true causal interaction between states in control dynamical system. We propose a…

Optimization and Control · Mathematics 2018-07-24 Subhrajit Sinha , Umesh Vaidya

This paper contributes to the understanding of strongly coupled spatio-temporal processes by describing a generic method based on Granger causality. The method is validated by the robust identification of causality regimes and of their…

Applications · Statistics 2017-09-27 Juste Raimbault