English
Related papers

Related papers: On Data-Driven Computation of Information Transfer…

200 papers

The ability to distinguish between correlation and causation of variables in molecular systems remains an interesting and open area of investigation. In this work, we probe causality in a molecular system using two independent computational…

Chemical Physics · Physics 2025-02-27 Vittorio Del Tatto , Debarshi Banerjee , Ali Hassanali , Alessandro Laio

We present a framework for constructing a structured realization of a linear time-invariant dynamical system solely from a discrete sampling of an input and output trajectory of the system. We estimate the transfer function of the original…

Optimization and Control · Mathematics 2019-02-15 Elliot Fosong , Philipp Schulze , Benjamin Unger

Transfer Entropy and Directed Information are information-theoretic measures of the directional dependency between stochastic processes. Following the definitions of Schreiber and Massey in discrete time, we define and evaluate these…

Probability · Mathematics 2016-04-08 Nigel J. Newton

Transfer entropy has been used to quantify the directed flow of information between source and target variables in many complex systems. While transfer entropy was originally formulated in discrete time, in this paper we provide a framework…

Information Theory · Computer Science 2017-04-05 Richard E. Spinney , Mikhail Prokopenko , Joseph T. Lizier

We present a measure of local information transfer, derived from an existing averaged information-theoretical measure, namely transfer entropy. Local transfer entropy is used to produce profiles of the information transfer into each…

Cellular Automata and Lattice Gases · Physics 2008-09-22 Joseph T. Lizier , Mikhail Prokopenko , Albert Y. Zomaya

Discovery of causal relations is fundamental for understanding the dynamics of complex systems. While causal interactions are well defined for acyclic systems that can be separated into causally effective subsystems, a mathematical…

Data Analysis, Statistics and Probability · Physics 2017-10-11 Daniel Harnack , Erik Laminski , Klaus Richard Pawelzik

Information theory allows us to investigate information processing in neural systems in terms of information transfer, storage and modification. Especially the measure of information transfer, transfer entropy, has seen a dramatic surge of…

Information Theory · Computer Science 2015-11-24 Patricia Wollstadt , Mario Martínez-Zarzuela , Raul Vicente , Francisco J. Díaz-Pernas , Michael Wibral

While it is an important problem to identify the existence of causal associations between two components of a multivariate time series, a topic addressed in Runge et al. (2012), it is even more important to assess the strength of their…

Data Analysis, Statistics and Probability · Physics 2015-07-15 Jakob Runge , Jobst Heitzig , Norbert Marwan , Jürgen Kurths

Estimating total treatment effects in the presence of network interference typically requires knowledge of the underlying interaction structure. However, in many practical settings, network data is either unavailable, incomplete, or…

Methodology · Statistics 2026-02-05 Albert Tan , Sadegh Shirani , James Nordlund , Mohsen Bayati

Nonlinear dynamical systems are ubiquitous in nature and they are hard to forecast. Not only they may be sensitive to small perturbations in their initial conditions, but they are often composed of processes acting at multiple scales.…

Chaotic Dynamics · Physics 2025-10-06 Chenyu Dong , Davide Faranda , Adriano Gualandi , Valerio Lucarini , Gianmarco Mengaldo

Exploiting the theory of state space models, we derive the exact expressions of the information transfer, as well as redundant and synergistic transfer, for coupled Gaussian processes observed at multiple temporal scales. All of the terms,…

Methodology · Statistics 2017-08-21 Luca Faes , Daniele Marinazzo , Sebastiano Stramaglia

Imitation learning, which learns agent policy by mimicking expert demonstration, has shown promising results in many applications such as medical treatment regimes and self-driving vehicles. However, it remains a difficult task to interpret…

Machine Learning · Computer Science 2024-01-31 Tianxiang Zhao , Wenchao Yu , Suhang Wang , Lu Wang , Xiang Zhang , Yuncong Chen , Yanchi Liu , Wei Cheng , Haifeng Chen

In this paper, we propose a data-driven approach for control of nonlinear dynamical systems. The proposed data-driven approach relies on transfer Koopman and Perron-Frobenius (P-F) operators for linear representation and control of such…

Systems and Control · Computer Science 2018-06-12 Apurba Kumar Das , Bowen Huang , Umesh Vaidya

Mathematical models are fundamental building blocks in the design of dynamical control systems. As control systems are becoming increasingly complex and networked, approaches for obtaining such models based on first principles reach their…

Machine Learning · Computer Science 2022-07-19 Dominik Baumann , Friedrich Solowjow , Karl H. Johansson , Sebastian Trimpe

Modern systems (e.g., deep neural networks, big data analytics, and compilers) are highly configurable, which means they expose different performance behavior under different configurations. The fundamental challenge is that one cannot…

Artificial Intelligence · Computer Science 2019-02-27 Mohammad Ali Javidian , Pooyan Jamshidi , Marco Valtorta

Complex dynamical systems are prevalent in many scientific disciplines. In the analysis of such systems two aspects are of particular interest: 1) the temporal patterns along which they evolve and 2) the underlying causal mechanisms.…

Methodology · Statistics 2022-05-31 Nicolas-Domenic Reiter , Andreas Gerhardus , Jakob Runge

Artificial intelligence models and methods commonly lack causal interpretability. Despite the advancements in interpretable machine learning (IML) methods, they frequently assign importance to features which lack causal influence on the…

Machine Learning · Computer Science 2024-01-29 Francisco Nunes Ferreira Quialheiro Simoes , Mehdi Dastani , Thijs van Ommen

In ordinal symbolic dynamics, transcripts describe the algebraic relationship between ordinal patterns. Using the concept of transcript, we exploit the mathematical structure of the group of permutations to derive properties and relations…

Data Analysis, Statistics and Probability · Physics 2015-06-15 Roberto Monetti , Wolfram Bunk , Thomas Aschenbrenner , Stephan Springer , Jose Maria Amigo

One of the crucial steps in scientific studies is to specify dependent relationships among factors in a system of interest. Given little knowledge of a system, can we characterize the underlying dependent relationships through observation…

Information Theory · Computer Science 2012-12-24 Shohei Hidaka

We propose a data-driven control method for systems with aleatoric uncertainty, for example, robot fleets with variations between agents. Our method leverages shared trajectory data to increase the robustness of the designed controller and…

Robotics · Computer Science 2024-03-25 Alexander von Rohr , Dmitrii Likhachev , Sebastian Trimpe