English
Related papers

Related papers: Information directionality in coupled time series …

200 papers

Nonlinear dynamics play an important role in the analysis of signals. A popular, readily interpretable nonlinear measure is Permutation Entropy. It has recently been extended for the analysis of graph signals, thus providing a framework for…

Stochastic chains represent a wide and key variety of phenomena in many branches of science within the context of Information Theory and Thermodynamics. They are typically approached by a sequence of independent events or by a memoryless…

Statistical Mechanics · Physics 2017-03-06 J. Ricardo Arias-Gonzalez

We propose a new method of discovering causal relationships in temporal data based on the notion of causal compression. To this end, we adopt the Pearlian graph setting and the directed information as an information theoretic tool for…

Machine Learning · Statistics 2016-11-02 Aleksander Wieczorek , Volker Roth

We propose to construct cross and joint ordinal pattern transition networks from multivariate time series for two coupled systems, where synchronizations are often present. In particular, we focus on phase synchronization, which is one of…

Chaotic Dynamics · Physics 2018-06-06 Heng Guo , Jiayang Zhang , Yong Zou , Shuguang Guan

We introduce an approach which allows detecting causal relationships between variables for which the time evolution is available. Causality is assessed by a variational scheme based on the Information Imbalance of distance ranks, a…

Methodology · Statistics 2024-05-07 Vittorio Del Tatto , Gianfranco Fortunato , Domenica Bueti , Alessandro Laio

In 2002, in a seminal article, Christoph Bandt and Bernd Pompe proposed a new methodology for the analysis of complex time series, now known as Ordinal Analysis. The ordinal methodology is based on the computation of symbols (known as…

Data Analysis, Statistics and Probability · Physics 2022-06-07 Inmaculada Leyva , Johann Martinez , Cristina Masoller , Osvaldo A. Rosso , Massimiliano Zanin

We study the value of information in sequential compressed sensing by characterizing the performance of sequential information guided sensing in practical scenarios when information is inaccurate. In particular, we assume the signal…

Information Theory · Computer Science 2015-09-02 Ruiyang Song , Yao Xie , Sebastian Pokutta

Low-dimensional representations of underdamped systems often provide insightful grasps and analytical tractability. Here, we build such representations via information projections, obtaining an optimal model that captures the most…

Statistical Mechanics · Physics 2022-08-10 Giorgio Nicoletti , Amos Maritan , Daniel M. Busiello

We propose new concepts in order to analyze and model the dependence structure between two time series. Our methods rely exclusively on the order structure of the data points. Hence, the methods are stable under monotone transformations of…

Statistics Theory · Mathematics 2015-02-02 Alexander Schnurr , Herold Dehling

Appealing to several multivariate information measures---some familiar, some new here---we analyze the information embedded in discrete-valued stochastic time series. We dissect the uncertainty of a single observation to demonstrate how the…

Information Theory · Computer Science 2015-05-28 Ryan G. James , Christopher J. Ellison , James P. Crutchfield

We study two aspects of information semantics: (i) the collection of all relationships, (ii) tracking and spotting anomaly and change. The first is implemented by endowing all relevant information spaces with a Euclidean metric in a common…

Artificial Intelligence · Computer Science 2011-01-11 Fionn Murtagh

Information theory and the framework of information dynamics have been used to provide tools to characterise complex systems. In particular, we are interested in quantifying information storage, information modification and information…

Information Theory · Computer Science 2013-03-25 Oliver Obst , Joschka Boedecker , Benedikt Schmidt , Minoru Asada

The growing study of time series, especially those related to nonlinear systems, has challenged the methodologies to characterize and classify dynamical structures of a signal. Here we conceive a new diagnostic tool for time series based on…

Other Statistics · Statistics 2017-07-05 G. Corso , T. L. Prado , G. Z. dos S. Lima , S. R. Lopes

The purpose of this paper is to characterize the concept of monotonicity according to a direction related to a set of n random variables in terms of its associated n-copula C. We start establishing relationships in the bivariate and…

A methodology for high dimensional causal inference in a time series context is introduced. It is assumed that there is a monotonic transformation of the data such that the dynamics of the transformed variables are described by a Gaussian…

Methodology · Statistics 2023-07-07 Francesco Cordoni , Alessio Sancetta

Directed information theory deals with communication channels with feedback. When applied to networks, a natural extension based on causal conditioning is needed. We show here that measures built from directed information theory in networks…

Information Theory · Computer Science 2011-11-02 P. O. Amblard , O. J. J. Michel

Comparing time series is essential in various tasks such as clustering and classification. While elastic distance measures that allow warping provide a robust quantitative comparison, a qualitative comparison on top of them is missing.…

Machine Learning · Computer Science 2025-06-19 Simiao Lin , Wannes Meert , Pieter Robberechts , Hendrik Blockeel

Identifying the underlying directional relations from observational time series with nonlinear interactions and complex relational structures is key to a wide range of applications, yet remains a hard problem. In this work, we introduce a…

Machine Learning · Computer Science 2020-01-08 Tailin Wu , Thomas Breuel , Michael Skuhersky , Jan Kautz

We develop information-theoretic measures of spatial structure and pattern in more than one dimension. As is well known, the entropy density of a two-dimensional configuration can be efficiently and accurately estimated via a converging…

Statistical Mechanics · Physics 2009-11-07 David P. Feldman , James P. Crutchfield

Ordinal data analysis is an interesting direction in machine learning. It mainly deals with data for which only the relationships `$<$', `$=$', `$>$' between pairs of points are known. We do an attempt of formalizing structures behind…

General Topology · Mathematics 2024-12-24 Karsten Keller , Evgeniy Petrov