English
Related papers

Related papers: Multivariate permutation entropy, a Cartesian grap…

200 papers

This paper introduces a simple measure of a concordance pattern among observed outcomes along a network, i.e., the pattern in which adjacent outcomes tend to be more strongly correlated than non-adjacent outcomes. The graph concordance…

Methodology · Statistics 2017-09-04 Kyungchul Song

Entropy measures quantify the amount of information and correlation present in a quantum system. In practice, when the quantum state is unknown and only copies thereof are available, one must resort to the estimation of such entropy…

Quantum Physics · Physics 2024-03-27 Ziv Goldfeld , Dhrumil Patel , Sreejith Sreekumar , Mark M. Wilde

Large continuous-time Markov chains with exponentially small transition rates arise in modeling complex systems in physics, chemistry and biology. We propose a constructive graph-algorithmic approach to determine the sequence of critical…

Probability · Mathematics 2017-02-01 Tingyue Gan , Maria Cameron

The method of Maximum (relative) Entropy (ME) is used to translate the information contained in the known form of the likelihood into a prior distribution for Bayesian inference. The argument is guided by intuition gained from the…

Data Analysis, Statistics and Probability · Physics 2009-11-10 Ariel Caticha , Roland Preuss

Transfer entropy (TE) captures the directed relationships between two variables. Partial transfer entropy (PTE) accounts for the presence of all confounding variables of a multivariate system and infers only about direct causality. However,…

Methodology · Statistics 2021-02-03 Angeliki Papana , Ariadni Papana-Dagiasis , Elsa Siggiridou

Given a heterogeneous time-series sample, the objective is to find points in time (called change points) where the probability distribution generating the data has changed. The data are assumed to have been generated by arbitrary unknown…

Machine Learning · Statistics 2015-05-13 Azadeh Khaleghi , Daniil Ryabko

A measure to estimate the direct and directional coupling in multivariate time series is proposed. The measure is an extension of a recently published measure of conditional Mutual Information from Mixed Embedding (MIME) for bivariate time…

Data Analysis, Statistics and Probability · Physics 2015-06-16 Dimitris Kugiumtzis

This paper proposes a geometric estimator of dependency between a pair of multivariate samples. The proposed estimator of dependency is based on a randomly permuted geometric graph (the minimal spanning tree) over the two multivariate…

Machine Learning · Computer Science 2019-10-02 Salimeh Yasaei Sekeh , Alfred O. Hero

We consider a Gaussian statistical model whose parameter space is given by the variances of random variables. Underlying this model we identify networks by interpreting random variables as sitting on vertices and their correlations as…

Mathematical Physics · Physics 2015-06-17 Domenico Felice , Stefano Mancini , Marco Pettini

Entropy production (EP) is a key quantity in thermodynamics, and yet measuring EP has remained a challenging task. Here we introduce an EP estimator, called multidimensional entropic bound (MEB), utilizing an ensemble of trajectories…

Statistical Mechanics · Physics 2024-09-06 Sangyun Lee , Dong-Kyum Kim , Jong-Min Park , Won Kyu Kim , Hyunggyu Park , Jae Sung Lee

We construct the general permutation invariant Gaussian 2-matrix model for matrices of arbitrary size $D$. The parameters of the model are given in terms of variables defined using the representation theory of the symmetric group $S_D$. A…

High Energy Physics - Theory · Physics 2022-03-30 George Barnes , Adrian Padellaro , Sanjaye Ramgoolam

We propose multivariate nonstationary Gaussian processes for jointly modeling multiple clinical variables, where the key parameters, length-scales, standard deviations and the correlations between the observed output, are all time…

Methodology · Statistics 2019-10-15 Rui Meng , Braden Soper , Herbert Lee , Vincent X. Liu , John D. Greene , Priyadip Ray

This article introduces a new class of models for multiple networks. The core idea is to parametrize a distribution on labelled graphs in terms of a Fr\'{e}chet mean graph (which depends on a user-specified choice of metric or graph…

Methodology · Statistics 2020-03-09 Simón Lunagómez , Sofia C. Olhede , Patrick J. Wolfe

The rate of entropy production provides a useful quantitative measure of a non-equilibrium system and estimating it directly from time-series data from experiments is highly desirable. Several approaches have been considered for stationary…

Statistical Mechanics · Physics 2022-02-21 Shun Otsubo , Sreekanth K Manikandan , Takahiro Sagawa , Supriya Krishnamurthy

In this paper, we present a kernel-based, multi-task Gaussian Process (GP) model for approximating the underlying function of an individual's mobility state using a time-inhomogeneous Markov Process with two states: moves and pauses. Our…

Machine Learning · Statistics 2023-06-22 Ekin Ugurel

The modeling of diffusion processes on graphs is the basis for many network science and machine learning approaches. Entropic measures of network-based diffusion have recently been employed to investigate the reversibility of these…

Dynamical Systems · Mathematics 2025-10-23 Samuel Koovely , Alexandre Bovet

A new method is proposed to compute connectivity measures on multivariate time series with gaps. Rather than removing or filling the gaps, the rows of the joint data matrix containing empty entries are removed and the calculations are done…

Methodology · Statistics 2015-05-04 G. Papadopoulos , D. Kugiumtzis

Entropic causal inference is a recent framework for learning the causal graph between two variables from observational data by finding the information-theoretically simplest structural explanation of the data, i.e., the model with smallest…

Machine Learning · Computer Science 2025-09-23 Spencer Compton , Kristjan Greenewald , Dmitriy Katz , Murat Kocaoglu

Understanding causal relationships among the variables of a system is paramount to explain and control its behavior. For many real-world systems, however, the true causal graph is not readily available and one must resort to predictions…

Machine Learning · Statistics 2024-12-20 Elias Eulig , Atalanti A. Mastakouri , Patrick Blöbaum , Michaela Hardt , Dominik Janzing

Entropy is a classical measure to quantify the amount of information or complexity of a system. Various entropy-based measures such as functional and spectral entropies have been proposed in brain network analysis. However, they are less…

Neurons and Cognition · Quantitative Biology 2018-03-08 Hyekyoung Lee , Eunkyung Kim , Hyejin Kang , Youngmin Huh , Youngjo Lee , Seonhee Lim , Dong Soo Lee