English
Related papers

Related papers: Entropy of finite random binary sequences with wea…

200 papers

This work is an enquiry into the circumstances under which entropy methods can give an answer to the questions of both quantum separability and classical correlations of a composite state. Several entropy functionals are employed to examine…

Quantum Physics · Physics 2009-11-07 A. K. Rajagopal , R. W. Rendell

In this paper we investigate a quantity called conditional entropy of ordinal patterns, akin to the permutation entropy. The conditional entropy of ordinal patterns describes the average diversity of the ordinal patterns succeeding a given…

Chaotic Dynamics · Physics 2014-07-22 Anton M. Unakafov , Karsten Keller

We propose two different approaches for introducing the information temperature of the binary N-th order Markov chains. The first approach is based on comparing the Markov sequences with the equilibrium Ising chains at given temperatures.…

Data Analysis, Statistics and Probability · Physics 2022-10-05 O. V. Usatenko , S. S. Melnyk , G. M. Pritula , V. A. Yampol'skii

Entropy and differential entropy are important quantities in information theory. A tractable extension to singular random variables-which are neither discrete nor continuous-has not been available so far. Here, we present such an extension…

Information Theory · Computer Science 2017-01-04 Günther Koliander , Georg Pichler , Erwin Riegler , Franz Hlawatsch

The entanglement entropy of a subsystem of a quantum system is expressed, in the replica approach, through analytic continuation with respect to n of the trace of the n-th power of the reduced density matrix. This trace can be thought of as…

High Energy Physics - Theory · Physics 2008-12-18 Michele Caraglio , Ferdinando Gliozzi

The generic behavior of quantum systems has long been of theoretical and practical interest. Any quantum process is represented by a sequence of quantum channels. We consider general ergodic sequences of stochastic channels with arbitrary…

Quantum Physics · Physics 2022-07-08 Ramis Movassagh , Jeffrey Schenker

A constructive proof is given to the fact that any ergodic Markov chain can be realized as a random walk subject to a synchronizing road coloring. Redundancy (ratio of extra entropy) in such a realization is also studied.

Probability · Mathematics 2011-05-06 Kouji Yano , Kenji Yasutomi

We derive various exact results for Markovian systems that spontaneously relax to a non-equilibrium steady-state by using joint probability distributions symmetries of different entropy production decompositions. The analytical approach is…

Statistical Mechanics · Physics 2012-02-10 Reinaldo García-García , Vivien Lecomte , A. B. Kolton , D. Domínguez

This paper derives new bounds on the difference of the entropies of two discrete random variables in terms of the local and total variation distances between their probability mass functions. The derivation of the bounds relies on maximal…

Information Theory · Computer Science 2016-11-17 Igal Sason

We consider a class of discrete time Markov chains with state space [0,1] and the following dynamics. At each time step, first the direction of the next transition is chosen at random with probability depending on the current location. Then…

Probability · Mathematics 2014-12-04 Shaun McKinlay , Konstantin Borovkov

This study investigates the entanglement properties of disordered free fermion systems undergoing an Anderson phase transition from a delocalized to a localized phase. The entanglement entropy is employed to quantify the degree of…

Strongly Correlated Electrons · Physics 2023-09-26 Mohammad Pouranvari

The exact expression for the density matrix of the kink ground state of the ferromagnetic XXZ chain is obtained. Utilizing this, we exactly calculate various correlation functions such as the longitudinal and transverse spin-spin…

Statistical Mechanics · Physics 2009-03-17 Kohei Motegi , Kazumitsu Sakai

We study the effect of the choice of embedding geometry on the entropy of random geometric graph ensembles with soft connection functions. First we show that when the connection range is small, the entropy is dependent only on the dimension…

Probability · Mathematics 2026-01-22 Oliver Baker , Carl P. Dettmann

We consider discrete-time Markov chains and study large deviations of the pair empirical occupation measure, which is useful to compute fluctuations of pure-additive and jump-type observables. We provide an exact expression for the…

Statistical Mechanics · Physics 2022-07-04 Giorgio Carugno , Pierpaolo Vivo , Francesco Coghi

Let $X$ be a discrete random variable with support $S$ and $f : S \to S^\prime$ be a bijection. Then it is well-known that the entropy of $X$ is the same as the entropy of $f(X)$. This entropy preservation property has been well-utilized to…

Information Theory · Computer Science 2007-07-13 Chandra Nair , Balaji Prabhakar , Devavrat Shah

Hidden Markov chains are widely applied statistical models of stochastic processes, from fundamental physics and chemistry to finance, health, and artificial intelligence. The hidden Markov processes they generate are notoriously…

Chaotic Dynamics · Physics 2021-05-26 Alexandra M. Jurgens , James P. Crutchfield

In this paper, we establish novel concentration inequalities for additive functionals of geometrically ergodic Markov chains similar to Rosenthal inequalities for sums of independent random variables. We pay special attention to the…

Probability · Mathematics 2025-09-26 Alain Durmus , Eric Moulines , Alexey Naumov , Sergey Samsonov , Marina Sheshukova

We consider the maximum entropy Markov chain inference approach to characterize the collective statistics of neuronal spike trains, focusing on the statistical properties of the inferred model. We review large deviations techniques useful…

Neurons and Cognition · Quantitative Biology 2018-08-15 Rodrigo Cofre , Cesar Maldonado , Fernando Rosas

We explore the relation between entanglement entropy of quantum many body systems and the distribution of corresponding, properly selected, observables. Such a relation is necessary to actually measure the entanglement entropy. We show that…

Statistical Mechanics · Physics 2009-11-11 Israel Klich , Gil Refael , Alessandro Silva

This paper considers a Markov-modulated duplication-deletion random graph where at each time instant, one node can either join or leave the network; the probabilities of joining or leaving evolve according to the realization of a finite…

Information Theory · Computer Science 2013-03-04 Maziyar Hamdi , Vikram Krishnamurthy , George Yin