Related papers: The McMillan theorem for colored branching process…
It is well known that in Information Theory and Machine Learning the Kullback-Leibler divergence, which extends the concept of Shannon entropy, plays a fundamental role. Given an {\it a priori} probability kernel $\hat{\nu}$ and a…
The notion of a surface-order specific entropy h_c(P) of a two-dimensional discrete random field P along a curve c is introduced as the limit of rescaled entropies along lattice approximations of the blowups of c. Existence is shown by…
We calculate the almost sure Hausdorff dimension of uniformly random self-similar fractals. These random fractals are generated from a finite family of similarities, where the linear parts of the mappings are independent uniformly…
In this work we are interested in the self--affine fractals studied by Gatzouras and Lalley and by the author which generalize the famous general Sierpinski carpets studied by Bedford and McMullen. We give a formula for the Hausdorff…
We study natural measures on sets of beta-expansions and on slices through self similar sets. In the setting of beta-expansions, these allow us to better understand the measure of maximal entropy for the random beta-transformation and to…
We consider the fractal characteristic of the quantum mechanical paths and we obtain for any universal class of fractons labeled by the Hausdorff dimension defined within the interval 1$ $$ < $$ $$h$$ $$ <$$ $$ 2$, a fractal distribution…
In this article a collection of random self-similar fractal dendrites is constructed, and their Hausdorff dimension is calculated. Previous results determining this quantity for random self-similar structures have relied on geometrical…
The asymptotic correspondence between the probability mass function of the $q$-deformed multinomial distribution and the $q$-generalised Kullback-Leibler divergence, also known as Tsallis relative entropy, is established. The probability…
We consider the fractal characteristic of the quantum mechanical paths and we obtain for any universal class of fractons labeled by the Hausdorff dimension defined within the interval 1$ $$ < $$ $$h$$ $$ <$$ $$ 2$, a fractal distribution…
This work addresses problems on simultaneous Diophantine approximation on fractals, motivated by a long standing problem of Mahler regarding Cantor's middle $1/3$ set. We obtain the first instances where a complete analogue of Khintchine's…
Experimental designs are tools which can drastically reduce the number of simulations required by time-consuming computer codes. One strategy for selecting the values of the inputs, whose response is to be observed, is to choose these…
Mean Hausdorff dimension is a dynamical version of Hausdorff dimension. It provides a way to dynamicalize geometric measure theory. We pick up the following three classical results of fractal geometry. (1) The calculation of Hausdorff…
We analyze dynamical properties of the Shannon information entropy of a continuous probability distribution, which is driven by a standard diffusion process. This entropy choice is confronted with another option, employing the conditional…
We use the Heat Kernel method to calculate the Entanglement Entropy for a given entangling region on a fractal. The leading divergent term of the entropy is obtained as a function of the fractal dimension as well as the walk dimension. The…
We characterize Martin-L\"of randomness and Schnorr randomness in terms of the merging of opinions, along the lines of the Blackwell-Dubins Theorem. After setting up a general framework for defining notions of merging randomness, we focus…
Estimating the Shannon entropy of a discrete distribution from which we have only observed a small sample is challenging. Estimating other information-theoretic metrics, such as the Kullback-Leibler divergence between two sparsely sampled…
We study Bedford--McMullen type carpets whose selected grid rectangles may be reflected in one or both coordinates. The organizing principle is that the Hausdorff dimension is controlled by the entropy of the weak-coordinate projection.…
A two parameter generalization of Boltzmann-Gibbs-Shannon entropy based on natural logarithm is introduced. The generalization of the Shannon-Kinchinn axioms corresponding to the two parameter entropy is proposed and verified. We present…
Convergence properties of Shannon Entropy are studied. In the differential setting, it is shown that weak convergence of probability measures, or convergence in distribution, is not enough for convergence of the associated differential…
In this article, we prove Shannon-MacMillan-Breiman Theorem for Wireless Sensor Networks modelled as coloured geometric random graphs. For large $n,$ we show that a Wireless Sensor Network consisting of $n$ sensors in $[0,1]^d$ connected by…