Related papers: Kolmogorov--Nagumo Mean Frameworks for Conditional…
In this paper we calculate Kolmogorov-Sinai entropy $h_M(S)$ of the generalized Markov shift associated with a contractive Markov system (CMS) \cite{Wer1} using the coding map constructed in \cite{Wer3}. We show that…
Shannon and Khinchin showed that assuming four information theoretic axioms the entropy must be of Boltzmann-Gibbs type, $S=-\sum_i p_i \log p_i$. Here we note that in physical systems one of these axioms may be violated. For non-ergodic…
We prove an inequality for the entropy numbers in terms of nonlinear Kolmogorov's widths. This inequality is in a spirit of known inequalities of this type and it is adjusted to the form convenient in applications for $m$-term…
In this paper a general definition of quantum conditional entropy for infinite-dimensional systems is given based on recent work of Holevo and Shirokov arXiv:1004.2495 devoted to quantum mutual and coherent informations in the…
The concept of weighted entropy takes into account values of different outcomes, i.e., makes entropy context-dependent, through the weight function. In this paper, we establish a number of simple inequalities for the weighted entropies…
We have discussed the Tsallis entropy in finite $N$-unit nonextensive systems, by using the multivariate $q$-Gaussian probability distribution functions (PDFs) derived by the maximum entropy methods with the normal average and the…
Under certain conditions, the rate of increase of the statistical entropy of a simple, fully chaotic, conservative system is known to be given by a single number, characteristic of this system, the Kolmogorov-Sinai entropy rate. This…
Since Bandt et al. have shown that the permutation entropy and the Kolmogorov-Sinai entropy coincide for piecewise monotone interval maps, the relationship of both entropies for time-discrete dynamical systems is of a certain interest. The…
We define and investigate a notion of entropy for quantum error correcting codes. The entropy of a code for a given quantum channel has a number of equivalent realisations, such as through the coefficients associated with the Knill-Laflamme…
Tsallis and R\'{e}nyi entropy measures are two possible different generalizations of the Boltzmann-Gibbs entropy (or Shannon's information) but are not generalizations of each others. It is however the Sharma-Mittal measure, which was…
We introduce the notion of metric entropy for a nonautonomous dynamical system given by a sequence of probability spaces and a sequence of measure-preserving maps between these spaces. This notion generalizes the classical concept of metric…
Most scholars maintain that quantum mechanics (QM) is a contextual theory and that quantum probability does not allow an epistemic (ignorance) interpretation. By inquiring possible connections between contextuality and non-classical…
Existing error-bound-based analyses for stochastic algorithms that exhibit certain descent properties, such as randomized coordinate descent and randomized projection methods, are often limited in scope and typically lead to overly…
In an equilibrium system, the Kolmogorov-Sinai entropy, $h_{\mathrm{KS}}$, equals the sum of the positive Lyapunov exponents, the exponential rates of divergence of infinitesimal perturbations. Kinetic theory may be used to calculate the…
We discuss the entropic criterion for separability of compound quantum systems for general non-additive entropic forms based on arbitrary concave functions $f$. For any separable state, the generalized entropy of the whole system is shown…
The paper examines relationships between the conditional Shannon entropy and the expectation of $\ell_{\alpha}$-norm for joint probability distributions. More precisely, we investigate the tight bounds of the expectation of…
For a measurable map $T$ and a sequence of $T$-invariant probability measures $\mu_n$ that converges in some sense to a $T$-invariant probability measure $\mu$, an estimate from below for the Kolmogorov--Sinai entropy of $T$ with respect to…
The entropic form $S_q$ is, for any $q \neq 1$, {\it nonadditive}. Indeed, for two probabilistically independent subsystems, it satisfies $S_q(A+B)/k=[S_q(A)/k]+[S_q(B)/k]+(1-q)[S_q(A)/k][S_q(B)/k] \ne S_q(A)/k+S_q(B)/k$. This form will…
We study entropy--coherence relations near rank-deficient support boundaries in finite-dimensional quantum systems. For block-diagonal reference states, we establish support-sensitive coercivity estimates showing that the entropy cost of…
We provide tight upper and lower bounds on the expected minimum Kolmogorov complexity of binary classifiers that are consistent with labeled samples. The expected size is not more than complexity of the target concept plus the conditional…