相关论文: Toward a relative q-entropy
In ordinary statistical mechanics the Boltzmann-Shannon entropy is related to the Maxwell-Bolzmann distribution $p_i$ by means of a twofold link. The first link is differential and is offered by the Jaynes Maximum Entropy Principle. The…
During the past decades, the Ising distribution has attracted interest in many applied disciplines, as the maximum entropy distribution associated to any set of correlated binary (`spin') variables with observed means and covariances.…
Although neural networks can solve very complex machine-learning problems, the theoretical reason for their generalizability is still not fully understood. Here we use Wang-Landau Mote Carlo algorithm to calculate the entropy (logarithm of…
We introduce hardness in relative entropy, a new notion of hardness for search problems which on the one hand is satisfied by all one-way functions and on the other hand implies both next-block pseudoentropy and inaccessible entropy, two…
Following [1], the aim of this paper is to analyze the relative weighted entropy involving the central moments weight functions. We compare the standard relative entropy with the weighted case in two particular forms of Gaussian…
We present our view in a standing debate about the definition and meaning of power-law entropies for continuous systems. Our suggestion is that such arguments should take into account the generalized operations of addition and…
The aim of this paper is to investigate the q -> 1/q duality in an information-entropy theory of all q-generalized entropy functionals (Tsallis, Renyi and Sharma-Mittal measures) in the light of a representation based on generalized…
The paper is devoted to discretization of integral norms of functions from a given finite dimensional subspace. Even though this problem is extremely important in applications, its systematic study has begun recently. In this paper we…
Systems with a long-term stationary state that possess as a spatio-temporally fluctuation quantity $\beta$ can be described by a superposition of several statistics, a "super statistics". We consider first, the Gamma, log-normal and…
In this paper, we present new estimates for the entropy dissipation of the Landau-Fermi-Dirac equation (with hard or moderately soft potentials) in terms of a weighted relative Fisher information adapted to this equation. Such estimates are…
A new characterization of the exponential type Orlicz spaces generated by the functions $\exp(|x|^p)-1$ ($p\ge 1$) is given. We define norms for centered random variables belonging to these spaces. We show equivalence of these norms with…
We offer the first operational interpretation of the $\alpha$-z relative entropies, a measure of distinguishability between two quantum states introduced by Jak\v{s}i\'c et al. and Audenaert and Datta. We show that these relative entropies…
It is well known that, for chaotic systems, the production of relevant entropy (Boltzmann-Gibbs) is always linear and the system has strong (exponential) sensitivity to initial conditions. In recent years, various numerical results indicate…
We prove a stochastic formula for the Gaussian relative entropy in the spirit of Borell's formula for the Laplace transform. As an application, we give unified and short proofs of a number of functional inequalities.
In this paper, we introduce a new distribution generated by Lindley random variable which offers a more flexible model for modelling lifetime data. Various statistical properties like distribution function, survival function, moments,…
In the present paper, we study the analyticity of the leftmost eigenvalue of the linear elliptic partial differential operator with random coefficient and analyze the convergence rate of the quasi-Monte Carlo method for approximation of the…
In this paper, we derive a new generalisation of the strong subadditivity of the entropy to the setting of general conditional expectations onto arbitrary finite-dimensional von Neumann algebras. The latter inequality, which we call…
One of the most common anticipated difficulties in applying mainstream maximum likelihood inference upon extreme values is articulated on the scarcity of extreme observations for bringing the extreme value theorem to hold across a series of…
The extremization of an appropriate entropic functional may yield to the probability distribution functions maximizing the respective entropic structure. This procedure is known in Statistical Mechanics and Information Theory as Jaynes'…
We introduce a new generalization of the Pseudo-Lindley distribution by applying alpha power transformation. The obtained distribution is referred as the Pseudo-Lindley alpha power transformed distribution (\textit{PL-APT}). Some tractable…