Related papers: Entropy and the Combinatorial Dimension

The Vapnik-Chervonenkis dimension of a set K in R^n is the maximal dimension of the coordinate cube of a given size, which can be found in coordinate projections of K. We show that the VC dimension of a convex body governs its entropy. This…

We show that a simple geometric result suffices to derive the form of the optimal solution in a large class of finite and infinite-dimensional maximum entropy problems concerning probability distributions, spectral densities and covariance…

We find a sharp combinatorial bound for the metric entropy of sets in R^n and general classes of functions. This solves two basic combinatorial conjectures on the empirical processes. 1. A class of functions satisfies the uniform Central…

Let $\Omega$ be a bounded closed convex set in ${\mathbb R}^d$ with non-empty interior, and let ${\cal C}_r(\Omega)$ be the class of convex functions on $\Omega$ with $L^r$-norm bounded by $1$. We obtain sharp estimates of the…

We define the topological entropy per unit volume in parabolic PDE's such as the complex Ginzburg-Landau equation, and show that it exists, and is bounded by the upper Hausdorff dimension times the maximal expansion rate. We then give a…

We consider the well-known max-(relative) entropy problem $\Theta$(y) = infQ$\ll$P DKL(Q P ) with Kullback-Leibler divergence on a domain $\Omega$ $\subset$ R d , and with ''moment'' constraints h dQ = y, y $\in$ R m . We show that when m…

It is shown that the volume entropy of a Hilbert geometry associated to an $n$-dimensional convex body of class $C^{1,1}$ equals $n-1$. To achieve this result, a new projective invariant of convex bodies, similar to the centro-affine area,…

The approximability of a convex body is a number which measures the difficulty to approximate that body by polytopes. We prove that twice the approximability is equal to the volume entropy for a Hilbert geometry in dimension two end three…

We prove an estimation of the Kolmogorov $\epsilon$-entropy in H of the unitary ball in the space V, where H is a Hilbert space and V is a Sobolev-like subspace of H. Then, by means of Zelik's result [5], an estimate of the fractal…

In the presence of vacuum, the physical entropy for polytropic gases behaves singularly and it is thus a challenge to study its dynamics. It is shown in this paper that the boundedness of the entropy can be propagated up to any finite time…

We evaluate the shattering dimension of various classes of linear functionals on various symmetric convex sets. The proofs here relay mostly on methods from the local theory of normed spaces and include volume estimates, factorization…

The mathematical analysis on the behavior of the entropy for viscous, compressible, and heat conducting magnetohydrodynamic flows near the vacuum region is a challenging problem as the governing equation for entropy is highly degenerate and…

The notion of entropy appears in many fields and this paper is a survey about entropies in several branches of Mathematics. We are mainly concerned with the topological and the algebraic entropy in the context of continuous endomorphisms of…

The inequality of Vapnik and Chervonenkis controls the expectation of the function by its sample average uniformly over a VC-major class of functions taking into account the size of the expectation. Using Talagrand's kernel method we prove…

We prove a proposition that the entropy of the system composed of finite $N$ molecules of ideal gas is the $q$-entropy or Havrda-Charv\'at-Tsallis entropy, which is also known as Tsallis entropy, with the entropic index…

We determine the explicit universal form of the entanglement and Renyi entropies, for regions with arbitrary boundary on a null plane or the light-cone. All the entropies are shown to saturate the strong subadditive inequality. This Renyi…

To calculate the entropy of a subalgebra or of a channel with respect to a state, one has to solve an intriguing optimalization problem. The latter is also the key part in the entanglement of formation concept, in which case the subalgebra…

The Shannon entropy, the desequilibrium and their generalizations (R\'enyi and Tsallis entropies) of the three-dimensional single-particle systems in a spherically-symmetric potential $V(r)$ can be decomposed into angular and radial parts.…

In this note we evaluate c-Entropy of perturbed L-systems introduced in [5]. Explicit formulas relating the c-Entropy of the L-systems and the perturbation parameter are established. We also show that c-Entropy attains its maximum value…

We establish the boundedness of solutions of reaction-diffusion systems with quadratic (in fact slightly super-quadratic) reaction terms that satisfy a natural entropy dissipation property, in any space dimension N>2. This bound imply the…