Related papers: Metric Entropy estimation using o-minimality Theor…
Various lower bounds are established for the entropy of sums, products and their combinations. First, we derive a prime-field analogue of a version of the entropy power inequality established by Tao over torsion-free groups. Next, we prove…
The phenomenon of entropy concentration provides strong support for the maximum entropy method, MaxEnt, for inferring a probability vector from information in the form of constraints. Here we extend this phenomenon, in a discrete setting,…
General hyperbolic systems of balance laws with inhomogeneity in space and time in all constitutive functions are studied in the context of relative entropy. A framework is developed in this setting that contributes to a measure-valued weak…
In the theory of surface diffeomorphisms relative to homoclinic and heteroclinic orbits, it is possible to compute a one-dimensional representative map for any irreducible isotopy class. The topological entropy of this graph representative…
An implicit Euler finite-volume scheme for general cross-diffusion systems with volume-filling constraints is proposed and analyzed. The diffusion matrix may be nonsymmetric and not positive semidefinite, but the diffusion system is assumed…
Chater and MacKay [CM] derived an entropy function of state for exchange economies satisfying a list of axioms, and showed that a change of state of a system of such economies is possible if and only if their total entropy does not…
Maximum entropy estimation is of broad interest for inferring properties of systems across many different disciplines. In this work, we significantly extend a technique we previously introduced for estimating the maximum entropy of a set of…
We give a numerical characterization of mutual orthogonality (that is, complementarity) for subalgebras. In order to give such a characterization for mutually orthogonal subalgebras $A$ and $B$ of the $k \times k$ matrix algebra…
We bound the number of nearly orthogonal vectors with fixed VC-dimension over $\setpm^n$. Our bounds are of interest in machine learning and empirical process theory and improve previous bounds by Haussler. The bounds are based on a simple…
The folding entropy is a quantity originally proposed by Ruelle in 1996 during the study of entropy production in the non-equilibrium statistical mechanics. As derived through a limiting process to the non-equilibrium steady state, the…
We develop a method of obtaining a hierarchy of new higher-order entropies in the context of compressible models with local and non-local diffusion and isentropic pressure. The local viscosity is allowed to degenerate as the density…
We show that a simple geometric result suffices to derive the form of the optimal solution in a large class of finite and infinite-dimensional maximum entropy problems concerning probability distributions, spectral densities and covariance…
We investigate the concept of entropy in probabilistic theories more general than quantum mechanics, with particular reference to the notion of information causality recently proposed by Pawlowski et. al. (arXiv:0905.2992). We consider two…
We seek an entropy estimator for discrete distributions with fully empirical accuracy bounds. As stated, this goal is infeasible without some prior assumptions on the distribution. We discover that a certain information moment assumption…
In this paper, we mainly elucidate a close relationship between the topological entropy and mean dimension theory for actions of polynomial growth groups. We show that metric mean dimension and mean Hausdorff dimension of subshifts with…
The theory of thermal macroeconomics (TM) analyses economic phenomena within the mathematical framework of classical thermodynamics, using a set of axioms that apply to the purely macroscopic aspects of an economy [CM]. The theory shows…
The estimation law of unknown parameters vector ${\theta}$ is proposed for one class of nonlinearly parametrized regression equations $y\left( t \right) = \Omega \left( t \right)\Theta \left( \theta \right)$. We restrict our attention to…
For a (compact) subset $K$ of a metric space and $\varepsilon > 0$, the {\em covering number} $N(K , \varepsilon )$ is defined as the smallest number of balls of radius $\varepsilon$ whose union covers $K$. Knowledge of the {\em metric…
Matrix concentration inequalities provide a direct way to bound the typical spectral norm of a random matrix. The methods for establishing these results often parallel classical arguments, such as the Laplace transform method. This work…
We prove minimal entropy rigidity for complete, finite volume manifolds locally isometric to a product of rank one symmetric spaces of dimension at least 3: the locally symmetric metric uniquely minimizes (normalized) entropy among all…