Related papers: Using Relative Entropy to Find Optimal Approximati…
Optimal transportation distances are valuable for comparing and analyzing probability distributions, but larger-scale computational techniques for the theoretically favorable quadratic case are limited to smooth domains or regularized…
It is supposed that the exponential multiplier in the method of the non-equilibrium statistical operator (Zubarev`s approach) can be considered as a distribution density of the past lifetime of the system, and can be replaced by an…
When constructing models of the world, we aim for optimal compressions: models that include as few details as possible while remaining as accurate as possible. But which details -- or features measured in data -- should we choose to include…
Recommendations based on behavioral data may be faced with ambiguous statistical evidence. We consider the case of association rules, relevant e.g.~for query and product recommendations. For example: Suppose that a customer belongs to…
The various schemes for studying rigidly rotating perfect fluids in general relativity are reviewed. General conclusions one may draw from these are: (i) There is a need to restrict the scope of the possible ansatze, and (ii) the angular…
Given a universe of discourse X-a domain of possible outcomes-an experiment may consist of selecting one of its elements, subject to the operation of chance, or of observing the elements, subject to imprecision. A priori uncertainty about…
This paper mainly addresses the optimization of $p$-th moment of $\mathbb{R}^n$-valued random variable. Through an ingenious approximation mechanism, one transforms the maximization problem into a sequence of minimization problems, which…
This paper deals with the diffusive limit of the Jin and Xin model and its approximation by an asymptotic preserving finite volume scheme. At the continuous level, we determine a convergence rate to the diffusive limit by means of a…
In this letter we propose the use of physics techniques for entropy determination on constrained parameter optimization problems. The main feature of such techniques, the construction of an unbiased walk on energy space, suggests their use…
A novel principle is presented which allows for the proof of bounded weak solutions to a class of physically relevant, strongly coupled parabolic systems exhibiting a formal gradient-flow structure. The main feature of these systems is that…
Correlations reduce the configurational entropies of liquids below their ideal gas limits. By means of first principles molecular dynamics simulations, we obtain accurate pair correlation functions of liquid metals, then subtract the mutual…
We consider dynamical systems evolving near an equilibrium statistical state where the interest is in modelling long term behavior that is consistent with thermodynamic constraints. We adjust the distribution using an entropy-optimizing…
Using the conservation laws for charge, energy, momentum, and angular momentum, we derive hydrodynamic equations for the charge density, local temperature, and fluid velocity, as well as for the spin tensor, starting from local equilibrium…
We develop a general formalism for introducing stochastic fluctuations around thermodynamic equilibrium which takes into account, for the first time, recent developments on the causality and stability properties of relativistic hydrodynamic…
We study minimization of a parametric family of relative entropies, termed relative $\alpha$-entropies (denoted $\mathscr{I}_{\alpha}(P,Q)$). These arise as redundancies under mismatched compression when cumulants of compressed lengths are…
Consider the problem of estimating the Shannon entropy of a distribution over $k$ elements from $n$ independent samples. We show that the minimax mean-square error is within universal multiplicative constant factors of $$\Big(\frac{k }{n…
This paper derives new bounds on the difference of the entropies of two discrete random variables in terms of the local and total variation distances between their probability mass functions. The derivation of the bounds relies on maximal…
We introduce the telescopic relative entropy (TRE), which is a new regularisation of the relative entropy related to smoothing, to overcome the problem that the relative entropy between pure states is either zero or infinity and therefore…
Turbulence may appear as a complex process with a multitude of scales and flow patterns, but still obeys simple physical principles such as the conservation of momentum, of energy, and the maximum entropy principle. The latter states that…
We derive a formula for the entropy of two dimensional incompressible inviscid flow, by determining the volume of the space of vorticity distributions with fixed values for the moments Q_k= \int_w(x)^k d^2 x. This space is approximated by a…