Related papers: Divergence and Deformed Exponential Family
Selecting an appropriate divergence measure is a critical aspect of machine learning, as it directly impacts model performance. Among the most widely used, we find the Kullback-Leibler (KL) divergence, originally introduced in kinetic…
Given $s \ge k\ge 3$, let $h^{(k)}(s)$ be the minimum $t$ such that there exist arbitrarily large $k$-uniform hypergraphs $H$ whose independence number is at most polylogarithmic in the number of vertices and in which every $s$ vertices…
A well-known technique in estimating probabilities of rare events in general and in information theory in particular (used, e.g., in the sphere-packing bound), is that of finding a reference probability measure under which the event of…
We study concentration inequalities for the Kullback--Leibler (KL) divergence between the empirical distribution and the true distribution. Applying a recursion technique, we improve over the method of types bound uniformly in all regimes…
Information-theoretic measures such as the entropy, cross-entropy and the Kullback-Leibler divergence between two mixture models is a core primitive in many signal processing tasks. Since the Kullback-Leibler divergence of mixtures provably…
We derive a closed form solution for the Kullback-Leibler divergence between two Weibull distributions. These notes are meant as reference material and intended to provide a guided tour towards a result that is often mentioned but seldom…
In statistical classification/multiple hypothesis testing and machine learning, a model distribution estimated from the training data is usually applied to replace the unknown true distribution in the Bayes decision rule, which introduces a…
We establish a correspondence between information geometry and gauge theory. First, we define an important class of statistical manifolds, that is normalized and satisfies a conservation field equation. Second, we prove that for a…
In this paper we provide the asymptotic theory of the general of $\phi$-divergences measures, which includes the most common divergence measures : Renyi and Tsallis families and the Kullback-Leibler measure. Instead of using the Parzen…
For a compact complex manifold, we introduce holomorphic foliations associated with certain abelian subgroups of the automorphism group. Such foliations are generalizations of holomorphic principal torus bundles. If there exists a…
Using periodic-orbit theory beyond the diagonal approximation we investigate the form factor, $K(\tau)$, of a generic quantum graph with mixing classical dynamics and time-reversal symmetry. We calculate the contribution from pairs of…
Ideas from deformation quantization are applied to deform the expression of elements of an algebra. Extending these ideas to certain transcendental elements implies that $\frac{1}{i\h}uv$ in the Weyl algebra is naturally viewed as an…
We shall develop a new deformation theory of geometric structures in terms of closed differential forms. This theory is a generalization of Kodaira -Spencer theory and further we obtain a criterion of unobstructed deformations. We apply…
Consider the family of power divergence statistics based on $n$ trials, each leading to one of $r$ possible outcomes. This includes the log-likelihood ratio and Pearson's statistic as important special cases. It is known that in certain…
Let $X$ be a smooth irreducible complex algebraic variety of dimension $n$ and $L$ a very ample line bundle on $X$. Given a toric degeneration of $(X,L)$ satisfying some natural technical hypotheses, we construct a deformation $\{J_s\}$ of…
We initiate the study of quadratic discrepancy for finite point sets on the Heisenberg group $\mathbb H^n$ with respect to upper Ahlfors regular probability measures. For a natural family of test sets given by left translations and…
We obtain sufficient conditions ensuring the topological equivalence of two perturbed difference linear systems whose linear part has a property of generalized exponential dichotomy. When the exponential dichotomy is verified, we obtain a…
The correlated probabilistic model introduced and analytically discussed in Hanel et al (2009) is based on a self-dual transformation of the index $q$ which characterizes a current generalization of Boltzmann-Gibbs statistical mechanics,…
The aim of this work is to lay the foundations of differential geometry and Lie theory over the general class of topological base fields and -rings for which a differential calculus has been developed in recent work (collaboration with H.…
We show that for any $k\in\omega$, the structure $(H_k,\in)$ of sets that are hereditarily of size at most $k$ is decidable. We provide a transparent complete axiomatization of its theory, a quantifier elimination result, and tight bounds…