Related papers: Regularity Estimates for Singular Density Dependen…
We calculate the limiting behavior of relative Renyi entropy when the first probability distribution is close to the second one in a non-regular location-shift family which is generated by a probability distribution whose support is an…
Shannon and Renyi entropies are quantitative measures of uncertainty in a data set. They are developed by Renyi in the context of entropy theory. These measures have been studied in the case of the multivariate t-distributions. We extend…
Let $k\in (d,\infty]$ and consider the $k*$-distance $$\|\mu-\nu\|_{k*}:= \sup\Big\{|\mu(f)-\nu(f)|:\ f\in\B_b(\R^d),\ \|f\|_{\tt L^k}:=\sup_{x\in \R^d}\|1_{B(x,1)}f\|_{L^k}\le 1\Big\}$$ between probability measures on $\R^d$. The…
The classical result by It\^o on the existence of strong solutions of stochastic differential equations (SDEs) with Lipschitz coefficients can be extended to the case where the drift is only measurable and bounded. These generalizations are…
Under integrability conditions on distribution dependent coefficients, existence and uniqueness are proved for McKean-Vlasov type SDEs with non-degenerate noise. When the coefficients are Dini continuous in the space variable, gradient…
The existence and uniqueness of stationary distributions and the exponential convergence in $L^p$-Wasserstein distance are derived for distribution dependent SDEs from associated decoupled equations. To establish the exponential…
We propose a new way of defining entropy of a system, which gives a general form which may be nonextensive as Tsallis entropy, but is linearly dependent on component entropies, like Renyi entropy, which is extensive. This entropy has a…
Relative entropy is a measure of distinguishability for quantum states, and plays a central role in quantum information theory. The family of Renyi entropies generalizes to Renyi relative entropies that include as special cases most entropy…
Quantum Renyi relative entropies provide a one-parameter family of distances between density matrices, which generalizes the relative entropy and the fidelity. We study these measures for renormalization group flows in quantum field theory.…
The entropy production rate is a central quantity in non-equilibrium statistical physics, scoring how far a stochastic process is from being time-reversible. In this paper, we compute the entropy production of diffusion processes at…
We propose a relative entropy gradient sampler (REGS) for sampling from unnormalized distributions. REGS is a particle method that seeks a sequence of simple nonlinear transforms iteratively pushing the initial samples from a reference…
A class of estimators of the R\'{e}nyi and Tsallis entropies of an unknown distribution $f$ in $\mathbb{R}^m$ is presented. These estimators are based on the $k$th nearest-neighbor distances computed from a sample of $N$ i.i.d. vectors with…
By refining a recent result of Xie and Zhang, we prove the exponential ergodicity under a weighted variation norm for singular SDEs with drift containing a local integrable term and a coercive term. This result is then extended to singular…
We consider the generalized differential entropy of normalized sums of independent and identically distributed (IID) continuous random variables. We prove that the R\'{e}nyi entropy and Tsallis entropy of order $\alpha\ (\alpha>0)$ of the…
Via constructing an asymptotic coupling by reflection, in this paper we establish uniform-in-time estimates on probability distances for mean-field type SDEs, where the drift terms under consideration are dissipative merely in the long…
We find the value of constants related to constraints in characterization of some known statistical distributions and then we proceed to use the idea behind maximum entropy principle to derive generalized version of this distributions using…
We study nonparametric density estimation in non-stationary drift settings. Given a sequence of independent samples taken from a distribution that gradually changes in time, the goal is to compute the best estimate for the current…
A strengthened version of the central limit theorem for discrete random variables is established, relying only on information-theoretic tools and elementary arguments. It is shown that the relative entropy between the standardised sum of…
We establish heat-kernel bounds and regularity estimates for the transition densities of the diffusion associated with the martingale problem corresponding to the generator of a formal multidimensional Brownian SDE with singular drift. As a…
We present simple and computationally efficient nonparametric estimators of R\'enyi entropy and mutual information based on an i.i.d. sample drawn from an unknown, absolutely continuous distribution over $\R^d$. The estimators are…