English
Related papers

Related papers: Divergence Measures Estimation and Its Asymptotic …

200 papers

Recent work has focused on the problem of nonparametric estimation of information divergence functionals. Many existing approaches are restrictive in their assumptions on the density support set or require difficult calculations at the…

Information Theory · Computer Science 2021-07-30 Kevin R. Moon , Kumar Sricharan , Kristjan Greenewald , Alfred O. Hero

Data sets sampled in Lie groups are widespread, and as with multivariate data, it is important for many applications to assess the differences between the sets in terms of their distributions. Indices for this task are usually derived by…

Methodology · Statistics 2024-02-21 Martin Hanik , Hans-Christian Hege , Christoph von Tycowicz

Skewness measures can be used to measure the level of asymmetry of a distribution. Given the prevalence of statistical methods that assume underlying symmetry, and also the desire for symmetry in order to make meaningful judgements for…

Statistics Theory · Mathematics 2019-12-19 Chandima N. P. G. Arachchige , Luke A. Prendergast

When we consider canonical averages for classical discrete systems, typically referred to as substitutional alloys, the map phi from many-body interatomic interactions to thermodynamic equilibrium configurations generally exhibits…

Statistical Mechanics · Physics 2026-05-12 Koretaka Yuge

We propose a direct estimation method for R\'{e}nyi and f-divergence measures based on a new graph theoretical interpretation. Suppose that we are given two sample sets $X$ and $Y$, respectively with $N$ and $M$ samples, where $\eta:=M/N$…

Information Theory · Computer Science 2017-11-22 Morteza Noshad , Kevin R. Moon , Salimeh Yasaei Sekeh , Alfred O. Hero

We study the problem of nonparametric estimation of density functions with a product form on the domain $\triangle=\{( x_1, \ldots, x_d)\in \mathbb{R}^d, 0\leq x_1\leq \dots \leq x_d \leq 1\}$. Such densities appear in the random truncation…

Statistics Theory · Mathematics 2016-04-22 Cristina Butucea , Jean-François Delmas , Anne Dutfoy , Richard Fischer

Health data are often not symmetric to be adequately modeled through the usual normal distributions; most of them exhibit skewed patterns. They can indeed be modeled better through the larger family of skew-normal distributions covering…

Applications · Statistics 2019-09-24 Amarnath Nandy , Ayanendranath Basu , Abhik Ghosh

We consider kernel estimation of marginal densities and regression functions of stationary processes. It is shown that for a wide class of time series, with proper centering and scaling, the maximum deviations of kernel density and…

Statistics Theory · Mathematics 2010-10-21 Weidong Liu , Wei Biao Wu

Consider a sphere of radius root(n) in n dimensions, and consider X, a random variable uniformly distributed on its surface. Poincare's Observation states that for large n, the distribution of the first k coordinates of X is close in total…

Probability · Mathematics 2007-06-13 Oliver Johnson

The asymptotic behaviour, with respect to the large order, of the radii of starlikeness of two types of normalised Bessel functions is considered. We derive complete asymptotic expansions for the radii of starlikeness and provide recurrence…

Complex Variables · Mathematics 2020-09-30 Árpád Baricz , Gergő Nemes

It has been argued persuasively that, in order to evaluate climate models, the probability distributions of model output need to be compared to the corresponding empirical distributions of observed data. Distance measures between…

Methodology · Statistics 2013-07-17 Thordis L. Thorarinsdottir , Tilmann Gneiting , Nadine Gissibl

Complex, high-dimensional data is ubiquitous across many scientific disciplines, including machine learning, biology, and the social sciences. One of the primary methods of visualizing these datasets is with two-dimensional scatter plots…

Machine Learning · Computer Science 2025-10-13 Kiran Smelser , Kaviru Gunaratne , Jacob Miller , Stephen Kobourov

We study generalizations of Reifenberg's Theorem for measures in $\mathbb R^n$ under assumptions on the Jones' $\beta$-numbers, which appropriately measure how close the support is to being contained in a subspace. Our main results, which…

Classical Analysis and ODEs · Mathematics 2025-03-25 Nick Edelen , Aaron Naber , Daniele Valtorta

We study frequentist risk properties of predictive density estimators for mean mixtures of multivariate normal distributions, involving an unknown location parameter $\theta \in \mathbb{R}^d$, and which include multivariate skew normal…

Statistics Theory · Mathematics 2022-02-02 Pankaj Bhagwat , Eric Marchand

This paper shows that finitely additive measures occur naturally in very general Divergence Theorems. The main results are two such theorems. The first proves the existence of pure normal measures for sets of finite perime- ter, which yield…

Analysis of PDEs · Mathematics 2017-10-09 Moritz Schönherr , Friedemann Schuricht

In this paper, we study a method to sample from a target distribution $\pi$ over $\mathbb{R}^d$ having a positive density with respect to the Lebesgue measure, known up to a normalisation factor. This method is based on the Euler…

Statistics Theory · Mathematics 2016-12-20 Alain Durmus , Eric Moulines

This paper studies the change point problem for a general parametric, univariate or multivariate family of distributions. An information theoretic procedure is developed which is based on general divergence measures for testing the…

Statistics Theory · Mathematics 2014-03-26 Apostolos Batsidis , Nirian Martín , Leandro Pardo , Konstantinos Zografos

Regularized kernel methods such as, e.g., support vector machines and least-squares support vector regression constitute an important class of standard learning algorithms in machine learning. Theoretical investigations concerning…

Machine Learning · Statistics 2012-03-21 Robert Hable

In an earlier study, we showed that Tsallis relative entropy (TRE), which is the generalization of Kullback-Leibler relative entropy (KLRE) to non-extensive systems, can be used as a possible risk measure in constructing risk optimal…

Statistical Finance · Quantitative Finance 2022-05-30 Sandhya Devi , Sherman Page

We give a comprehensive theoretical characterization of a nonparametric estimator for the $L_2^2$ divergence between two continuous distributions. We first bound the rate of convergence of our estimator, showing that it is…

Machine Learning · Statistics 2014-10-31 Akshay Krishnamurthy , Kirthevasan Kandasamy , Barnabas Poczos , Larry Wasserman