English
Related papers

Related papers: f-divergence estimation and two-sample homogeneity…

200 papers

The ratio of two probability densities, called a density-ratio, is a vital quantity in machine learning. In particular, a relative density-ratio, which is a bounded extension of the density-ratio, has received much attention due to its…

Machine Learning · Statistics 2021-07-05 Atsutoshi Kumagai , Tomoharu Iwata , Yasuhiro Fujiwara

Density ratio estimation (DRE) is a fundamental machine learning technique for comparing two probability distributions. However, existing methods struggle in high-dimensional settings, as it is difficult to accurately compare probability…

Machine Learning · Computer Science 2022-03-15 Kristy Choi , Chenlin Meng , Yang Song , Stefano Ermon

The fitness coefficient, introduced in this paper, results from a competition between parametric and nonparametric density estimators within the likelihood of the data. As illustrated on several real datasets, the fitness coefficient…

Statistics Theory · Mathematics 2018-06-18 Gildas Mazo , François Portier

We propose a direct estimation method for R\'{e}nyi and f-divergence measures based on a new graph theoretical interpretation. Suppose that we are given two sample sets $X$ and $Y$, respectively with $N$ and $M$ samples, where $\eta:=M/N$…

Information Theory · Computer Science 2017-11-22 Morteza Noshad , Kevin R. Moon , Salimeh Yasaei Sekeh , Alfred O. Hero

The authors consider the problem of estimating the density $g$ of independent and identically distributed variables $X\_i$, from a sample $Z\_1, ..., Z\_n$ where $Z\_i=X\_i+\sigma\epsilon\_i$, $i=1, ..., n$, $\epsilon$ is a noise…

Statistics Theory · Mathematics 2008-02-11 Fabienne Comte , Yves Rozenholc , Marie-Luce Taupin

Statistical depth, which measures the center-outward rank of a given sample with respect to its underlying distribution, has become a popular and powerful tool in nonparametric inference. In this paper, we investigate the use of statistical…

Methodology · Statistics 2025-11-25 Chifeng Shen , Yuejiao Fu , Michael Chen , Xiaoping Shi

The problem of estimating a proportion of objects with particular attribute in a finite population is considered. This paper shows an example of the application of estimation fraction using new proposed sample allocation in a population…

Applications · Statistics 2019-03-19 Dominik Sieradzki , Wojciech Zieliński

The paper concerns a new statistical method for assessing dissimilarity of two random sets based on one realisation of each of them. The method focuses on shapes of the components of the random sets, namely on the curvature of their…

The density ratio is an important metric for evaluating the relative likelihood of two probability distributions, with extensive applications in statistics and machine learning. However, existing estimation theories for density ratios often…

Machine Learning · Statistics 2025-04-03 Shuntuo Xu , Zhou Yu , Jian Huang

We propose nonparametric estimation of divergence measures between continuous distributions. Our approach is based on a plug-in kernel- type estimators of density functions. We give the uniform in bandwidth consistency for the proposal…

Methodology · Statistics 2014-06-24 Papa Ngom , Hamza Dhaker , Pierre Mendy , El Hadji Deme

Given $iid$ observations from an unknown absolute continuous distribution defined on some domain $\Omega$, we propose a nonparametric method to learn a piecewise constant function to approximate the underlying probability density function.…

Machine Learning · Statistics 2018-03-13 Dangna Li , Kun Yang , Wing Hung Wong

In this article we study the problem of quantifying the uncertainty in an experiment with a technical system. We propose new density estimates which combine observed data of the technical system and simulated data from an (imperfect)…

Statistics Theory · Mathematics 2020-12-21 Sebastian Kersting , Michael Kohler

Two-sample hypothesis testing for large graphs is popular in cognitive science, probabilistic machine learning and artificial intelligence. While numerous methods have been proposed in the literature to address this problem, less attention…

Methodology · Statistics 2024-02-20 Xin Jin , Kit Chan , Ian Barnett , Riddhi Pratim Ghosh

We consider the problem of estimating the population probability distribution given a finite set of multivariate samples, using the maximum entropy approach. In strict keeping with Jaynes' original definition, our precise formulation of the…

Data Analysis, Statistics and Probability · Physics 2007-07-13 Sabbir Rahman , Mahbub Majumdar

Consider the nonparametric regression model Y=m(X)+E, where the function m is smooth but unknown, and E is independent of X. An estimator of the density of the error term E is proposed and its weak consistency is obtained. The contribution…

Statistics Theory · Mathematics 2011-12-25 Rawane Samb

A key challenge in building effective regression models for large and diverse populations is accounting for patient heterogeneity. An example of such heterogeneity is in health system risk modeling efforts where different combinations of…

Methodology · Statistics 2022-12-26 Jared D. Huling , Menggang Yu

In this paper we refine the procedure proposed by Lin et al. (2015) to estimate the density at a given quantile based on a resampling method. The approach consists on generating multiple samples of the zero-mean Gaussian variable from which…

Applications · Statistics 2025-09-04 Beatriz Farah , Aurélien Latouche , Olivier Bouaziz

We review approaches to statistical inference based on randomization. Permutation tests are treated as an important special case. Under a certain group invariance property, referred to as the ``randomization hypothesis,'' randomization…

Econometrics · Economics 2025-02-05 David M. Ritzwoller , Joseph P. Romano , Azeem M. Shaikh

Positive predictive value and negative predictive value are two widely used parameters to assess the clinical usefulness of a medical diagnostic test. When there are two diagnostic tests, it is recommendable to make a comparative assessment…

Methodology · Statistics 2024-05-29 Antonio Martín Andrés , Pedro Femia Marzo

This paper studies the binary classification of two distributions with the same Gaussian copula in high dimensions. Under this semiparametric Gaussian copula setting, we derive an accurate semiparametric estimator of the log density ratio,…

Statistics Theory · Mathematics 2014-11-12 Yue Zhao , Marten Wegkamp