English
Related papers

Related papers: f-divergence estimation and two-sample homogeneity…

200 papers

This paper considers the two-dataset problem, where data are collected from two potentially different populations sharing common aspects. This problem arises when data are collected by two different types of researchers or from two…

Methodology · Statistics 2022-09-27 Steven N. MacEachern , Koji Miyawaki

Estimation of the $\phi$-divergence between two unknown probability distributions using empirical data is a fundamental problem in information theory and statistical learning. We consider a multi-variate generalization of the data dependent…

Probability · Mathematics 2018-01-04 Fengqiao Luo , Sanjay Mehrotra

The statistics and machine learning communities have recently seen a growing interest in classification-based approaches to two-sample testing. The outcome of a classification-based two-sample test remains a rejection decision, which is not…

Statistics Theory · Mathematics 2022-11-15 Loris Michel , Jeffrey Näf , Nicolai Meinshausen

Kernel density estimation is a popular method for estimating unseen probability distributions. However, the convergence of these classical estimators to the true density slows down in high dimensions. Moreover, they do not define meaningful…

Statistics Theory · Mathematics 2025-05-30 Jack Kendrick

We show that the variational representations for f-divergences currently used in the literature can be tightened. This has implications to a number of methods recently proposed based on this representation. As an example application we use…

Machine Learning · Computer Science 2012-06-22 Avraham Ruderman , Mark Reid , Dario Garcia-Garcia , James Petterson

A number of biomedical problems require performing many hypothesis tests, with an attendant need to apply stringent thresholds. Often the data take the form of a series of predictor vectors, each of which must be compared with a single…

Methodology · Statistics 2014-05-13 Yi-Hui Zhou , Fred Wright

Hypothesis testing is a statistical inference approach used to determine whether data supports a specific hypothesis. An important type is the two-sample test, which evaluates whether two sets of data points are from identical…

Machine Learning · Computer Science 2025-01-08 Weizhi Li , Visar Berisha , Gautam Dasarathy

The log-normal distribution is one of the most common distributions used for modeling skewed and positive data. It frequently arises in many disciplines of science, specially in the biological and medical sciences. The statistical analysis…

Methodology · Statistics 2020-01-01 Ayanendranath Basu , Abhijit Mandal , Nirian Martin , Leandro Pardo

Binary density ratio estimation (DRE), the problem of estimating the ratio $p_1/p_2$ given their empirical samples, provides the foundation for many state-of-the-art machine learning algorithms such as contrastive representation learning…

Machine Learning · Computer Science 2021-12-08 Lantao Yu , Yujia Jin , Stefano Ermon

We introduce two novel non-parametric statistical hypothesis tests. The first test, called the relative test of dependency, enables us to determine whether one source variable is significantly more dependent on a first target variable or a…

Artificial Intelligence · Computer Science 2016-11-18 Wacha Bounliphone , Eugene Belilovsky , Arthur Tenenhaus , Ioannis Antonoglou , Arthur Gretton , Matthew B. Blashcko

Some large scale inference problems are considered based on using the relative belief ratio as a measure of statistical evidence. This approach is applied to the multiple testing problem. A particular application of this is concerned with…

Statistics Theory · Mathematics 2016-09-22 Michael Evans , Jabed Tomal

Consider the semiparametric transformation model $\Lambda_{\theta_o}(Y)=m(X)+\epsilon$, where $\theta_o$ is an unknown finite dimensional parameter, the functions $\Lambda_{\theta_o}$ and $m$ are smooth, $\epsilon$ is independent of $X$,…

Statistics Theory · Mathematics 2011-10-11 Rawane Samb , Cédric Heuchenne , Ingrid Van Keilegom

Classical two-sample permutation tests for equality of distributions have exact size in finite samples, but they fail to control size for testing equality of parameters that summarize each distribution. This paper proposes permutation tests…

Econometrics · Economics 2022-04-22 Marinho Bertanha , EunYi Chung

Two-sample inference for the difference of population means typically relies upon a Central Limit Theorem approximation. When data are drawn from a Negative Binomial distribution, previous work of Shilane et al. (2010) showed that a Normal…

Methodology · Statistics 2012-03-06 David Shilane , Derek Bean

Estimating the ratio of two probability densities from a finite number of observations is a central machine learning problem. A common approach is to construct estimators using binary classifiers that distinguish observations from the two…

Machine Learning · Computer Science 2025-01-28 Werner Zellinger

Density ratio estimation serves as an important technique in the unsupervised machine learning toolbox. However, such ratios are difficult to estimate for complex, high-dimensional data, particularly when the densities of interest are…

Machine Learning · Computer Science 2021-07-07 Kristy Choi , Madeline Liao , Stefano Ermon

In this paper, we study the Bernstein polynomial model for estimating the multivariate distribution functions and densities with bounded support. As a mixture model of multivariate beta distributions, the maximum (approximate) likelihood…

Methodology · Statistics 2019-01-23 Tao Wang , Zhong Guan

Nonparametric tests for equality of multivariate distributions are frequently desired in research. It is commonly required that test-procedures based on relatively small samples of vectors accurately control the corresponding Type I Error…

Methodology · Statistics 2021-01-14 Ablert Vexler , Gregory Gurevich , Li Zou

In the classical two-sample problem, the conventional approach for testing distributions equality is based on the difference between the two marginal empirical distribution functions, whereas a test for independence is based on the contrast…

Statistics Theory · Mathematics 2018-06-14 Laura Dumitrescu , Estate V. Khmaladze

One of the classic concerns in statistics is determining if two samples come from thesame population, i.e. homogeneity testing. In this paper, we propose a homogeneitytest in the context of Functional Data Analysis, adopting an idea from…

Applications · Statistics 2021-10-22 Alejandro Calle-Saldarriaga , Henry Laniado , Francisco Zuluaga