English
Related papers

Related papers: From Data to Probability Densities without Histogr…

200 papers

The task of calibration is to retrospectively adjust the outputs from a machine learning model to provide better probability estimates on the target variable. While calibration has been investigated thoroughly in classification, it has not…

Machine Learning · Statistics 2018-06-21 Hao Song , Meelis Kull , Peter Flach

We investigate the problem of testing the equivalence between two discrete histograms. A {\em $k$-histogram} over $[n]$ is a probability distribution that is piecewise constant over some set of $k$ intervals over $[n]$. Histograms have been…

Data Structures and Algorithms · Computer Science 2017-03-07 Ilias Diakonikolas , Daniel M. Kane , Vladimir Nikishkin

We propose a frequentist testing procedure that maintains a defined coverage and is optimal in the sense that it gives maximal power to detect deviations from a null hypothesis when the alternative to the null hypothesis is sampled from a…

Applications · Statistics 2020-07-07 Christian Bartels , Johanna Mielke , Ekkehard Glimm

We propose the so-called jackknife empirical likelihood approach for the survey data of general unequal probability sampling designs, and analyze parameters defined according to U-statistics. We prove theoretically that jackknife…

Methodology · Statistics 2023-03-28 Mengdong Shang , Xia Chen

We consider a nonparametric Bayesian approach to estimation and testing for a multivariate monotone density. Instead of following the conventional Bayesian route of putting a prior distribution complying with the monotonicity restriction,…

Statistics Theory · Mathematics 2023-06-09 Kang Wang , Subhashis Ghosal

Density regression characterizes the conditional density of the response variable given the covariates, and provides much more information than the commonly used conditional mean or quantile regression. However, it is often computationally…

Methodology · Statistics 2022-06-15 Yunlu Chen , Nan Zhang

Low-contrast image enhancement is essential for high-quality image display and other visual applications. However, it is a challenging task as the enhancement is expected to increase the visibility of an image while maintaining its…

Image and Video Processing · Electrical Eng. & Systems 2021-11-24 Thaweesak Trongtirakul , Sos Agaian

A collaborative distributed binary decision problem is considered. Two statisticians are required to declare the correct probability measure of two jointly distributed memoryless process, denoted by $X^n=(X_1,\dots,X_n)$ and…

Information Theory · Computer Science 2016-04-11 Gil Katz , Pablo Piantanida , Merouane Debbah

This article proposes a way to improve the presentation of histograms where data are compared to expectation. Sometimes, it is difficult to judge by eye whether the difference between the bin content and the theoretical expectation…

Data Analysis, Statistics and Probability · Physics 2018-02-21 Georgios Choudalakis , Diego Casadei

We explain how effective automatic probability density function estimates can be constructed using contemporary Bayesian inference engines such as those based on no-U-turn sampling and expectation propagation. Extensive simulation studies…

Machine Learning · Statistics 2021-09-28 M. P. Wand , J. C. F. Yu

So far, various techniques have been implemented for generating discrete distributions based on continuous distributions. The characteristics and properties of this kind of probability distributions have been studied. Furthermore, the…

Computation · Statistics 2016-02-05 Halaleh Kamari , Hossein Bevrani , Kaniav Kamary

The happy function $H: \mathbb{N} \rightarrow \mathbb{N}$ sends a positive integer to the sum of the squares of its digits. A number $x$ is said to be happy if the sequence $\{H^n(x)\}^\infty_{n=1}$ eventually reaches one. A basic open…

Number Theory · Mathematics 2015-03-03 Justin Gilmer

When inferring unknown parameters or comparing different models, data must be compared to underlying theory. Even if a model has no closed-form solution to derive summary statistics, it is often still possible to simulate mock data in order…

Cosmology and Nongalactic Astrophysics · Physics 2019-12-20 Niall Jeffrey , Filipe B. Abdalla

Histograms with weighted entries are used to estimate probability density functions. Computer simulation is the main application of this type of histograms. A review on chi-square tests for comparing weighted histograms is presented in this…

Data Analysis, Statistics and Probability · Physics 2017-04-27 Nikolai Gagunashvili

Finite population inference is a central goal in survey sampling. Probability sampling is the main statistical approach to finite population inference. Challenges arise due to high cost and increasing non-response rates. Data integration…

Methodology · Statistics 2020-01-13 Shu Yang , Jae Kwang Kim

We propose a new method of histogram construction, providing a fully Bayesian approach to irregular histograms. Our procedure applies Bayesian model selection to a piecewise constant model of the underlying distribution, resulting in a…

Methodology · Statistics 2026-03-13 Oskar Høgberg Simensen , Dennis Christensen , Nils Lid Hjort

This paper develops a conformal method to compute prediction intervals for non-parametric regression that can automatically adapt to skewed data. Leveraging black-box machine learning algorithms to estimate the conditional distribution of…

Methodology · Statistics 2021-10-26 Matteo Sesia , Yaniv Romano

Distinguishing between uniform and non-uniform sample distributions is a common problem in directional data analysis; however for many tests, non-uniform distributions exist that fail uniformity rejection. By merging directional statistics…

Applications · Statistics 2011-08-11 Martin Ehler , Jennifer Galanis

The cumulative distribution and quantile functions for the one-sided one sample Kolmogorov-Smirnov probability distributions are used for goodness-of-fit testing. While the Smirnov-Birnbaum-Tingey formula for the CDF appears straight…

Computation · Statistics 2018-02-21 Paul van Mulbregt

The concept of biased data is well known and its practical applications range from social sciences and biology to economics and quality control. These observations arise when a sampling procedure chooses an observation with probability that…

Statistics Theory · Mathematics 2007-06-13 Sam Efromovich