English
Related papers

Related papers: Optimal Data-Based Binning for Histograms

200 papers

Let $\mathfrak{C}$ be a class of probability distributions over the discrete domain $[n] = \{1,...,n\}.$ We show that if $\mathfrak{C}$ satisfies a rather general condition -- essentially, that each distribution in $\mathfrak{C}$ can be…

Machine Learning · Computer Science 2012-10-03 Siu-on Chan , Ilias Diakonikolas , Rocco A. Servedio , Xiaorui Sun

We formulate an optimization problem to estimate probability densities in the context of multidimensional problems that are sampled with uneven probability. It considers detector sensitivity as an heterogeneous density and takes advantage…

Machine Learning · Computer Science 2025-06-04 Aleix Boquet-Pujadas , Pol del Aguila Pla , Michael Unser

How might a smooth probability distribution be estimated, with accurately quantified uncertainty, from a limited amount of sampled data? Here we describe a field-theoretic approach that addresses this problem remarkably well in one…

Data Analysis, Statistics and Probability · Physics 2018-10-24 Wei-Chia Chen , Ammar Tareen , Justin B. Kinney

Efficient and accurate estimation of multivariate empirical probability distributions is fundamental to the calculation of information-theoretic measures such as mutual information and transfer entropy. Common techniques include variations…

Information Theory · Computer Science 2023-03-23 Z. Keskin

Optimum parameter estimation methods require knowledge of a parametric probability density that statistically describes the available observations. In this work we examine Bayesian and non-Bayesian parameter estimation problems under a…

Applications · Statistics 2022-02-01 George V. Moustakides

The relevance and impact of probability distributions on image processing are the subject of this study.It may be characterized as a probability distribution function of brightness for a certain area, which might be a whole picture. To…

Image and Video Processing · Electrical Eng. & Systems 2021-08-31 Irem Doken , Melih Gokdemir , W. T Al-Shaibani , Ibraheem Shayea

We consider the problem of estimating the number of clusters (k) in a dataset. We propose a non-parametric approach to the problem that utilizes similarity graphs to construct a robust statistic that effectively captures similarity…

Methodology · Statistics 2025-06-13 Yichuan Bai , Lynna Chu

Binned scatter plots are a powerful statistical tool for empirical work in the social, behavioral, and biomedical sciences. Available methods rely on a quantile-based partitioning estimator of the conditional mean regression function to…

Methodology · Statistics 2024-07-23 Matias D. Cattaneo , Richard K. Crump , Max H. Farrell , Yingjie Feng

We consider an approach for testing the hypothesis that two realizations of the random variables in the form of histograms are taken from the same statistical population (i.e. two histograms are drawn from the same distribution). The…

Data Analysis, Statistics and Probability · Physics 2013-11-26 S. Bityukov , N. Krasnikov , A. Nikitenko , V. Smirnova

This paper presents a graph bundling algorithm that agglomerates edges taking into account both spatial proximity as well as user-defined criteria in order to reveal patterns that were not perceivable with previous bundling techniques. Each…

Graphics · Computer Science 2015-04-13 Daniel C. Moura

Survival analysis is a widely-used technique for analyzing time-to-event data in the presence of censoring. In recent years, numerous survival analysis methods have emerged which scale to large datasets and relax traditional assumptions…

Machine Learning · Computer Science 2023-11-06 Mert Ketenci , Shreyas Bhave , Noémie Elhadad , Adler Perotte

We study the Lp-integrated risk of some classical estimators of the density, when the observations are drawn from a strictly stationary sequence. The results apply to a large class of sequences, which can be non-mixing in the sense of…

Statistics Theory · Mathematics 2016-05-18 Jérôme Dedecker , Florence Merlevède

How to extract useful insights from data is always a challenge, especially if the data is multidimensional. Often, the data can be organized according to certain hierarchical structure that are stemmed either from data collection process or…

Applications · Statistics 2016-04-21 Kun Yang , Wing Hung Wong

Bin Packing problems have been widely studied because of their broad applications in different domains. Known as a set of NP-hard problems, they have different vari- ations and many heuristics have been proposed for obtaining approximate…

Machine Learning · Computer Science 2017-02-16 Feng Mao , Edgar Blanco , Mingang Fu , Rohit Jain , Anurag Gupta , Sebastien Mancel , Rong Yuan , Stephen Guo , Sai Kumar , Yayang Tian

Dealing with visualizations containing large data set is a challenging issue and, in the field of Information Visualization, almost every visual technique reveals its drawback when visualizing large number of items. To deal with this…

Graphics · Computer Science 2017-01-26 Enrico Bertini , Giuseppe Santucci

Weighted histograms in Monte Carlo simulations are often used for the estimation of probability density functions. They are obtained as a result of random experiments with random events that have weights. In this paper, the bin contents of…

Data Analysis, Statistics and Probability · Physics 2010-03-02 N. D. Gagunashvili

Many statistical models in cosmology can be simulated forwards but have intractable likelihood functions. Likelihood-free inference methods allow us to perform Bayesian inference from these models using only forward simulations, free from…

Cosmology and Nongalactic Astrophysics · Physics 2018-04-11 Justin Alsing , Benjamin Wandelt , Stephen Feeney

Clustering of large-scale structure provides significant cosmological information through the power spectrum of density perturbations. Additional information can be gained from higher-order statistics like the bispectrum, especially to…

Cosmology and Nongalactic Astrophysics · Physics 2015-03-09 Marcel Schmittfull , Tobias Baldauf , Uroš Seljak

Maximum likelihood fits to data can be performed using binned data and unbinned data. The likelihood fits in either case produce only the fitted quantities but not the goodness of fit. With binned data, one can obtain a measure of the…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Rajendran Raja

We consider the estimation of densities in multiple subpopulations, where the available sample size in each subpopulation greatly varies. This problem occurs in epidemiology, for example, where different diseases may share similar…

Methodology · Statistics 2021-09-15 Jiaming Qiu , Xiongtao Dai , Zhengyuan Zhu