English
Related papers

Related papers: Numerical estimation of densities

200 papers

It is now practically the norm for data to be very high dimensional in areas such as genetics, machine vision, image analysis and many others. When analyzing such data, parametric models are often too inflexible while nonparametric…

Methodology · Statistics 2011-05-31 Abhishek Bhattacharya , Garritt Page , David Dunson

We present sparse tree-based and list-based density estimation methods for binary/categorical data. Our density estimation models are higher dimensional analogies to variable bin width histograms. In each leaf of the tree (or list), the…

Machine Learning · Statistics 2023-11-16 Siong Thye Goh , Lesia Semenova , Cynthia Rudin

This paper aims to build an estimate of an unknown density of the data with measurement error as a linear combination of functions from a dictionary. Inspired by the penalization approach, we propose the weighted Elastic-net penalized…

Statistics Theory · Mathematics 2020-07-07 Xiaowei Yang , Huiming Zhang , Haoyu Wei , Shouzheng Zhang

Calculating one-body density profiles in equilibrium via particle-based simulation methods involves counting of events of particle occurrences at (histogram-resolved) space points. Here we investigate an alternative method based on a…

Soft Condensed Matter · Physics 2018-11-07 Daniel de las Heras , Matthias Schmidt

Normalizing Flows (NFs) are universal density estimators based on Neural Networks. However, this universality is limited: the density's support needs to be diffeomorphic to a Euclidean space. In this paper, we propose a novel method to…

Machine Learning · Computer Science 2022-02-02 Christian Horvat , Jean-Pascal Pfister

By a mixture density is meant a density of the form $\pi_{\mu}(\cdot)=\int\pi_{\theta}(\cdot)\times\mu(d\theta)$, where $(\pi_{\theta})_{\theta\in\Theta}$ is a family of probability densities and $\mu$ is a probability measure on $\Theta$.…

Statistics Theory · Mathematics 2016-08-16 François Roueff , Tobias Rydén

We propose a novel approach for density estimation called histogram trend filtering. Our estimator arises from looking at surrogate Poisson model for counts of observations in a partition of the support of the data. We begin by showing…

Methodology · Statistics 2016-02-09 Oscar Hernan Madrid Padilla , James G. Scott

Kernel density estimation is a popular method for estimating unseen probability distributions. However, the convergence of these classical estimators to the true density slows down in high dimensions. Moreover, they do not define meaningful…

Statistics Theory · Mathematics 2025-05-30 Jack Kendrick

In this paper, we present a generic methodology for the efficient numerical approximation of the density function of the McKean-Vlasov SDEs. The weak error analysis for the projected process motivates us to combine the iterative Multilevel…

Numerical Analysis · Mathematics 2019-09-27 Denis Belomestny , Lukasz Szpruch , Shuren Tan

We investigate density estimation from a $n$-sample in the Euclidean space $\mathbb R^D$, when the data is supported by an unknown submanifold $M$ of possibly unknown dimension $d < D$ under a reach condition. We study nonparametric kernel…

Statistics Theory · Mathematics 2020-11-02 Clément Berenfeld , Marc Hoffmann

The estimation of a density profile from experimental data points is a challenging problem, usually tackled by plotting a histogram. Prior assumptions on the nature of the density, from its smoothness to the specification of its form, allow…

Methodology · Statistics 2015-03-13 Alberto Bernacchia , Simone Pigolotti

How might a smooth probability distribution be estimated, with accurately quantified uncertainty, from a limited amount of sampled data? Here we describe a field-theoretic approach that addresses this problem remarkably well in one…

Data Analysis, Statistics and Probability · Physics 2018-10-24 Wei-Chia Chen , Ammar Tareen , Justin B. Kinney

In many real applications, the distribution of measurement error could vary with each subject or even with each observation so the errors are heteroscedastic. In this paper, we propose a fast algorithm using a simulation-extrapolation…

Statistics Theory · Mathematics 2009-02-13 Xiao-Feng Wang , Jiayang Sun , Zhaozhi Fan

Probability Density Estimation (PDE) is a multivariate discrimination technique based on sampling signal and background densities defined by event samples from data or Monte-Carlo (MC) simulations in a multi-dimensional phase space. In this…

Data Analysis, Statistics and Probability · Physics 2009-07-22 Dominik Dannheim , Tancredi Carli , Karl-Johan Grahn , Peter Speckmayer , Alexander Voigt

We consider the problem of estimating a spatially varying density function, motivated by problems that arise in large-scale radiological survey and anomaly detection. In this context, the density functions to be estimated are the background…

Methodology · Statistics 2017-11-17 Wesley Tansey , Alex Athey , Alex Reinhart , James G. Scott

The histogram method is a powerful non-parametric approach for estimating the probability density function of a continuous variable. But the construction of a histogram, compared to the parametric approaches, demands a large number of…

Machine Learning · Statistics 2015-12-29 Hideaki Kim , Hiroshi Sawada

Given a sample from a discretely observed compound Poisson process, we consider non-parametric estimation of the density $f_0$ of its jump sizes, as well as of its intensity $\lambda_0.$ We take a Bayesian approach to the problem and…

Statistics Theory · Mathematics 2023-02-27 Shota Gugushvili , Frank van der Meulen , Peter Spreij

We introduce a novel two-step approach for estimating a probability density function (pdf) given its samples, with the second and important step coming from a geometric formulation. The procedure involves obtaining an initial estimate of…

Methodology · Statistics 2017-12-14 Sutanoy Dasgupta , Debdeep Pati , Anuj Srivastava

The Gaussian kernel and its traditional normalizations (e.g., row-stochastic) are popular approaches for assessing similarities between data points. Yet, they can be inaccurate under high-dimensional noise, especially if the noise magnitude…

Statistics Theory · Mathematics 2023-07-12 Boris Landa , Xiuyuan Cheng

Star formation has long been known to be an inefficient process, in the sense that only a small fraction $\epsilon_{\rm ff}$ of the mass of any given gas cloud is converted to stars per cloud free-fall time. However, developing a successful…

Astrophysics of Galaxies · Physics 2021-02-17 Zipeng Hu , Mark R. Krumholz , Christoph Federrath , Riwaj Pokhrel , Robert A. Gutermuth