English
Related papers

Related papers: Efficient and Robust Density Estimation Using Bern…

200 papers

Parametric density estimation, for example as Gaussian distribution, is the base of the field of statistics. Machine learning requires inexpensive estimation of much more complex densities, and the basic approach is relatively costly…

Machine Learning · Computer Science 2017-02-21 Jarek Duda

Estimating the density of a distribution from samples is a fundamental problem in statistics. In many practical settings, the Wasserstein distance is an appropriate error metric for density estimation. For example, when estimating…

Machine Learning · Computer Science 2024-07-01 Vitaly Feldman , Audra McMillan , Satchit Sivakumar , Kunal Talwar

Density estimation plays a fundamental role in many areas of statistics and machine learning. Parametric, nonparametric and semiparametric density estimation methods have been proposed in the literature. Semiparametric density models are…

Statistics Theory · Mathematics 2019-01-11 Jian Shi , Jiahui Yu , Anna Liu , Yuedong Wang

There is a rich literature on Bayesian methods for density estimation, which characterize the unknown density as a mixture of kernels. Such methods have advantages in terms of providing uncertainty quantification in estimation, while being…

Methodology · Statistics 2024-04-10 Shounak Chattopadhyay , Antik Chakraborty , David B. Dunson

A procedure based on a Mixture Density Model for correcting experimental data for distortions due to finite resolution and limited detector acceptance is presented. Addressing the case that the solution is known to be non-negative, in the…

Data Analysis, Statistics and Probability · Physics 2015-03-09 Nikolai Gagunashvili

In this paper, we propose a maximum smoothed likelihood method to estimate the component density functions of mixture models, in which the mixing proportions are known and may differ among observations. The proposed estimates maximize a…

Methodology · Statistics 2014-07-14 Tao Yu , Pengfei Li , Jing Qin

The aim of this paper is to present a new estimation procedure that can be applied in many statistical frameworks including density and regression and which leads to both robust and optimal (or nearly optimal) estimators. In density…

Statistics Theory · Mathematics 2017-01-23 Yannick Baraud , Lucien Birgé , Mathieu Sart

Flexible Bayesian models are typically constructed using limits of large parametric models with a multitude of parameters that are often uninterpretable. In this article, we offer a novel alternative by constructing an exponentially tilted…

Methodology · Statistics 2023-03-20 Abhisek Chakraborty , Anirban Bhattacharya , Debdeep Pati

The density ratio of two probability distributions is one of the fundamental tools in mathematical and computational statistics and machine learning, and it has a variety of known applications. Therefore, density ratio estimation from…

Machine Learning · Statistics 2024-06-28 Masanari Kimura , Howard Bondell

The Wasserstein distance has emerged as a key metric to quantify distances between probability distributions, with applications in various fields, including machine learning, control theory, decision theory, and biological systems.…

Machine Learning · Computer Science 2026-02-10 Eduardo Figueiredo , Steven Adams , Luca Laurenti

The paper builds upon a recent approach to find the approximate bounds of a real function using Polynomial Chaos expansions. Given a function of random variables with compact support probability distributions, the intuition is to quantify…

Computation · Statistics 2011-07-11 Gabriel Terejanu , Puneet Singla , Tarunraj Singh , Peter D. Scott

In this article, a formulation of a point-collocation method in which the unknown function is approximated using global expansion in tensor product Bernstein polynomial basis is presented. Bernstein polynomials used in this study are…

Numerical Analysis · Mathematics 2012-11-16 Nikola Mirkov , Bosko Rasuo

Accurate noise modelling is important for training of deep learning reconstruction algorithms. While noise models are well known for traditional imaging techniques, the noise distribution of a novel sensor may be difficult to determine a…

Machine Learning · Computer Science 2018-07-11 Felix Horger , Tobias Würfl , Vincent Christlein , Andreas Maier

The problem of quickest detection of a change in the distribution of a sequence of independent observations is considered. It is assumed that the pre-change distribution is known (accurately estimated), while the only information about the…

Statistics Theory · Mathematics 2023-09-29 Liyan Xie , Yuchen Liang , Venugopal V. Veeravalli

The Fourier Basis Density Model (FBM) was recently introduced as a flexible probability model for band-limited distributions, i.e. ones which are smooth in the sense of having a characteristic function with limited support around the…

Information Theory · Computer Science 2025-05-12 Alfredo De la Fuente , Saurabh Singh , Jona Ballé

Given $iid$ observations from an unknown absolute continuous distribution defined on some domain $\Omega$, we propose a nonparametric method to learn a piecewise constant function to approximate the underlying probability density function.…

Machine Learning · Statistics 2018-03-13 Dangna Li , Kun Yang , Wing Hung Wong

In this paper, we investigate the asymptotic properties of nonparametric Bayesian mixtures of Betas for estimating a smooth density on $[0,1]$. We consider a parametrization of Beta distributions in terms of mean and scale parameters and…

Statistics Theory · Mathematics 2010-01-12 Judith Rousseau

This note describes a method for detecting dense random texture using fully connected points sampled on image edges. An edge image is randomly sampled with points, the standard L2 distance is calculated between all connected points in a…

Computer Vision and Pattern Recognition · Computer Science 2023-10-09 Soeren Molander

We present some new and explicit error bounds for the approximation of distributions. The approximation error is quantified by the maximal density ratio of the distribution $Q$ to be approximated and its proxy $P$. This non-symmetric…

Statistics Theory · Mathematics 2022-09-02 Lutz Duembgen , Richard Samworth , Jon Wellner

In this article we study the problem of quantifying the uncertainty in an experiment with a technical system. We propose new density estimates which combine observed data of the technical system and simulated data from an (imperfect)…

Statistics Theory · Mathematics 2020-12-21 Sebastian Kersting , Michael Kohler