English
Related papers

Related papers: Bayesian estimation of a decreasing density

200 papers

The aim of this paper is to present a new estimation procedure that can be applied in many statistical frameworks including density and regression and which leads to both robust and optimal (or nearly optimal) estimators. In density…

Statistics Theory · Mathematics 2017-01-23 Yannick Baraud , Lucien Birgé , Mathieu Sart

We study nonparametric Bayesian inference with location mixtures of the Laplace density and a Dirichlet process prior on the mixing distribution. We derive a contraction rate of the corresponding posterior distribution, both for the mixing…

Statistics Theory · Mathematics 2016-03-10 Fengnan Gao , Aad van der Vaart

We construct a density estimator in the bivariate uniform deconvolution model. For this model we derive four inversion formulas to express the bivariate density that we want to estimate in terms of the bivariate density of the observations.…

Methodology · Statistics 2011-06-09 Martina Benešová , Bert van Es , Peter Tegelaar

The estimation of probability densities based on available data is a central task in many statistical applications. Especially in the case of large ensembles with many samples or high-dimensional sample spaces, computationally efficient…

Methodology · Statistics 2017-05-04 Daniel W. Meyer

Density Ratio Estimation has attracted attention from the machine learning community due to its ability to compare the underlying distributions of two datasets. However, in some applications, we want to compare distributions of random…

Machine Learning · Statistics 2020-06-26 Song Liu , Yulong Zhang , Mingxuan Yi , Mladen Kolar

A common problem in natural sciences is the comparison of competing models in the light of observed data. Bayesian model comparison provides a statistically sound framework for this comparison based on the evidence each model provides for…

Machine Learning · Statistics 2022-03-23 Jan Boelts

The ratio of two densities provides a direct characterization of their differences. We consider the two-sample comparison problem by estimating this ratio given i.i.d. observations from two distributions. To this end, we propose additive…

Methodology · Statistics 2026-04-23 Naoki Awaya , Yuliang Xu , Li Ma

Construction methods for prior densities are investigated from a predictive viewpoint. Predictive densities for future observables are constructed by using observed data. The simultaneous distribution of future observables and observed data…

Statistics Theory · Mathematics 2021-05-27 Fumiyasu Komaki

Bayesian networks provide a method of representing conditional independence between random variables and computing the probability distributions associated with these random variables. In this paper, we extend Bayesian network structures to…

Artificial Intelligence · Computer Science 2013-02-21 Eric Driver , Darryl Morrell

Estimating the unknown density from which a given independent sample originates is more difficult than estimating the mean, in the sense that for the best popular non-parametric density estimators, the mean integrated square error converges…

Statistics Theory · Mathematics 2021-09-08 Pierre L'Ecuyer , Florian Puchhammer , Amal Ben Abdellah

We show that rate-adaptive multivariate density estimation can be performed using Bayesian methods based on Dirichlet mixtures of normal kernels with a prior distribution on the kernel's covariance matrix parameter. We derive sufficient…

Statistics Theory · Mathematics 2013-08-22 Weining Shen , Surya T. Tokdar , Subhashis Ghosal

This paper offers a qualitative insight into the convergence of Bayesian parameter inference in a setup which mimics the modeling of the spread of a disease with associated disease measurements. Specifically, we are interested in the…

Statistics Theory · Mathematics 2022-12-08 Samuel Bronstein , Stefan Engblom , Robin Marin

In this paper several related estimation problems are addressed from a Bayesian point of view and optimal estimators are obtained for each of them when some natural loss functions are considered. Namely, we are interested in estimating a…

Statistics Theory · Mathematics 2021-10-27 A. G. Nogales

Divergence estimators based on direct approximation of density-ratios without going through separate approximation of numerator and denominator densities have been successfully applied to machine learning tasks that involve distribution…

Machine Learning · Statistics 2011-06-24 Makoto Yamada , Taiji Suzuki , Takafumi Kanamori , Hirotaka Hachiya , Masashi Sugiyama

We study an unbiased estimator for the density of a sum of random variables that are simulated from a computer model. A numerical study on examples with copula dependence is conducted where the proposed estimator performs favourably in…

Statistics Theory · Mathematics 2018-09-19 Patrick J. Laub , Robert Salomone , Zdravko I. Botev

Consider the Gaussian sequence model under the additional assumption that a fixed fraction of the means is known. We study the problem of variance estimation from a frequentist Bayesian perspective. The maximum likelihood estimator (MLE)…

Statistics Theory · Mathematics 2019-12-19 Gianluca Finocchio , Johannes Schmidt-Hieber

We investigate the problem of deriving posterior concentration rates under different loss functions in nonparametric Bayes. We first provide a lower bound on posterior coverages of shrinking neighbourhoods that relates the metric or loss…

Statistics Theory · Mathematics 2015-11-06 Marc Hoffmann , Judith Rousseau , Johannes Schmidt-Hieber

We focus on Bayesian inverse problems with Gaussian likelihood, linear forward model, and priors that can be formulated as a Gaussian mixture. Such a mixture is expressed as an integral of Gaussian density functions weighted by a mixing…

Computation · Statistics 2024-08-30 Rafael Flock , Yiqiu Dong , Felipe Uribe , Olivier Zahm

We consider an inhomogeneous Poisson process $X$ on $[0,T]$. The intensity function of $X$ is supposed to be strictly positive and smooth on $[0,T]$ except at the point $\theta$, in which it has either a 0-type singularity (tends to 0 like…

Statistics Theory · Mathematics 2007-06-13 Serguei Dachian

Consider a density $f$ on $[0,1]$ that must be estimated from an i.i.d. sample $X_1,...,X_n$ drawn from $f$. In this note, we study binary-tree-based histogram estimates that use recursive splitting of intervals. If the decision to split an…

Statistics Theory · Mathematics 2025-04-24 Luc Devroye , Jad Hamdan