English
Related papers

Related papers: Bayesian estimation of a decreasing density

200 papers

We consider nonparametric Bayesian estimation of a probability density $p$ based on a random sample of size $n$ from this density using a hierarchical prior. The prior consists, for instance, of prior weights on the regularity of the…

Statistics Theory · Mathematics 2009-09-29 Subhashis Ghosal , Jüri Lember , Aad van der Vaart

In many instances, the application of approximate Bayesian methods is hampered by two practical features: 1) the requirement to project the data down to low-dimensional summary, including the choice of this projection, which ultimately…

Methodology · Statistics 2020-06-26 David T. Frazier

In solving Bayesian inverse problems, it is often desirable to use a common density parameterization to denote the prior and posterior. Typically we seek a density from the same family as the prior which closely approximates the true…

Numerical Analysis · Mathematics 2022-03-29 Xiao-Mei Yang , Zhi-Liang Deng

Constraints are a natural choice for prior information in Bayesian inference. In various applications, the parameters of interest lie on the boundary of the constraint set. In this paper, we use a method that implicitly defines a…

Statistics Theory · Mathematics 2022-09-27 Jasper Marijn Everink , Yiqiu Dong , Martin Skovgaard Andersen

Shape restrictions such as monotonicity on functions often arise naturally in statistical modeling. We consider a Bayesian approach to the problem of estimation of a monotone regression function and testing for monotonicity. We construct a…

Statistics Theory · Mathematics 2020-08-05 Moumita Chakraborty , Subhashis Ghosal

We study the convergence rates of empirical Bayes posterior distributions for nonparametric and high-dimensional inference. We show that as long as the hyperparameter set is discrete, the empirical Bayes posterior distribution induced by…

Statistics Theory · Mathematics 2020-09-10 Fengshuo Zhang , Chao Gao

In this paper the Bayesian analysis is applied to assign a probability density to the value of a quantity having a definite sign. This analysis is logically consistent with the results, positive or negative, of repeated measurements.…

Methodology · Statistics 2009-11-13 D Calonico , F Levi , L Lorini , G Mana

State-of-the-art neural network-based methods for learning summary statistics have delivered promising results for simulation-based likelihood-free parameter inference. Existing approaches require density estimation as a post-processing…

This paper proposes a novel method for testing observability in Gaussian models using discrete density approximations (deterministic samples) of (multivariate) Gaussians. Our notion of observability is defined by the existence of the…

Systems and Control · Electrical Eng. & Systems 2022-08-19 Ariane Hanebeck , Claudia Czado

We reconsider a nonparametric density model based on Gaussian processes. By augmenting the model with latent P\'olya--Gamma random variables and a latent marked Poisson process we obtain a new likelihood which is conjugate to the model's…

Machine Learning · Statistics 2018-05-30 Christian Donner , Manfred Opper

The sample mean is often used to aggregate different unbiased estimates of a parameter, producing a final estimate that is unbiased but possibly high-variance. This paper introduces the Bayesian median of means, an aggregation rule that…

Statistics Theory · Mathematics 2019-06-05 Paulo Orenstein

An empirical Bayes approach to the estimation of possibly sparse sequences observed in Gaussian white noise is set out and investigated. The prior considered is a mixture of an atom of probability at zero and a heavy-tailed density \gamma,…

Statistics Theory · Mathematics 2007-06-13 Iain M. Johnstone , Bernard W. Silverman

In this paper we propose a new deterministic approximation method, called discretization approximation, for Bayesian computation. Discretization approximation is very simple to understand and to implement, It only requires calculating…

Computation · Statistics 2026-01-13 Shifeng Xiong

Approximate Bayesian Computation is a family of likelihood-free inference techniques that are well-suited to models defined in terms of a stochastic generating mechanism. In a nutshell, Approximate Bayesian Computation proceeds by computing…

Computation · Statistics 2010-07-28 Michael Blum

Penalized regression methods, such as $L_1$ regularization, are routinely used in high-dimensional applications, and there is a rich literature on optimality properties under sparsity assumptions. In the Bayesian paradigm, sparsity is…

Statistics Theory · Mathematics 2012-12-27 Anirban Bhattacharya , Debdeep Pati , Natesh S. Pillai , David B. Dunson

The frequentist behavior of nonparametric Bayes estimates, more specifically, rates of contraction of the posterior distributions to shrinking $L^r$-norm neighborhoods, $1\le r\le\infty$, of the unknown parameter, are studied. A theorem for…

Statistics Theory · Mathematics 2012-03-12 Evarist Giné , Richard Nickl

We present a novel approach to Bayesian inference and general Bayesian computation that is defined through a sequential decision loop. Our method defines a recursive partitioning of the sample space. It neither relies on gradients nor…

Machine Learning · Statistics 2021-06-10 Erik Bodin , Zhenwen Dai , Neill D. F. Campbell , Carl Henrik Ek

We study the rate of convergence of posterior distributions in density estimation problems for log-densities in periodic Sobolev classes characterized by a smoothness parameter p. The posterior expected density provides a nonparametric…

Statistics Theory · Mathematics 2009-09-29 Catia Scricciolo

We propose a novel approach for density estimation called histogram trend filtering. Our estimator arises from looking at surrogate Poisson model for counts of observations in a partition of the support of the data. We begin by showing…

Methodology · Statistics 2016-02-09 Oscar Hernan Madrid Padilla , James G. Scott

This paper introduces a new approach to the study of rates of convergence for posterior distributions. It is a natural extension of a recent approach to the study of Bayesian consistency. In particular, we improve on current rates of…

Statistics Theory · Mathematics 2007-08-22 Stephen G. Walker , Antonio Lijoi , Igor Prünster