English
Related papers

Related papers: Histogram Meets Topic Model: Density Estimation by…

200 papers

The increased availability of observation data from engineering systems in operation poses the question of how to incorporate this data into finite element models. To this end, we propose a novel statistical construction of the finite…

Methodology · Statistics 2021-01-25 Mark Girolami , Eky Febrianto , Ge Yin , Fehmi Cirak

We consider nonparametric Bayesian estimation of a probability density $p$ based on a random sample of size $n$ from this density using a hierarchical prior. The prior consists, for instance, of prior weights on the regularity of the…

Statistics Theory · Mathematics 2009-09-29 Subhashis Ghosal , Jüri Lember , Aad van der Vaart

The properties of black-hole and neutron-star binaries are extracted from gravitational-wave signals using Bayesian inference. This involves evaluating a multi-dimensional posterior probability function with stochastic sampling. The…

General Relativity and Quantum Cosmology · Physics 2021-09-29 Virginia D'Emilio , Rhys Green , Vivien Raymond

Random processes play a crucial role in scientific research, often characterized by distribution functions or probability density functions (PDFs). These PDFs serve as essential approximations of the actual and frequently undisclosed…

Methodology · Statistics 2023-06-06 Nico Schick

We consider the estimation of the global mode of a density under some decay rate condition around the global mode. We show that the maximum of a histogram, with proper choice of bandwidth, achieves the minimax rate that we establish for the…

Statistics Theory · Mathematics 2021-04-19 Ery Arias-Castro , Wanli Qiao , Lin Zheng

In this work, we study non-parametric estimation of joint probabilities of a given set of discrete and continuous random variables from their (empirically estimated) 2D marginals, under the assumption that the joint probability could be…

Machine Learning · Computer Science 2022-03-04 Shaan ul Haque , Ajit Rajwade , Karthik S. Gurumoorthy

We propose a novel Bayesian nonparametric method for hierarchical modelling on a set of related density functions, where grouped data in the form of samples from each density function are available. Borrowing strength across the groups is a…

Computation · Statistics 2014-10-31 G. S. Rodrigues , David J. Nott , S. A. Sisson

Density regression provides a flexible strategy for modeling the distribution of a response variable $Y$ given predictors $\mathbf{X}=(X_1,\ldots,X_p)$ by letting that the conditional density of $Y$ given $\mathbf{X}$ as a completely…

Statistics Theory · Mathematics 2016-01-07 Weining Shen , Subhashis Ghosal

When modeling a probability distribution with a Bayesian network, we are faced with the problem of how to handle continuous variables. Most previous work has either solved the problem by discretizing, or assumed that the data are generated…

Machine Learning · Computer Science 2013-02-21 George H. John , Pat Langley

In this work we develop and implement a novel Bayesian method for computing the DOS of a system. This method is based on the use of a test function with adjustable parameters and we use Bayes theorem to find the best parameters given a…

Statistical Mechanics · Physics 2021-12-28 Felipe Moreno , Sergio Davis , Joaquín Peralta

Implicit sampling is a weighted sampling method that is used in data assimilation, where one sequentially updates estimates of the state of a stochastic model based on a stream of noisy or incomplete data. Here we describe how to use…

Numerical Analysis · Mathematics 2016-01-20 Matthias Morzfeld , Xuemin Tu , Jon Wilkening , Alexandre J. Chorin

Identifying the underlying models in a set of data points contaminated by noise and outliers, leads to a highly complex multi-model fitting problem. This problem can be posed as a clustering problem by the projection of higher order…

Computer Vision and Pattern Recognition · Computer Science 2018-08-01 Ruwan Tennakoon , Alireza Sadri , Reza Hoseinnezhad , Alireza Bab-Hadiashar

Implementing Bayesian inference is often computationally challenging in applications involving complex models, and sometimes calculating the likelihood itself is difficult. Synthetic likelihood is one approach for carrying out inference…

Computation · Statistics 2021-03-15 David T. Frazier , David J. Nott , Christopher Drovandi , Robert Kohn

Density estimation plays a fundamental role in many areas of statistics and machine learning. Parametric, nonparametric and semiparametric density estimation methods have been proposed in the literature. Semiparametric density models are…

Statistics Theory · Mathematics 2019-01-11 Jian Shi , Jiahui Yu , Anna Liu , Yuedong Wang

Multicellular systems play a key role in bioprocess and biomedical engineering. Cell ensembles encountered in these setups show phenotypic variability like size and biochemical composition. As this variability may result in undesired…

Systems and Control · Computer Science 2018-07-16 Armin Küper , Robert Dürr , Steffen Waldherr

Approximate Bayesian inference on the basis of summary statistics is well-suited to complex problems for which the likelihood is either mathematically or computationally intractable. However the methods that use rejection suffer from the…

Computation · Statistics 2010-05-04 M. G. B. Blum , O. Francois

Estimating a Gibbs density function given a sample is an important problem in computational statistics and statistical learning. Although the well established maximum likelihood method is commonly used, it requires the computation of the…

Machine Learning · Computer Science 2023-03-14 Eldad Haber , Moshe Eliasof , Luis Tenorio

We present the fundamentals of a measure transport approach to sampling. The idea is to construct a deterministic coupling---i.e., a transport map---between a complex "target" probability measure of interest and a simpler reference measure.…

Computation · Statistics 2017-12-27 Youssef Marzouk , Tarek Moselhy , Matthew Parno , Alessio Spantini

The Dirichlet process mixture model and more general mixtures based on discrete random probability measures have been shown to be flexible and accurate models for density estimation and clustering. The goal of this paper is to illustrate…

Methodology · Statistics 2013-10-02 Ernesto Barrios , Antonio Lijoi , Luis E. Nieto-Barajas , Igor Prünster

In order to cluster or partition data, we often use Expectation-and-Maximization (EM) or Variational approximation with a Gaussian Mixture Model (GMM), which is a parametric probability density function represented as a weighted sum of…

Machine Learning · Computer Science 2013-07-04 Ji Won Yoon