English
Related papers

Related papers: On The Gaussian Approximation To Bayesian Posterio…

200 papers

We introduce priors and algorithms to perform Bayesian inference in Gaussian models defined by acyclic directed mixed graphs. Such a class of graphs, composed of directed and bi-directed edges, is a representation of conditional…

Methodology · Statistics 2012-07-02 Ricardo Silva , Zoubin Ghahramani

The Yule--Simon distribution has been out of the radar of the Bayesian community, so far. In this note, we propose an explicit Gibbs sampling scheme when a Gamma prior is chosen for the shape parameter. The performance of the algorithm is…

Methodology · Statistics 2017-07-04 Fabrizio Leisen , Luca Rossini , Cristiano Villa

There is a growing interest in the so-called Bayesian Predictive Inference approach, which allows to perform Bayesian inference without specifying the likelihood and prior of the model, or the need of any MCMC. Instead, only a sequence of…

Statistics Theory · Mathematics 2025-09-30 Marco Battiston , Lorenzo Cappello

In this note, we define a Gaussian probability distribution over matrices. We prove some useful properties of this distribution, namely, the fact that marginalization, conditioning, and affine transformations preserve the matrix Gaussian…

Probability · Mathematics 2018-06-22 Shane Barratt

The negative multinomial distribution is a multivariate generalization of the negative binomial distribution. In this paper, we consider the problem of estimating an unknown matrix of probabilities on the basis of observations of negative…

Statistics Theory · Mathematics 2020-10-30 Yasuyuki Hamura , Tatsuya Kubokawa

Consider the problem of estimating a random variable $X$ from noisy observations $Y = X+ Z$, where $Z$ is standard normal, under the $L^1$ fidelity criterion. It is well known that the optimal Bayesian estimator in this setting is the…

Statistics Theory · Mathematics 2024-08-08 Leighton P. Barnes , Alex Dytso , Jingbo Liu , H. Vincent Poor

Motivated by molecular biology, there has been an upsurge of research activities in directional statistics in general and its Bayesian aspect in particular. The central distribution for the circular case is von Mises distribution which has…

Computation · Statistics 2014-06-24 Peter G. M. Forbes , Kanti V. Mardia

Bayesian models that can handle both over and under dispersed counts are rare in the literature, perhaps because full probability distributions for dispersed counts are rather difficult to construct. This note takes a first look at Bayesian…

Methodology · Statistics 2020-10-08 Alan Huang , Andy Sang Il Kim

The Weibull distribution is one of the most used tools in reliability analysis. In this paper, assuming a Bayesian approach, we propose necessary and sufficient conditions to verify when improper priors lead to proper posteriors for the…

Statistics Theory · Mathematics 2020-05-19 Eduardo Ramos , Pedro L. Ramos

Inverse problems, i.e., estimating parameters of physical models from experimental data, are ubiquitous in science and engineering. The Bayesian formulation is the gold standard because it alleviates ill-posedness issues and quantifies…

Machine Learning · Statistics 2024-05-28 Sharmila Karumuri , Ilias Bilionis

The negative binomial distribution has been widely used as a more flexible model than the Poisson distribution for count data. However, when the true data-generating process is Poisson, it is often challenging to distinguish it from a…

Statistics Theory · Mathematics 2026-04-07 Yingying Yang , Niloufar Dousti Mousavi , Zhou Yu , Jie Yang

The Gaussian mixture model is widely used in unsupervised learning, owing to its simplicity and interpretability. However, a fundamental limitation of the classical Gaussian mixture model is that it forces each observation to belong to…

Machine Learning · Statistics 2026-04-27 Huan Qing

The generalized negative binomial distribution (GNB) is a new flexible family of discrete distributions that are mixed Poisson laws with the mixing generalized gamma (GG) distributions. This family of discrete distributions is very wide and…

Methodology · Statistics 2018-09-18 Andrey K. Gorshenin , Victor Yu. Korolev

Gaussian Process Networks (GPNs) are a class of directed graphical models which employ Gaussian processes as priors for the conditional expectation of each variable given its parents in the network. The model allows the description of…

Machine Learning · Statistics 2024-02-20 Enrico Giudice , Jack Kuipers , Giusi Moffa

An efficient method for finding a better maximizer of computationally extensive probability distributions is proposed on the basis of a Bayesian optimization technique. A key idea of the proposed method is to use extreme values of…

Data Analysis, Statistics and Probability · Physics 2018-03-14 Ryo Tamura , Koji Hukushima

Consider the task of estimating a random vector $X$ from noisy observations $Y = X + Z$, where $Z$ is a standard normal vector, under the $L^p$ fidelity criterion. This work establishes that, for $1 \leq p \leq 2$, the optimal Bayesian…

Statistics Theory · Mathematics 2024-01-31 Leighton P. Barnes , Alex Dytso , Jingbo Liu , H. Vincent Poor

Bayesian optimal design is a well-established approach to planning experiments. A distribution for the responses, i.e. a statistical model, is assumed which is dependent on unknown parameters. A utility function is then specified giving…

Methodology · Statistics 2025-01-03 Antony M. Overstall , Jacinta Holloway-Brown , James M. McGree

The analytic inference, e.g. predictive distribution being in closed form, may be an appealing benefit for machine learning practitioners when they treat wide neural networks as Gaussian process in Bayesian setting. The realistic widths,…

Disordered Systems and Neural Networks · Physics 2023-08-01 Chi-Ken Lu

Gaussian processes are distributions over functions that are versatile and mathematically convenient priors in Bayesian modelling. However, their use is often impeded for data with large numbers of observations, $N$, due to the cubic (in…

Machine Learning · Statistics 2020-08-04 David R. Burt , Carl Edward Rasmussen , Mark van der Wilk

In this article, we discuss a bivariate distribution whose conditionals are univariate binomial distributions and the marginals are not binomial that exhibits negative correlation. Some useful structural properties of this distribution…

Methodology · Statistics 2023-01-10 Indranil Ghosh , Filipe Marques , Subrata Chakraborty