English
Related papers

Related papers: Gaussian approximation of Gaussian scale mixture

200 papers

We present a Bayesian scheme for the approximate diagonalisation of several square matrices which are not necessarily symmetric. A Gibbs sampler is derived to simulate samples of the common eigenvectors and the eigenvalues for these…

Computation · Statistics 2012-06-22 Mingjun Zhong , Mark Girolami

It is often convenient to use Gaussian blur in studying image quality or in data augmentation pipelines for training convoluional neural networks. Because of their convenience, Guassians are sometimes used as first order approximations of…

Image and Video Processing · Electrical Eng. & Systems 2023-01-04 Austin C. Bergstrom , David Conran , David W. Messinger

Suppose that we are given independent, identically distributed samples $x_l$ from a mixture $\mu$ of no more than $k$ of $d$-dimensional spherical gaussian distributions $\mu_i$ with variance $1$, such that the minimum $\ell_2$ distance…

Data Structures and Algorithms · Computer Science 2025-09-10 Somnath Chakraborty , Hariharan Narayanan

Bayesian methods estimate a measure of uncertainty by using the posterior distribution. One source of difficulty in these methods is the computation of the normalizing constant. Calculating exact posterior is generally intractable and we…

Machine Learning · Computer Science 2021-11-17 Farzaneh Mahdisoltani

When comparing approximate Gaussian process (GP) models, it can be helpful to be able to generate data from any GP. If we are interested in how approximate methods perform at scale, we may wish to generate very large synthetic datasets to…

Machine Learning · Statistics 2023-01-03 Anthony Stephenson , Robert Allison , Edward Pyzer-Knapp

We discuss an approach to compute the first and second moments of the number of eigenvalues $I_N$ that lie in an arbitrary interval of the real line for $N \times N$ Gaussian random matrices. The method combines the standard…

Statistical Mechanics · Physics 2017-11-22 Fernando L. Metz

We discuss D-dimensional scalar field interacting with a scale invariant random metric which is either a Gaussian field or a square of a Gaussian field. The metric depends on d-dimensional coordinates (where d is less than D). By a…

High Energy Physics - Theory · Physics 2009-11-07 Z. Haba

The main computational challenge in Bayesian inference is to compute integrals against a high-dimensional posterior distribution. In the past decades, variational inference (VI) has emerged as a tractable approximation to these integrals,…

Statistics Theory · Mathematics 2024-01-09 Anya Katsevich , Philippe Rigollet

Estimating the number of components is a fundamental challenge in unsupervised learning, particularly when dealing with high-dimensional data with many components or severely imbalanced component sizes. This paper addresses this challenge…

Machine Learning · Statistics 2026-04-22 Huan Qing

In the setting where we have $n$ independent observations of a random variable $X$, we derive explicit error bounds in total variation distance when approximating the number of observations equal to the maximum of the sample (in the case…

Probability · Mathematics 2026-04-10 Fraser Daly

Gaussian processes (GPs) are flexible, probabilistic, nonparametric models widely used in fields such as spatial statistics and machine learning. A drawback of Gaussian processes is their computational cost, with $O(N^3)$ time and $O(N^2)$…

Computation · Statistics 2026-05-20 Filippo Rambelli , Fabio Sigrist

We consider the following detection problem: given a realization of a symmetric matrix ${\mathbf{X}}$ of dimension $n$, distinguish between the hypothesis that all upper triangular variables are i.i.d. Gaussians variables with mean 0 and…

Statistics Theory · Mathematics 2014-11-25 Andrea Montanari , Daniel Reichman , Ofer Zeitouni

Variable clustering is important for explanatory analysis. However, only few dedicated methods for variable clustering with the Gaussian graphical model have been proposed. Even more severe, small insignificant partial correlations due to…

Applications · Statistics 2018-06-18 Daniel Andrade , Akiko Takeda , Kenji Fukumizu

An integral over the interval $(0,\pi)$ is given for the cumulative distribution function of a sum of independent gamma random variables with different scale and shape parameters. The cumulative distribution function of a positive definite…

Probability · Mathematics 2024-12-18 Thomas Royen

This paper investigates the behaviour of the spectrum of generally correlated Gaussian random matrices whose columns are zero-mean independent vectors but have different correlations, under the specific regime where the number of their…

Information Theory · Computer Science 2014-12-30 Abla Kammoun , M. S. Alouini

We consider the problem of clustering data points in high dimensions, i.e. when the number of data points may be much smaller than the number of dimensions. Specifically, we consider a Gaussian mixture model (GMM) with non-spherical…

Statistics Theory · Mathematics 2014-06-10 Martin Azizyan , Aarti Singh , Larry Wasserman

Several proofs of the monotonicity of the non-Gaussianness (divergence with respect to a Gaussian random variable with identical second order statistics) of the sum of n independent and identically distributed (i.i.d.) random variables were…

Information Theory · Computer Science 2007-07-13 Jacob Binia

We introduce a geometric scaling relation that characterizes the local scale behavior of correlations using the informational distance $d_E = K_0/\sqrt{I}$, where $I$ is the mutual information. We define a geometric conversion factor, $G…

Statistical Mechanics · Physics 2025-12-02 Beau Leighton-Trudel

Let K be a field of positive characteristic. When V is a linear variety in K^n and G is a finitely generated subgroup of K^*, we show how to compute the intersection of V and G^n effectively using heights. We calculate all the estimates…

Number Theory · Mathematics 2014-02-26 Harm Derksen , David Masser

We consider the approximation of the inverse square root of regularly accretive operators in Hilbert spaces. The approximation is of rational type and comes from the use of the Gauss-Legendre rule applied to a special integral formulation…

Numerical Analysis · Mathematics 2022-02-04 Eleonora Denich , Paolo Novati