English
Related papers

Related papers: Fast simulation of truncated Gaussian distribution…

200 papers

We derive a novel variational expectation maximization approach based on truncated posterior distributions. Truncated distributions are proportional to exact posteriors within subsets of a discrete state space and equal zero otherwise. The…

Machine Learning · Statistics 2019-07-12 Jörg Lücke

The widespread use of Markov Chain Monte Carlo (MCMC) methods for high-dimensional applications has motivated research into the scalability of these algorithms with respect to the dimension of the problem. Despite this, numerous problems…

Computation · Statistics 2024-10-21 Ardjen Pengel , Jun Yang , Zhou Zhou

We consider the problem of embedding a subset of $\mathbb{R}^n$ into a low-dimensional Hamming cube in an almost isometric way. We construct a simple, data-oblivious, and computationally efficient map that achieves this task with high…

Probability · Mathematics 2022-09-07 Sjoerd Dirksen , Shahar Mendelson , Alexander Stollenwerk

We explore various Bayesian approaches to estimate partial Gaussian graphical models. Our hierarchical structures enable to deal with single-output as well as multiple-output linear regressions, in small or high dimension, enforcing either…

Methodology · Statistics 2021-12-14 Eunice Okome Obiang , Pascal Jézéquel , Frédéric Proïa

Clustering mixtures of Gaussian distributions is a fundamental and challenging problem that is ubiquitous in various high-dimensional data processing tasks. While state-of-the-art work on learning Gaussian mixture models has focused…

Machine Learning · Computer Science 2018-03-05 Dan Kushnir , Shirin Jalali , Iraj Saniee

It is well-known that polynomial reproduction is not possible when approximating with Gaussian kernels. Quasi-interpolation schemes have been developed which use a finite number of Gaussians at different scales, which then reproduce…

Numerical Analysis · Mathematics 2020-01-24 Simon Hubbert , Jeremy Levesley

We give a necessary and sufficient condition for symmetric infinitely divisible distribution to have Gaussian component. The result can be applied to approximation the distribution of finite sums of random variables. Particularly, it shows…

Probability · Mathematics 2015-08-25 Lev B. Klebanov , Irina V. Volchenkova , Ashot V. Kakosyan

The computation of Gaussian orthant probabilities has been extensively studied for low-dimensional vectors. Here, we focus on the high-dimensional case and we present a two-step procedure relying on both deterministic and stochastic…

Methodology · Statistics 2018-12-03 Dario Azzimonti , David Ginsbourger

The Gaussian kernel plays a central role in machine learning, uncertainty quantification and scattered data approximation, but has received relatively little attention from a numerical analysis standpoint. The basic problem of finding an…

Numerical Analysis · Mathematics 2021-04-02 Toni Karvonen , Chris J. Oates , Mark Girolami

We deconstruct the performance of GANs into three components: 1. Formulation: we propose a perturbation view of the population target of GANs. Building on this interpretation, we show that GANs can be viewed as a generalization of the…

Machine Learning · Computer Science 2019-05-21 Banghua Zhu , Jiantao Jiao , David Tse

We obtain an optimal bound for a Gaussian approximation of a large class of vector-valued random processes. Our results provide a substantial generalization of earlier results that assume independence and/or stationarity. Based on the decay…

Statistics Theory · Mathematics 2020-01-29 Sayar Karmakar , Wei Biao Wu

Variable selection for Gaussian process models is often done using automatic relevance determination, which uses the inverse length-scale parameter of each input variable as a proxy for variable relevance. This implicitly determined…

Methodology · Statistics 2019-04-24 Topi Paananen , Juho Piironen , Michael Riis Andersen , Aki Vehtari

We show that a necessary and sufficient condition for the sum of iid random vectors to converge (under appropriate shifting and scaling) to a multivariate Gaussian distribution is that the truncated second moment matrix is slowly varying at…

Probability · Mathematics 2020-01-22 Michael Grabchak

Consider a random vector with finite second moments. If its precision matrix is an M-matrix, then all partial correlations are non-negative. If that random vector is additionally Gaussian, the corresponding Markov random field (GMRF) is…

Statistics Theory · Mathematics 2014-04-29 Martin Slawski , Matthias Hein

Gaussian Quadrature is a well known technique for numerical integration. Recently Gaussian quadrature with respect to discrete measures corresponding to finite sums have found some new interest. In this paper we apply these ideas to…

Numerical Analysis · Mathematics 2007-05-23 Hartmut Monien

A weighted Gaussian approximation to tail product-limit process for Pareto-like distributions of randomly right-truncated data is provided and a new consistent and asymptotically normal estimator of the extreme value index is derived. A…

Statistics Theory · Mathematics 2015-07-07 Souad Benchaira , Djamel Meraghni , Abdelhakim Necir

We derive a Gaussian approximation result for the maximum of a sum of high-dimensional random vectors. Specifically, we establish conditions under which the distribution of the maximum is approximated by that of the maximum of a sum of the…

Statistics Theory · Mathematics 2018-01-24 Victor Chernozhukov , Denis Chetverikov , Kengo Kato

Robust estimation is much more challenging in high dimensions than it is in one dimension: Most techniques either lead to intractable optimization problems or estimators that can tolerate only a tiny fraction of errors. Recent work in…

Machine Learning · Computer Science 2018-03-14 Ilias Diakonikolas , Gautam Kamath , Daniel M. Kane , Jerry Li , Ankur Moitra , Alistair Stewart

The Gamma distribution is well-known and widely used in many signal processing and communications applications. In this letter, a simple and extremely efficient accept/reject algorithm is introduced for the generation of independent random…

Computation · Statistics 2013-06-27 Luca Martino , David Luengo

Most of existing embedding based recommendation models use embeddings (vectors) corresponding to a single fixed point in low-dimensional space, to represent users and items. Such embeddings fail to precisely represent the users/items with…

Information Retrieval · Computer Science 2020-06-22 Junyang Jiang , Deqing Yang , Yanghua Xiao , Chenlu Shen