English
Related papers

Related papers: Gaussian variational approximation for high-dimens…

200 papers

Through the Bayesian lens of data assimilation, uncertainty on model parameters is traditionally quantified through the posterior covariance matrix. However, in modern settings involving high-dimensional and computationally expensive…

Computation · Statistics 2023-11-16 Michael Stanley , Mikael Kuusela , Brendan Byrne , Junjie Liu

Factors models are routinely used to analyze high-dimensional data in both single-study and multi-study settings. Bayesian inference for such models relies on Markov Chain Monte Carlo (MCMC) methods which scale poorly as the number of…

Methodology · Statistics 2025-04-29 Blake Hansen , Alejandra Avalos-Pacheco , Massimiliano Russo , Roberta De Vito

We develop a scalable deep non-parametric generative model by augmenting deep Gaussian processes with a recognition model. Inference is performed in a novel scalable variational framework where the variational posterior distributions are…

Machine Learning · Computer Science 2016-03-02 Zhenwen Dai , Andreas Damianou , Javier González , Neil Lawrence

We develop Bayesian models for density regression with emphasis on discrete outcomes. The problem of density regression is approached by considering methods for multivariate density estimation of mixed scale variables, and obtaining…

Methodology · Statistics 2019-08-14 Georgios Papageorgiou

This article describes a method for using optimization to derive efficient independent transition functions for Markov chain Monte Carlo simulations. Our interest is in sampling from a posterior density $\pi(x)$ for problems in which the…

Computation · Statistics 2022-06-03 Dean S. Oliver

Max-stable processes have proved to be useful for the statistical modelling of spatial extremes. Several representations of max-stable random fields have been proposed in the literature. For statistical inference it is often assumed that…

Methodology · Statistics 2011-07-25 Richard A. Davis , Claudia Klüppelberg , Christina Steinkohl

While Bayesian methods are extremely popular in statistics and machine learning, their application to massive datasets is often challenging, when possible at all. Indeed, the classical MCMC algorithms are prohibitively slow when both the…

Statistics Theory · Mathematics 2019-04-23 Pierre Alquier , James Ridgway

The use of Gaussian process models is typically limited to datasets with a few tens of thousands of observations due to their complexity and memory footprint. The two most commonly used methods to overcome this limitation are 1) the…

Machine Learning · Statistics 2020-01-16 Vincent Adam , Stefanos Eleftheriadis , Nicolas Durrande , Artem Artemev , James Hensman

In Gaussian graphical models, the zero entries in the precision matrix determine the dependence structure, so estimating that sparse precision matrix and, thereby, learning this underlying structure, is an important and challenging problem.…

Statistics Theory · Mathematics 2019-12-10 Chang Liu , Ryan Martin

Despite the popularism of Bayesian neural networks in recent years, its use is somewhat limited in complex and big data situations due to the computational cost associated with full posterior evaluations. Variational Bayes (VB) provides a…

Machine Learning · Statistics 2020-06-30 Shrijita Bhattacharya , Tapabrata Maiti

We propose a general framework using spike-and-slab prior distributions to aid with the development of high-dimensional Bayesian inference. Our framework allows inference with a general quasi-likelihood function. We show that highly…

Statistics Theory · Mathematics 2019-08-21 Yves Atchade , Anwesha Bhattacharyya

This paper studies the problem of estimating the covariance of a collection of vectors using only highly compressed measurements of each vector. An estimator based on back-projections of these compressive samples is proposed and analyzed. A…

Machine Learning · Statistics 2019-01-16 Martin Azizyan , Akshay Krishnamurthy , Aarti Singh

We study posterior rates of contraction in Gaussian process regression with unbounded covariate domain. Our argument relies on developing a Gaussian approximation to the posterior of the leading coefficients of a Karhunen--Lo\'{e}ve…

Statistics Theory · Mathematics 2015-10-06 Anirban Bhattacharya , Debdeep Pati

Sparse Bayesian factor models are routinely implemented for parsimonious dependence modeling and dimensionality reduction in high-dimensional applications. We provide theoretical understanding of such Bayesian procedures in terms of…

Statistics Theory · Mathematics 2014-06-03 Debdeep Pati , Anirban Bhattacharya , Natesh S. Pillai , David Dunson

Modeling the temporal behavior of data is of primordial importance in many scientific and engineering fields. Baseline methods assume that both the dynamic and observation equations follow linear-Gaussian models. However, there are many…

Machine Learning · Computer Science 2020-11-03 Xavier Alameda-Pineda , Vincent Drouard , Radu Horaud

We consider the scenario where the parameters of a probabilistic model are expected to vary over time. We construct a novel prior distribution that promotes sparsity and adapts the strength of correlation between parameters at successive…

Machine Learning · Statistics 2015-11-10 Dani Yogatama , Bryan R. Routledge , Noah A. Smith

A new probabilistic post-processing method for wind vectors is presented in a distributional regression framework employing the bivariate Gaussian distribution. In contrast to previous studies all parameters of the distribution are…

Applications · Statistics 2019-07-26 Moritz N. Lang , Georg J. Mayr , Reto Stauffer , Achim Zeileis

Gaussian processes are a powerful framework for quantifying uncertainty and for sequential decision-making but are limited by the requirement of solving linear systems. In general, this has a cubic cost in dataset size and is sensitive to…

This paper proposes a novel low-rank approximation to the multivariate State-Space Model. The Stochastic Partial Differential Equation (SPDE) approach is applied component-wise to the independent-in-time Mat\'ern Gaussian innovation term in…

We propose new methods for multivariate linear regression when the regression coefficient matrix is sparse and the error covariance matrix is dense. We assume that the error covariance matrix has equicorrelation across the response…

Methodology · Statistics 2025-08-13 Daeyoung Ham , Bradley S. Price , Adam J. Rothman