English
Related papers

Related papers: Variational inference based on a subclass of close…

200 papers

Numerical integration and emulation are fundamental topics across scientific fields. We propose novel adaptive quadrature schemes based on an active learning procedure. We consider an interpolative approach for building a surrogate…

Computation · Statistics 2021-01-20 F. Llorente , L. Martino , V. Elvira , D. Delgado , J. López-Santiago

We study a nonparametric Bayesian approach to linear inverse problems under discrete observations. We use the discrete Fourier transform to convert our model into a truncated Gaussian sequence model, that is closely related to the classical…

Statistics Theory · Mathematics 2018-10-31 Shota Gugushvili , Aad van der Vaart , Dong Yan

Despite exceptional predictive performance of Deep sequence models (DSMs), the main concern of their deployment centers around the lack of uncertainty awareness. In contrast, probabilistic models quantify the uncertainty associated with…

Machine Learning · Computer Science 2026-03-03 Wenlong Chen

Sampling of sharp posteriors in high dimensions is a challenging problem, especially when gradients of the likelihood are unavailable. In low to moderate dimensions, affine-invariant methods, a class of ensemble-based gradient-free methods,…

Methodology · Statistics 2022-02-23 Matthew M. Dunlop , Georg Stadler

Bayesian methods have become a popular way to incorporate prior knowledge and a notion of uncertainty into machine learning models. At the same time, the complexity of modern machine learning makes it challenging to comprehend a model's…

Machine Learning · Computer Science 2021-09-09 Sarem Seitz

Although Bayesian inference is an immensely popular paradigm among a large segment of scientists including statisticians, most applications consider objective priors and need critical investigations (Efron, 2013, Science). While it has…

Statistics Theory · Mathematics 2020-09-11 Abhik Ghosh , Tuhin Majumder , Ayanendranath Basu

We study the behavior of the posterior distribution in high-dimensional Bayesian Gaussian linear regression models having $p\gg n$, with $p$ the number of predictors and $n$ the sample size. Our focus is on obtaining quantitative finite…

Statistics Theory · Mathematics 2014-01-06 Nate Strawn , Artin Armagan , Rayan Saab , Lawrence Carin , David Dunson

Variational inference has experienced a recent surge in popularity owing to stochastic approaches, which have yielded practical tools for a wide range of model classes. A key benefit is that stochastic variational inference obviates the…

Computer Vision and Pattern Recognition · Computer Science 2018-03-29 Tobias Plötz , Anne S. Wannenwetsch , Stefan Roth

Gaussian graphical models are a popular tool to learn the dependence structure in the form of a graph among variables of interest. Bayesian methods have gained in popularity in the last two decades due to their ability to simultaneously…

Statistics Theory · Mathematics 2019-04-02 Yabo Niu , Debdeep Pati , Bani Mallick

Estimating conditional independence graphs from high-dimensional Gaussian data is challenging because methods must detect relevant edges while rigorously controlling statistical errors. We propose a Bayesian framework based on a prior…

Methodology · Statistics 2026-04-21 Roland B. Sogan , Tabea Rebafka , Fanny Villers

Using coupling techniques based on Stein's method for probability approximation, we revisit classical variance bounding inequalities of Chernoff, Cacoullos, Chen and Klaassen. Taking advantage of modern coupling techniques allows us to…

Probability · Mathematics 2019-11-11 Fraser Daly , Fatemeh Ghaderinezhad , Christophe Ley , Yvik Swan

We derive the precise asymptotic distributional behavior of Gaussian variational approximate estimators of the parameters in a single-predictor Poisson mixed model. These results are the deepest yet obtained concerning the statistical…

Statistics Theory · Mathematics 2012-02-24 Peter Hall , Tung Pham , M. P. Wand , S. S. J. Wang

In Bayesian nonparametric models, Gaussian processes provide a popular prior choice for regression function estimation. Existing literature on the theoretical investigation of the resulting posterior distribution almost exclusively assume a…

Statistics Theory · Mathematics 2015-03-06 Debdeep Pati , Anirban Bhattacharya , Guang Cheng

Variational inference techniques based on inducing variables provide an elegant framework for scalable posterior estimation in Gaussian process (GP) models. Besides enabling scalability, one of their main advantages over sparse…

Machine Learning · Statistics 2021-02-24 Simone Rossi , Markus Heinonen , Edwin V. Bonilla , Zheyang Shen , Maurizio Filippone

In image reconstruction, an accurate quantification of uncertainty is of great importance for informed decision making. Here, the Bayesian approach to inverse problems can be used: the image is represented through a random function that…

Numerical Analysis · Mathematics 2025-04-24 Jonas Latz , Aretha L. Teckentrup , Simon Urbainczyk

We study how the posterior contraction rate under a Gaussian process (GP) prior depends on the intrinsic dimension of the predictors and the smoothness of the regression function. An open question is whether a generic GP prior that does not…

Statistics Theory · Mathematics 2025-06-26 Tao Tang , Nan Wu , Xiuyuan Cheng , David Dunson

Surrogate models provide a quick-to-evaluate approximation to complex computational models and are essential for multi-query problems like design optimisation. The inputs of current deterministic computational models are usually…

Applications · Statistics 2024-10-15 Thomas A. Archbold , Ieva Kazlauskaite , Fehmi Cirak

Frequentist and likelihood methods of inference based on the multivariate skew-normal model encounter several technical difficulties with this model. In spite of the popularity of this class of densities, there are no broadly satisfactory…

Methodology · Statistics 2013-02-06 Brunero Liseo , Antonio Parisi

Parameter estimation for model-based clustering using a finite mixture of normal inverse Gaussian (NIG) distributions is achieved through variational Bayes approximations. Univariate NIG mixtures and multivariate NIG mixtures are…

Methodology · Statistics 2017-10-09 Sanjeena Subedi , Paul D. McNicholas

We introduce the concept of conjugate prior models for a given likelihood function in Bayesian spatial inversion. The conjugate class of prior models can be selection extended and still remain conjugate. We demonstrate the generality of…

Methodology · Statistics 2018-12-06 Henning Omre , Kjartan Rimstad