English
Related papers

Related papers: Prior-preconditioned conjugate gradient method for…

200 papers

We propose a flexible class of models based on scale mixture of uniform distributions to construct shrinkage priors for covariance matrix estimation. This new class of priors enjoys a number of advantages over the traditional scale mixture…

Methodology · Statistics 2011-10-07 Hao Wang , Natesh S. Pillai

Non-conjugate Gaussian processes (NCGPs) define a flexible probabilistic framework to model categorical, ordinal and continuous data, and are widely used in practice. However, exact inference in NCGPs is prohibitively expensive for large…

Machine Learning · Computer Science 2025-04-18 Lukas Tatzel , Jonathan Wenger , Frank Schneider , Philipp Hennig

Developing suitable approximate models for analyzing and simulating complex nonlinear systems is practically important. This paper aims at exploring the skill of a rich class of nonlinear stochastic models, known as the conditional Gaussian…

Numerical Analysis · Mathematics 2022-06-01 Nan Chen , Yingda Li , Honghu Liu

This work introduces a Bayesian methodology for fitting large discrete graphical models with spike-and-slab priors to encode sparsity. We consider a quasi-likelihood approach that enables node-wise parallel computation resulting in reduced…

Methodology · Statistics 2019-10-21 Anwesha Bhattacharyya , Yves Atchade

Gaussian mixture models are a popular tool for model-based clustering, and mixtures of factor analyzers are Gaussian mixture models having parsimonious factor covariance structure for mixture components. There are several recent extensions…

Methodology · Statistics 2023-06-29 Lucas Kock , Nadja Klein , David J. Nott

As a non-parametric Bayesian model which produces informative predictive distribution, Gaussian process (GP) has been widely used in various fields, like regression, classification and optimization. The cubic complexity of standard GP…

Machine Learning · Statistics 2018-11-06 Haitao Liu , Jianfei Cai , Yew-Soon Ong , Yi Wang

In order to scale standard Gaussian process (GP) regression to large-scale datasets, aggregation models employ factorized training process and then combine predictions from distributed experts. The state-of-the-art aggregation models,…

Machine Learning · Statistics 2018-06-05 Haitao Liu , Jianfei Cai , Yi Wang , Yew-Soon Ong

In the framework of Bayesian model-based clustering based on a finite mixture of Gaussian distributions, we present a joint approach to estimate the number of mixture components and identify cluster-relevant variables simultaneously as well…

Methodology · Statistics 2016-06-23 Gertraud Malsiner-Walli , Sylvia Frühwirth-Schnatter , Bettina Grün

Modern applications routinely collect high-dimensional data, leading to statistical models having more parameters than there are samples available. A common solution is to impose sparsity in parameter estimation, often using penalized…

Methodology · Statistics 2025-07-08 Paolo Onorati , David B. Dunson , Antonio Canale

Regression models for dichotomous data are ubiquitous in statistics. Besides being useful for inference on binary responses, these methods serve also as building blocks in more complex formulations, such as density regression, nonparametric…

Methodology · Statistics 2019-11-19 Daniele Durante

We consider a novel Bayesian approach to estimation, uncertainty quantification, and variable selection for a high-dimensional linear regression model under sparsity. The number of predictors can be nearly exponentially large relative to…

Methodology · Statistics 2025-02-28 Samhita Pal , Subhashis Ghoshal

Bayesian causal discovery aims to infer the posterior distribution over causal models from observed data, quantifying epistemic uncertainty and benefiting downstream tasks. However, computational challenges arise due to joint inference over…

Machine Learning · Computer Science 2023-12-11 Yashas Annadani , Nick Pawlowski , Joel Jennings , Stefan Bauer , Cheng Zhang , Wenbo Gong

Bayesian estimation methods for sparse blind deconvolution problems conventionally employ Bernoulli-Gaussian (BG) prior for modeling sparse sequences and utilize Markov Chain Monte Carlo (MCMC) methods for the estimation of unknowns.…

Methodology · Statistics 2021-08-30 Burak Cevat Civek , Emre Ertin

The efficient solution of large-scale multiterm linear matrix equations is a challenging task in numerical linear algebra, and it is a largely open problem. We propose a new iterative scheme for symmetric and positive definite operators,…

Numerical Analysis · Mathematics 2025-05-27 Davide Palitta , Martina Iannacito , Valeria Simoncini

Bounded continuous responses -- such as proportions -- arise frequently in diverse scientific fields including climatology, biostatistics, and finance. Beta regression is a widely adopted framework for modeling such data, due to the…

Methodology · Statistics 2025-05-29 The Tien Mai

In practical computations, the (preconditioned) conjugate gradient (P)CG method is the iterative method of choice for solving systems of linear algebraic equations $Ax=b$ with a real symmetric positive definite matrix $A$. During the…

Numerical Analysis · Mathematics 2021-01-12 Gérard Meurant , Jan Papež , Petr Tichý

We consider a class of colored graphical Gaussian models obtained by placing symmetry constraints on the precision matrix in a Bayesian framework. The prior distribution on the precision matrix is the colored $G$-Wishart prior which is the…

Methodology · Statistics 2020-04-03 Qiong Li , Xin Gao , Helene Massam

Nonparametric regression for massive numbers of samples (n) and features (p) is an increasingly important problem. In big n settings, a common strategy is to partition the feature space, and then separately apply simple models to each…

Machine Learning · Statistics 2014-06-10 Rajarshi Guhaniyogi , David B. Dunson

A conventional Bayesian approach to prediction uses the posterior distribution to integrate out parameters in a density for unobserved data conditional on the observed data and parameters. When the true posterior is intractable, it is…

Methodology · Statistics 2026-02-27 Lucas Kock , Scott A. Sisson , G. S. Rodrigues , David J. Nott

Mixtures of experts have become an indispensable tool for flexible modelling in a supervised learning context, allowing not only the mean function but the entire density of the output to change with the inputs. Sparse Gaussian processes…

Machine Learning · Computer Science 2024-01-23 Clement Etienam , Kody Law , Sara Wade , Vitaly Zankin