English
Related papers

Related papers: Scalable Bayes under Informative Sampling

200 papers

It is well known that the Lasso can be interpreted as a Bayesian posterior mode estimate with a Laplacian prior. Obtaining samples from the full posterior distribution, the Bayesian Lasso, confers major advantages in performance as compared…

Computation · Statistics 2018-01-09 Marcela Mendoza , Alexis Allegra , Todd P. Coleman

Clustering is widely studied in statistics and machine learning, with applications in a variety of fields. As opposed to classical algorithms which return a single clustering solution, Bayesian nonparametric models provide a posterior over…

Methodology · Statistics 2019-02-11 Sara Wade , Zoubin Ghahramani

We introduce a novel Bayesian approach for both covariate selection and sparse precision matrix estimation in the context of high-dimensional Gaussian graphical models involving multiple responses. Our approach provides a sparse estimation…

Methodology · Statistics 2024-09-25 Anwesha Chakravarti , Naveen N. Narishetty , Feng Liang

Implicit stochastic models, where the data-generation distribution is intractable but sampling is possible, are ubiquitous in the natural sciences. The models typically have free parameters that need to be inferred from data collected in…

Machine Learning · Statistics 2020-08-17 Steven Kleinegesse , Michael U. Gutmann

Bayesian experimental design (BED) is to answer the question that how to choose designs that maximize the information gathering. For implicit models, where the likelihood is intractable but sampling is possible, conventional BED methods…

Machine Learning · Computer Science 2021-03-16 Jiaxin Zhang , Sirui Bi , Guannan Zhang

In Bayesian inverse problems, the posterior distribution is used to quantify uncertainty about the reconstructed solution. In practice, Markov chain Monte Carlo algorithms often are used to draw samples from the posterior distribution.…

Numerical Analysis · Mathematics 2018-03-13 D. Andrew Brown , Arvind Saibaba , Sarah Vallélian

Hierarchical models in Bayesian inverse problems are characterized by an assumed prior probability distribution for the unknown state and measurement error precision, and hyper-priors for the prior parameters. Combining these probability…

Computation · Statistics 2019-06-10 Arvind K. Saibaba , Johnathan Bardsley , D. Andrew Brown , Alen Alexanderian

In this article, we present data-subsetting algorithms that allow for the approximate and scalable implementation of the Bayesian bootstrap. They are analogous to two existing algorithms in the frequentist literature: the bag of little…

Computation · Statistics 2019-03-25 Andrés F. Barrientos , Víctor Peña

We consider Bayesian model selection in generalized linear models that are high-dimensional, with the number of covariates p being large relative to the sample size n, but sparse in that the number of active covariates is small compared to…

Statistics Theory · Mathematics 2011-12-26 Rina Foygel , Mathias Drton

We study Bayesian methods for large-scale linear inverse problems, focusing on the challenging task of hyperparameter estimation. Typical hierarchical Bayesian formulations that follow a Markov Chain Monte Carlo approach are possible for…

Numerical Analysis · Mathematics 2024-01-05 Khalil A Hall-Hooper , Arvind K Saibaba , Julianne Chung , Scot M Miller

We analyze binary data, available for a relatively large number (big data) of families (or households), which are within small areas, from a population-based survey. Inference is required for the finite population proportion of individuals…

Methodology · Statistics 2018-06-04 Balgobin Nandram , Lu Chen , Shuting Fu , Binod Manandhar

In calculating expected information gain in optimal Bayesian experimental design, the computation of the inner loop in the classical double-loop Monte Carlo requires a large number of samples and suffers from underflow if the number of…

Numerical Analysis · Mathematics 2018-04-04 Joakim Beck , Ben Mansour Dia , Luis FR Espath , Quan Long , Raul Tempone

Achieving robust uncertainty quantification for deep neural networks represents an important requirement in many real-world applications of deep learning such as medical imaging where it is necessary to assess the reliability of a neural…

Machine Learning · Computer Science 2024-03-15 Tim Rensmeyer , Oliver Niggemann

Online sampling-supported visual analytics is increasingly important, as it allows users to explore large datasets with acceptable approximate answers at interactive rates. However, existing online spatiotemporal sampling techniques are…

This paper introduces "Semantic Scaling," a novel method for ideal point estimation from text. I leverage large language models to classify documents based on their expressed stances and extract survey-like data. I then use item response…

Computation and Language · Computer Science 2024-05-07 Michael Burnham

Bayesian Image-on-Scalar Regression (ISR) provides flexible, uncertainty-aware neuroimaging analysis. However, applying ISR to large-scale datasets such as the UK Biobank is challenging due to intensive computational demands and the need to…

Applications · Statistics 2026-02-09 Yuliang Xu , Timothy D. Johnson , Thomas E. Nichols , Jian Kang

In all areas of human knowledge, datasets are increasing in both size and complexity, creating the need for richer statistical models. This trend is also true for economic data, where high-dimensional and nonlinear/nonparametric inference…

Econometrics · Economics 2021-12-23 Dimitris Korobilis , Kenichi Shimizu

Bayesian regression remains a simple but effective tool based on Bayesian inference techniques. For large-scale applications, with complicated posterior distributions, Markov Chain Monte Carlo methods are applied. To improve the well-known…

Computation · Statistics 2020-09-28 Joris Tavernier , Jaak Simm , Adam Arany , Karl Meerbergen , Yves Moreau

Bayesian optimization (BO) provides a powerful framework for optimizing black-box, expensive-to-evaluate functions. It is therefore an attractive tool for engineering design problems, typically involving multiple objectives. Thanks to the…

Machine Learning · Computer Science 2024-09-06 Navid Ansari , Alireza Javanmardi , Eyke Hüllermeier , Hans-Peter Seidel , Vahid Babaei

Bayesian models provide recursive inference naturally because they can formally reconcile new data and existing scientific information. However, popular use of Bayesian methods often avoids priors that are based on exact posterior…

Methodology · Statistics 2019-04-29 Mevin B. Hooten , Devin S. Johnson , Brian M. Brost