English
Related papers

Related papers: Simulation-efficient shortest probability interval…

200 papers

Bayesian methods are appealing in their flexibility in modeling complex data and ability in capturing uncertainty in parameters. However, when Bayes' rule does not result in tractable closed-form, most approximate inference algorithms lack…

Machine Learning · Computer Science 2016-05-09 Bo Dai , Niao He , Hanjun Dai , Le Song

High-dimensional simulation optimization is notoriously challenging. We propose a new sampling algorithm that converges to a global optimal solution and suffers minimally from the curse of dimensionality. The algorithm consists of two…

Machine Learning · Statistics 2021-07-21 Liang Ding , Rui Tuo , Xiaowei Zhang

This paper presents a novel approach for approximate integration over the uncertainty of noise and signal variances in Gaussian process (GP) regression. Our efficient and straightforward approach can also be applied to integration over…

Machine Learning · Statistics 2017-12-18 Ville Tolvanen , Pasi Jylänki , Aki Vehtari

Bootstrap smoothed (bagged) parameter estimators have been proposed as an improvement on estimators found after preliminary data-based model selection. The key result of Efron (2014) is a very convenient and widely applicable formula for a…

Methodology · Statistics 2019-04-29 Paul Kabaila , Christeen Wijethunga

Bayesian inference is useful to obtain a predictive distribution with a small generalization error. However, since posterior distributions are rarely evaluated analytically, we employ the variational Bayesian inference or sampling method to…

Machine Learning · Computer Science 2025-09-03 Yohei Saito , Shun Kimura , Koujin Takeda

We propose a randomized physics-informed neural network (PINN) or rPINN method for uncertainty quantification in inverse partial differential equation (PDE) problems with noisy data. This method is used to quantify uncertainty in the…

Machine Learning · Computer Science 2024-07-08 Yifei Zong , David Barajas-Solano , Alexandre M. Tartakovsky

This article explores combinations of weighted bootstraps, like the Bayesian bootstrap, with the bootstrap $t$ method for setting approximate confidence intervals for the mean of a random variable in small samples. For this problem the…

Statistics Theory · Mathematics 2025-08-21 Art B. Owen

We develop a method to estimate the spin-spin interactions in the Hamiltonian from the observed magnetization curve by machine learning based on Bayesian inference. In our method, plausible spin-spin interactions are determined by…

Statistical Mechanics · Physics 2018-03-08 Ryo Tamura , Koji Hukushima

The declining response rates in probability surveys along with the widespread availability of unstructured data has led to growing research into non-probability samples. Existing robust approaches are not well-developed for non-Gaussian…

Methodology · Statistics 2022-03-29 Ali Rafei , Michael R. Elliott , Carol A. C. Flannagan

An empirical Bayes approach to the estimation of possibly sparse sequences observed in Gaussian white noise is set out and investigated. The prior considered is a mixture of an atom of probability at zero and a heavy-tailed density \gamma,…

Statistics Theory · Mathematics 2007-06-13 Iain M. Johnstone , Bernard W. Silverman

Penalized spline regression is a popular method for scatterplot smoothing, but there has long been a debate on how to construct confidence intervals for penalized spline fits. Due to the penalty, the fitted smooth curve is a biased estimate…

Methodology · Statistics 2017-06-06 Ning Dai

The Bayesian lasso is well-known as a Bayesian alternative for Lasso. Although the advantage of the Bayesian lasso is capable of full probabilistic uncertain quantification for parameters, the corresponding posterior distribution can be…

Methodology · Statistics 2022-07-06 Jun Kawakami , Shintaro Hashimoto

We consider a novel Bayesian approach to estimation, uncertainty quantification, and variable selection for a high-dimensional linear regression model under sparsity. The number of predictors can be nearly exponentially large relative to…

Methodology · Statistics 2025-02-28 Samhita Pal , Subhashis Ghoshal

Bayesian formulation of modern day signal processing problems has called for improved Markov chain Monte Carlo (MCMC) sampling algorithms for inference. The need for efficient sampling techniques has become indispensable for high…

Computation · Statistics 2025-10-28 Apratim Shukla , Dootika Vats , Eric C. Chi

Prior information often takes the form of parameter constraints. Bayesian methods include such information through prior distributions having constrained support. By using posterior sampling algorithms, one can quantify uncertainty without…

Methodology · Statistics 2018-09-25 Leo L Duan , Alexander L Young , Akihiko Nishimura , David B Dunson

Motivated by the growing popularity of variants of the Wasserstein distance in statistics and machine learning, we study statistical inference for the Sliced Wasserstein distance--an easily computable variant of the Wasserstein distance.…

Statistics Theory · Mathematics 2022-04-05 Tudor Manole , Sivaraman Balakrishnan , Larry Wasserman

Spatial modelling often uses Gaussian random fields to capture the stochastic nature of studied phenomena. However, this approach incurs significant computational burdens (O(n3)), primarily due to covariance matrix computations. In this…

Methodology · Statistics 2024-04-22 Joaquin Cavieres , Paula Moraga , Cole C. Monnahan

We aim to incorporate variable selection routines into variable-by-variable (or sequential) imputation in clustered data to achieve computational improvement in applications with large-scale health data. Specifically, we utilize variable…

Methodology · Statistics 2025-04-08 Qiushuang Li , Recai Yucel

This paper introduces smoothed pseudo-population bootstrap methods for the purposes of variance estimation and the construction of confidence intervals for finite population quantiles. In an i.i.d. context, it has been shown that resampling…

Methodology · Statistics 2025-09-30 Vanessa McNealis , Christian Léger

The mean field variational Bayes (VB) algorithm implemented in Stan is relatively fast and efficient, making it feasible to produce model-estimated official statistics on a rapid timeline. Yet, while consistent point estimates of parameters…

Methodology · Statistics 2024-07-08 Terrance D. Savitsky , Julie Gershunskaya