English
Related papers

Related papers: Small-noise approximation for Bayesian optimal exp…

200 papers

This paper offers a qualitative insight into the convergence of Bayesian parameter inference in a setup which mimics the modeling of the spread of a disease with associated disease measurements. Specifically, we are interested in the…

Statistics Theory · Mathematics 2022-12-08 Samuel Bronstein , Stefan Engblom , Robin Marin

Bayesian design of experiments and sample size calculations usually rely on complex Monte Carlo simulations in practice. Obtaining bounds on Bayesian notions of the false-positive rate and power therefore often lack closed-form or…

Methodology · Statistics 2025-02-06 Riko Kelter , Samuel Pawel

Within Bayesian state estimation, considerable effort has been devoted to incorporating constraints into state estimation for process optimization, state monitoring, fault detection and control. Nonetheless, in the domain of state-space…

Systems and Control · Electrical Eng. & Systems 2025-07-28 Rodrigo A. González , Angel L. Cedeño , Koen Tiels , Tom Oomen

Statistical applications often involve the calculation of intractable multidimensional integrals. The Laplace formula is widely used to approximate such integrals. However, in high-dimensional or small sample size problems, the shape of the…

Computation · Statistics 2016-12-30 Erlis Ruli , Nicola Sartori , Laura Ventura

Predictive coding (PC) accounts of perception now form one of the dominant computational theories of the brain, where they prescribe a general algorithm for inference and learning over hierarchical latent probabilistic models. Despite this,…

Machine Learning · Computer Science 2023-03-10 Umais Zahid , Qinghai Guo , Karl Friston , Zafeirios Fountas

One way to reduce the time of conducting optimization studies is to evaluate designs in parallel rather than just one-at-a-time. For expensive-to-evaluate black-boxes, batch versions of Bayesian optimization have been proposed. They work by…

Optimization and Control · Mathematics 2023-04-04 Mickael Binois , Nicholson Collier , Jonathan Ozik

This work considers an estimation task in compressive sensing, where the goal is to estimate an unknown signal from compressive measurements that are corrupted by additive pre-measurement noise (interference, or clutter) as well as…

Machine Learning · Statistics 2013-11-25 Swayambhoo Jain , Akshay Soni , Jarvis Haupt

Latent Gaussian models (LGMs) are a popular class of Bayesian hierarchical models that include Gaussian processes, as well as certain spatial models and mixed-effect models. Efficient Bayesian inference of LGMs often requires marginalizing…

Machine Learning · Statistics 2026-05-21 Jinlin Lai , Charles C. Margossian , Daniel R. Sheldon

The declining response rates in probability surveys along with the widespread availability of unstructured data has led to growing research into non-probability samples. Existing robust approaches are not well-developed for non-Gaussian…

Methodology · Statistics 2022-03-29 Ali Rafei , Michael R. Elliott , Carol A. C. Flannagan

This paper suggests a nonparametric scheme to find the sparse solution of the underdetermined system of linear equations in the presence of unknown impulsive or non-Gaussian noise. This approach is robust against any variations of the noise…

Computer Vision and Pattern Recognition · Computer Science 2012-01-16 Mahmoud Ramezani Mayiami , Babak Seyfe

The Laplace approximation is an old, but frequently used method to approximate integrals for Bayesian calculations. In this paper we develop an extension of the Laplace approximation, by applying it iteratively to the residual, i.e., the…

Computation · Statistics 2012-09-04 Björn Bornkamp

Large-scale variational quantum algorithms are widely recognized as a potential pathway to achieve practical quantum advantages. However, the presence of quantum noise might suppress and undermine these advantages, which blurs the…

Quantum Physics · Physics 2024-09-20 Yuguo Shao , Fuchuan Wei , Song Cheng , Zhengwei Liu

There is a growing demand for performing larger-scale Bayesian inference tasks, arising from greater data availability and higher-dimensional model parameter spaces. In this work we present parallelization strategies for the methodology of…

Computation · Statistics 2022-04-12 Lisa Gaedke-Merzhäuser , Janet van Niekerk , Olaf Schenk , Håvard Rue

We discuss a new method for setting limits on small signals in the presence of background noise. The method is based on a combination of a two dimensional confidence region and the large sample approximation to the likelihood ratio test…

High Energy Physics - Phenomenology · Physics 2009-10-31 Wolfgang A. Rolke , Angel M. Lopez

Stochastic approximation methods play a central role in maximum likelihood estimation problems involving intractable likelihood functions, such as marginal likelihoods arising in problems with missing or incomplete data, and in parametric…

Computation · Statistics 2020-06-02 Valentin De Bortoli , Alain Durmus , Marcelo Pereyra , Ana F. Vidal

We develop a computational procedure to estimate the covariance hyperparameters for semiparametric Gaussian process regression models with additive noise. Namely, the presented method can be used to efficiently estimate the variance of the…

Machine Learning · Computer Science 2022-06-22 Siavash Ameli , Shawn C. Shadden

We consider inverse problems with linear forward models and Gaussian priors, but with unknown hyperparameters that may arise from the model, the noise, or the specification of the prior. We model this using a hierarchical Bayes framework…

Numerical Analysis · Mathematics 2026-05-14 Elle Buser , Julianne Chung , Hugo Díaz , Arvind K. Saibaba

The United States Bureau of Labor Statistics collects data using survey instruments under informative sampling designs that assign probabilities of inclusion to be correlated with the response. The bureau extensively uses Bayesian…

Methodology · Statistics 2017-10-26 Terrance D. Savitsky , Sanvesh Srivastava

In many inference problems, the evaluation of complex and costly models is often required. In this context, Bayesian methods have become very popular in several fields over the last years, in order to obtain parameter inversion, model…

Computational Engineering, Finance, and Science · Computer Science 2021-07-21 Luca Martino , Víctor Elvira , Javier López-Santiago , Gustau Camps-Valls

Monte Carlo approximations for random linear elliptic PDE constrained optimization problems are studied. We use empirical process theory to obtain best possible mean convergence rates $O(n^{-\frac{1}{2}})$ for optimal values and solutions,…

Optimization and Control · Mathematics 2021-06-14 Werner Römisch , Thomas M. Surowiec