English
Related papers

Related papers: Self-Supervised Laplace Approximation for Bayesian…

200 papers

Bayesian estimation is a powerful theoretical paradigm for the operation of quantum sensors. However, the Bayesian method for statistical inference generally suffers from demanding calibration requirements that have so far restricted its…

Quantum Physics · Physics 2021-09-22 Samuel P. Nolan , Augusto Smerzi , Luca Pezzè

Learning a sequence of tasks without access to i.i.d. observations is a widely studied form of continual learning (CL) that remains challenging. In principle, Bayesian learning directly applies to this setting, since recursive and one-off…

Estimation of parameters that obey specific constraints is crucial in statistics and machine learning; for example, when parameters are required to satisfy boundedness, monotonicity, or linear inequalities. Traditional approaches impose…

Methodology · Statistics 2026-04-03 Lachlan Astfalck , Deborshee Sen , Sayan Patra , Edward Cripps , David Dunson

In a Bayesian inverse problem setting, the solution consists of a posterior measure obtained by combining prior belief, information about the forward operator, and noisy observational data. This measure is most often given in terms of a…

Probability · Mathematics 2017-04-12 Philipp Wacker

Approximate Bayesian computation (ABC) methods, which are applicable when the likelihood is difficult or impossible to calculate, are an active topic of current research. Most current ABC algorithms directly approximate the posterior…

Computation · Statistics 2012-12-10 Y. Fan , D. J. Nott , S. A. Sisson

Approximate Bayesian Computation (ABC) is a useful class of methods for Bayesian inference when the likelihood function is computationally intractable. In practice, the basic ABC algorithm may be inefficient in the presence of discrepancy…

Statistics Theory · Mathematics 2015-05-14 Stefano Cabras , Maria Eugenia Castellanos Nueda , Erlis Ruli

Two major bottlenecks to the solution of large-scale Bayesian inverse problems are the scaling of posterior sampling algorithms to high-dimensional parameter spaces and the computational cost of forward model evaluations. Yet incomplete or…

Computation · Statistics 2016-05-03 Tiangang Cui , Youssef M. Marzouk , Karen E. Willcox

Bayesian deep learning (BDL) is a promising approach to achieve well-calibrated predictions on distribution-shifted data. Nevertheless, there exists no large-scale survey that evaluates recent SOTA methods on diverse, realistic, and…

Machine Learning · Computer Science 2023-10-26 Florian Seligmann , Philipp Becker , Michael Volpp , Gerhard Neumann

We present asymptotic results for the regression-adjusted version of approximate Bayesian computation introduced by Beaumont(2002). We show that for an appropriate choice of the bandwidth, regression adjustment will lead to a posterior…

Statistics Theory · Mathematics 2017-11-29 Wentao Li , Paul Fearnhead

We propose a method to improve the efficiency and accuracy of amortized Bayesian inference by leveraging universal symmetries in the joint probabilistic model of parameters and data. In a nutshell, we invert Bayes' theorem and estimate the…

Machine Learning · Computer Science 2024-07-24 Marvin Schmitt , Desi R. Ivanova , Daniel Habermann , Ullrich Köthe , Paul-Christian Bürkner , Stefan T. Radev

Although the Laplace approximation offers a simple route to uncertainty quantification in deep neural networks, its reliance on inverting large Hessian matrices has motivated a range of computationally feasible low-dimensional or sparse…

Machine Learning · Statistics 2026-05-12 Swarnali Raha , Kshitij Khare , Rohit K Patra

Empirical likelihood is a popular nonparametric statistical tool that does not require any distributional assumptions. In this paper, we explore the possibility of conducting variable selection via Bayesian empirical likelihood. We show…

Methodology · Statistics 2022-06-13 Yichen Cheng , Yichuan Zhao

Uncertainty quantification is an important task in machine learning - a task in which standardneural networks (NNs) have traditionally not excelled. This can be a limitation for safety-critical applications, where uncertainty-aware methods…

Machine Learning · Computer Science 2024-01-05 Felix Fiedler , Sergio Lucia

Bayesian predictive inference propagates parameter uncertainty to quantities of interest through the posterior-predictive distribution. In practice, this is typically performed using a two-stage procedure: first approximating the posterior…

Machine Learning · Statistics 2026-05-06 Nan Feng , Xun Huan

Parametric Bayesian modeling offers a powerful and flexible toolbox for machine learning. Yet the model, however detailed, may still be wrong, and this can make inferences untrustworthy. In this paper we introduce a new class of…

Methodology · Statistics 2026-04-03 Bohan Wu , Eli N. Weinstein , Sohrab Salehi , Yixin Wang , David M. Blei

Bayesian synthetic likelihood is a widely used approach for conducting Bayesian analysis in complex models where evaluation of the likelihood is infeasible but simulation from the assumed model is tractable. We analyze the behaviour of the…

Statistics Theory · Mathematics 2026-04-17 David T. Frazier , Christopher Drovandi , David J. Nott

Self-supervised learning has emerged as a major technique for the task of learning from unlabeled data, where the current methods mostly revolve around alignment of representations and input recon struction. Although such approaches have…

Machine Learning · Computer Science 2026-04-16 Mintu Dutta , Ritesh Vyas , Mohendra Roy

Penalized B-splines are routinely used in additive models to describe smooth changes in a response with quantitative covariates. It is typically done through the conditional mean in the exponential family using generalized additive models…

Methodology · Statistics 2020-05-12 Philippe Lambert

The Bayesian lasso is well-known as a Bayesian alternative for Lasso. Although the advantage of the Bayesian lasso is capable of full probabilistic uncertain quantification for parameters, the corresponding posterior distribution can be…

Methodology · Statistics 2022-07-06 Jun Kawakami , Shintaro Hashimoto

In a bivariate meta-analysis the number of diagnostic studies involved is often very low so that frequentist methods may result in problems. Bayesian inference is attractive as informative priors that add small amount of information can…

Methodology · Statistics 2015-12-22 Jingyi Guo , Håvard Rue , Andrea Riebler