English
Related papers

Related papers: BALSON: Bayesian Least Squares Optimization with N…

200 papers

Many recently developed Bayesian methods have focused on sparse signal detection. However, much less work has been done addressing the natural follow-up question: how to make valid inferences for the magnitude of those signals after…

Methodology · Statistics 2021-03-02 Spencer Woody , Oscar Hernan Madrid Padilla , James G. Scott

The Poisson distribution arises naturally when dealing with data involving counts, and it has found many applications in inverse problems and imaging. In this work, we develop an approximate Bayesian inference technique based on expectation…

Numerical Analysis · Mathematics 2019-09-04 Chen Zhang , Simon Arridge , Bangti Jin

We propose a novel approach to Bayesian analysis that is provably robust to outliers in the data and often has computational advantages over standard methods. Our technique is based on splitting the data into non-overlapping subgroups,…

Statistics Theory · Mathematics 2016-06-03 Stanislav Minsker , Sanvesh Srivastava , Lizhen Lin , David B. Dunson

Portfolio optimization is a critical task in investment. Most existing portfolio optimization methods require information on the distribution of returns of the assets that make up the portfolio. However, such distribution information is…

Econometrics · Economics 2025-10-09 Masahiro Kato , Kentaro Baba , Hibiki Kaibuchi , Ryo Inokuchi

In the statistical problem of denoising, Bayes and empirical Bayes methods can "overshrink" their output relative to the latent variables of interest. This work is focused on constrained denoising problems which mitigate such phenomena. At…

Methodology · Statistics 2025-07-01 Adam Quinn Jaffe , Nikolaos Ignatiadis , Bodhisattva Sen

Gaussian Bayesian networks (a.k.a. linear Gaussian structural equation models) are widely used to model causal interactions among continuous variables. In this work, we study the problem of learning a fixed-structure Gaussian Bayesian…

Data Structures and Algorithms · Computer Science 2022-10-19 Arnab Bhattacharyya , Davin Choo , Rishikesh Gajjala , Sutanu Gayen , Yuhao Wang

Popular deterministic approximations of posterior distributions from, e.g. the Laplace method, variational Bayes and expectation-propagation, generally rely on symmetric approximating families, often taken to be Gaussian. This choice…

Methodology · Statistics 2026-01-19 Francesco Pozza , Daniele Durante , Botond Szabo

Parameter ensembles or sets of point estimates constitute one of the cornerstones of modern statistical practice. This is especially the case in Bayesian hierarchical models, where different decision-theoretic frameworks can be deployed to…

Methodology · Statistics 2011-06-10 Cedric E. Ginestet , Nicky G. Best , Sylvia Richardson

The generation of decision-theoretic Bayesian optimal designs is complicated by the significant computational challenge of minimising an analytically intractable expected loss function over a, potentially, high-dimensional design space. A…

Methodology · Statistics 2017-02-07 Antony M. Overstall , James M. McGree , Christopher C. Drovandi

This article deals with random projections applied as a data reduction technique for Bayesian regression analysis. We show sufficient conditions under which the entire $d$-dimensional distribution is approximately preserved under random…

Many cosmological models have only a finite number of parameters of interest, but a very expensive data-generating process and an intractable likelihood function. We address the problem of performing likelihood-free Bayesian inference from…

Cosmology and Nongalactic Astrophysics · Physics 2018-09-14 Florent Leclercq

We develop a novel method for carrying out model selection for Bayesian autoencoders (BAEs) by means of prior hyper-parameter optimization. Inspired by the common practice of type-II maximum likelihood optimization and its equivalence to…

The generalized negative binomial distribution (GNB) is a new flexible family of discrete distributions that are mixed Poisson laws with the mixing generalized gamma (GG) distributions. This family of discrete distributions is very wide and…

Methodology · Statistics 2018-09-18 Andrey K. Gorshenin , Victor Yu. Korolev

Data-driven risk analysis involves the inference of probability distributions from measured or simulated data. In the case of a highly reliable system, such as the electricity grid, the amount of relevant data is often exceedingly limited,…

Methodology · Statistics 2017-07-11 Simon H. Tindemans , Goran Strbac

Current approaches in approximate inference for Bayesian neural networks minimise the Kullback-Leibler divergence to approximate the true posterior over the weights. However, this approximation is without knowledge of the final application,…

Machine Learning · Statistics 2018-05-11 Adam D. Cobb , Stephen J. Roberts , Yarin Gal

Bayesian Last Layer (BLL) models focus solely on uncertainty in the output layer of neural networks, demonstrating comparable performance to more complex Bayesian models. However, the use of Gaussian priors for last layer weights in…

Machine Learning · Computer Science 2024-08-08 Jian Xu , Zhiqi Lin , Shigui Li , Min Chen , Junmei Yang , Delu Zeng , John Paisley

This paper proposes a Bayesian method for estimating the parameters of a normal distribution when only limited summary statistics (sample mean, minimum, maximum, and sample size) are available. To estimate the parameters of a normal…

Methodology · Statistics 2024-11-21 Tomoki Matsumoto

Some statistical models are specified via a data generating process for which the likelihood function cannot be computed in closed form. Standard likelihood-based inference is then not feasible but the model parameters can be inferred by…

Computation · Statistics 2015-02-20 Michael U. Gutmann , Jukka Corander , Ritabrata Dutta , Samuel Kaski

Bayesian parameter inference depends on a choice of prior probability distribution for the parameters in question. The prior which makes the posterior distribution maximally sensitive to data is called the Jeffreys prior, and it is…

Cosmology and Nongalactic Astrophysics · Physics 2019-02-25 Steen Hannestad , Thomas Tram

Bayesian analysis plays a crucial role in estimating distribution of unknown parameters for given data and model. Due to the curse of dimensionality, it becomes difficult for high-dimensional problems, especially when multiple modes exist.…

Methodology · Statistics 2025-07-18 Zihan Liao , Binbin Li , Hua-Ping Wan