English
Related papers

Related papers: Likelihood-informed dimension reduction across tem…

200 papers

PAC-Bayesian algorithms and Gibbs posteriors are gaining popularity due to their robustness against model misspecification even when Bayesian inference is inconsistent. The PAC-Bayesian alpha-posterior is a generalization of the standard…

Machine Learning · Computer Science 2020-04-23 Lucie Perrotta

We introduce a Bayesian model for inferring mixtures of subspaces of different dimensions. The key challenge in such a mixture model is specification of prior distributions over subspaces of different dimensions. We address this challenge…

Statistics Theory · Mathematics 2015-09-24 Brian St. Thomas , Lizhen Lin , Lek-Heng Lim , Sayan Mukherjee

Bayesian posterior distributions arising in modern applications, including inverse problems in partial differential equation models in tomography and subsurface flow, are often computationally intractable due to the large computational cost…

Machine Learning · Statistics 2023-02-10 Tapio Helin , Andrew Stuart , Aretha Teckentrup , Konstantinos Zygalakis

Factor models are widely used for dimension reduction. Bayesian approaches to these models often place a prior on the factor loadings that allows for infinitely many factors, with loadings increasingly shrunk toward zero as the column index…

Methodology · Statistics 2026-03-31 Shicheng Liu , Qingping Zhou , Yanan Fan , Xiongwen Ke

When complex Bayesian models exhibit implausible behaviour, one solution is to assemble available information into an informative prior. Challenges arise as prior information is often only available for the observable quantity, or some…

Methodology · Statistics 2026-03-18 Andrew A. Manderson , Robert J. B. Goudie

A strategy is presented to incorporate prior information from conceptual geological models in probabilistic inversion of geophysical data. The conceptual geological models are represented by multiple-point statistics training images (TIs)…

Geophysics · Physics 2017-01-06 T. Lochbühler , J. A. Vrugt , M. Sadegh , N. Linde

Bayesian likelihood-free methods implement Bayesian inference using simulation of data from the model to substitute for intractable likelihood evaluations. Most likelihood-free inference methods replace the full data set with a summary…

Methodology · Statistics 2020-10-16 Yinan Mao , Xueou Wang , David J. Nott , Michael Evans

Parametric stochastic simulators are ubiquitous in science, often featuring high-dimensional input parameters and/or an intractable likelihood. Performing Bayesian parameter inference in this context can be challenging. We present a neural…

Machine Learning · Statistics 2021-10-27 Benjamin Kurt Miller , Alex Cole , Patrick Forré , Gilles Louppe , Christoph Weniger

Generative models and those with computationally intractable likelihoods are widely used to describe complex systems in the natural sciences, social sciences, and engineering. Fitting these models to data requires likelihood-free inference…

Methodology · Statistics 2025-12-04 Rui Zhang , Oksana A. Chkrebtii , Dongbin Xiu

We consider Bayesian optimization of an expensive-to-evaluate black-box objective function, where we also have access to cheaper approximations of the objective. In general, such approximations arise in applications such as reinforcement…

Machine Learning · Statistics 2016-11-16 Matthias Poloczek , Jialei Wang , Peter I. Frazier

The Laplace approximation (LA) to posteriors is a ubiquitous tool to simplify Bayesian computation, particularly in the high-dimensional settings arising in Bayesian inverse problems. Precisely quantifying the LA accuracy is a challenging…

Statistics Theory · Mathematics 2025-09-10 Anya Katsevich , Vladimir Spokoiny

We develop a novel method for carrying out model selection for Bayesian autoencoders (BAEs) by means of prior hyper-parameter optimization. Inspired by the common practice of type-II maximum likelihood optimization and its equivalence to…

This paper presents a study of the large-sample behavior of the posterior distribution of a structural parameter which is partially identified by moment inequalities. The posterior density is derived based on the limited information…

Statistics Theory · Mathematics 2010-01-13 Yuan Liao , Wenxin Jiang

Bayesian predictive inference provides a coherent description of entire predictive uncertainty through predictive distributions. We examine several widely used sparsity priors from the predictive (as opposed to estimation) inference…

Statistics Theory · Mathematics 2024-06-03 Veronika Rockova

Plasma diagnostics often employ computerized tomography to estimate emissivity profiles from a finite, and often limited, number of line-integrated measurements. Decades of algorithmic refinement have brought considerable improvements, and…

Plasma Physics · Physics 2026-03-12 D. Hamm , C. Theiler , M. Simeoni , B. P. Duval , T. Debarre , L. Simons , J. R. Queralt

Semi-structured regression models enable the joint modeling of interpretable structured and complex unstructured feature effects. The structured model part is inspired by statistical models and can be used to infer the input-output…

Machine Learning · Computer Science 2024-01-24 Daniel Dold , David Rügamer , Beate Sick , Oliver Dürr

In the time of Big Data, training complex models on large-scale data sets is challenging, making it appealing to reduce data volume for saving computation resources by subsampling. Most previous works in subsampling are weighted methods…

Machine Learning · Computer Science 2021-04-14 Zifeng Wang , Hong Zhu , Zhenhua Dong , Xiuqiang He , Shao-Lun Huang

Modern applications routinely collect high-dimensional data, leading to statistical models having more parameters than there are samples available. A common solution is to impose sparsity in parameter estimation, often using penalized…

Methodology · Statistics 2025-07-08 Paolo Onorati , David B. Dunson , Antonio Canale

Robust Bayesian inference using density power divergence (DPD) has emerged as a promising approach for handling outliers in statistical estimation. Although the DPD-based posterior offers theoretical guarantees of robustness, its practical…

Methodology · Statistics 2025-12-11 Naruki Sonobe , Tomotaka Momozaki , Tomoyuki Nakagawa

In this article, we study the binary classification problem with supervised data, in the case where the covariate-to-probability-of-success map is possibly spatially inhomogeneous. We devise nonparametric Bayesian procedures with…

Statistics Theory · Mathematics 2025-09-10 Matteo Giordano