English
Related papers

Related papers: Marginal likelihood and model selection for Gaussi…

200 papers

The application of Bayesian inference for the purpose of model selection is very popular nowadays. In this framework, models are compared through their marginal likelihoods, or their quotients, called Bayes factors. However, marginal…

Methodology · Statistics 2022-07-27 F. Llorente , L. Martino , E. Curbelo , J. Lopez-Santiago , D. Delgado

Optimization is widely used in statistics, and often efficiently delivers point estimates on useful spaces involving structural constraints or combinatorial structure. To quantify uncertainty, Gibbs posterior exponentiates the negative loss…

Methodology · Statistics 2025-07-23 Cheng Zeng , Eleni Dilma , Jason Xu , Leo L Duan

This article is concerned with learning and stochastic control in physical systems which contain unknown input signals. These unknown signals are modeled as Gaussian processes (GP) with certain parametrized covariance structures. The…

Systems and Control · Computer Science 2018-08-15 Simo Särkkä , Mauricio A. Álvarez , Neil D. Lawrence

In this paper we present a novel methodology to perform Bayesian model selection in linear models with heavy-tailed distributions. We consider a finite mixture of distributions to model a latent variable where each component of the mixture…

Methodology · Statistics 2017-08-21 Flávio B Gonçalves , Marcos O. Prates , Victor H. Lachos

In Bayesian inference for the Cox proportional hazards model, modeling the baseline hazard function is challenging. Recently, direct Bayesian inference using the partial likelihood is considered in the framework of general Bayesian…

Methodology · Statistics 2026-04-29 Tomohiro Ohigashi , Shunichiro Orihara , Shonosuke Sugasawa

We propose a practical Bayesian optimization method using Gaussian process regression, of which the marginal likelihood is maximized where the number of model selection steps is guided by a pre-defined threshold. Since Bayesian optimization…

Machine Learning · Statistics 2020-10-19 Jungtaek Kim , Seungjin Choi

Analyzing data collected from multiple sources to estimate common and heterogeneous structures through a hierarchical model is a central task in Bayesian inference, and to this end, Bayesian factor models are one of the most widely used…

Methodology · Statistics 2026-03-04 Naoki Awaya , Keisuke Sasaki , Genya Kobayashi , Shonosuke Sugasawa

Laplace's method approximates a target density with a Gaussian distribution at its mode. It is computationally efficient and asymptotically exact for Bayesian inference due to the Bernstein-von Mises theorem, but for complex targets and…

Machine Learning · Computer Science 2026-03-12 Hanlin Yu , Marcelo Hartmann , Bernardo Williams , Mark Girolami , Arto Klami

The three and five-dimensional convex sets of two-level complex and quaternionic quantum systems are studied in the Bayesian thermostatistical framework introduced by Lavenda. Associated with a given parameterization of each such set is a…

Quantum Physics · Physics 2007-05-23 Paul B. Slater

We study the problem of learning latent variables in Gaussian graphical models. Existing methods for this problem assume that the precision matrix of the observed variables is the superposition of a sparse and a low-rank component. In this…

Machine Learning · Statistics 2017-07-12 Mohammadreza Soltani , Chinmay Hegde

Gaussian process state-space models (GPSSMs) provide a principled and flexible approach to modeling the dynamics of a latent state, which is observed at discrete-time points via a likelihood model. However, inference in GPSSMs is…

Machine Learning · Computer Science 2023-07-18 Xuhui Fan , Edwin V. Bonilla , Terence J. O'Kane , Scott A. Sisson

We introduce priors and algorithms to perform Bayesian inference in Gaussian models defined by acyclic directed mixed graphs. Such a class of graphs, composed of directed and bi-directed edges, is a representation of conditional…

Methodology · Statistics 2012-07-02 Ricardo Silva , Zoubin Ghahramani

Conditional independence models in the Gaussian case are algebraic varieties in the cone of positive definite covariance matrices. We study these varieties in the case of Bayesian networks, with a view towards generalizing the recursive…

Algebraic Geometry · Mathematics 2007-05-23 Seth Sullivant

Due to the ease of modern data collection, applied statisticians often have access to a large set of covariates that they wish to relate to some observed outcome. Generalized linear models (GLMs) offer a particularly interpretable framework…

Computation · Statistics 2019-05-21 Brian L. Trippe , Jonathan H. Huggins , Raj Agrawal , Tamara Broderick

In this article we consider Bayesian inference for partially observed Andersson-Madigan-Perlman (AMP) Gaussian chain graph (CG) models. Such models are of particular interest in applications such as biological networks and financial time…

Methodology · Statistics 2019-08-13 Deng Lu , Maria De Iorio , Ajay Jasra , Gary L. Rosner

We study learning problems in which the conditional distribution of the output given the input varies as a function of additional task variables. In varying-coefficient models with Gaussian process priors, a Gaussian process generates the…

Machine Learning · Computer Science 2015-10-15 Matthias Bussas , Christoph Sawade , Tobias Scheffer , Niels Landwehr

Statistical agencies and other institutions collect data under the promise to protect the confidentiality of respondents. When releasing microdata samples, the risk that records can be identified must be assessed. To this aim, a widely…

Applications · Statistics 2015-06-03 Cinzia Carota , Maurizio Filippone , Roberto Leombruni , Silvia Polettini

We consider the use of randomised forward models and log-likelihoods within the Bayesian approach to inverse problems. Such random approximations to the exact forward model or log-likelihood arise naturally when a computationally expensive…

Statistics Theory · Mathematics 2019-10-29 H. C. Lie , T. J. Sullivan , A. L. Teckentrup

Recent work in scalable approximate Gaussian process regression has discussed a bias-variance-computation trade-off when estimating the log marginal likelihood. We suggest a method that adaptively selects the amount of computation to use…

Machine Learning · Statistics 2021-09-21 David R. Burt , Artem Artemev , Mark van der Wilk

For predictive modeling relying on Bayesian inversion, fully independent, or ``mean-field'', Gaussian distributions are often used as approximate probability density functions in variational inference since the number of variational…

Methodology · Statistics 2023-07-14 Wyatt Bridgman , Reese Jones , Mohammad Khalil