English
Related papers

Related papers: Functional Estimation of the Marginal Likelihood

200 papers

Monte Carlo methods to evaluate and maximize the likelihood function enable the construction of confidence intervals and hypothesis tests, facilitating scientific investigation using models for which the likelihood function is intractable.…

Methodology · Statistics 2017-02-13 Edward L. Ionides , Carles Breto , Joonha Park , Richard A. Smith , Aaron A. King

The marginal likelihood plays an important role in many areas of Bayesian statistics such as parameter estimation, model comparison, and model averaging. In most applications, however, the marginal likelihood is not analytically tractable…

To conduct Bayesian inference with large data sets, it is often convenient or necessary to distribute the data across multiple machines. We consider a likelihood function expressed as a product of terms, each associated with a subset of the…

Computation · Statistics 2020-04-09 Lewis J. Rendell , Adam M. Johansen , Anthony Lee , Nick Whiteley

Computing the marginal likelihood (ML) of a model requires marginalizing out all of the parameters and latent variables, a difficult high-dimensional summation or integration problem. To make matters worse, it is often hard to measure the…

Machine Learning · Statistics 2015-11-10 Roger B. Grosse , Zoubin Ghahramani , Ryan P. Adams

We introduce a powerful and flexible MCMC algorithm for stochastic simulation. The method builds on a pseudo-marginal method originally introduced in [Genetics 164 (2003) 1139--1160], showing how algorithms which are approximations to an…

Statistics Theory · Mathematics 2009-04-01 Christophe Andrieu , Gareth O. Roberts

The graphical lasso is a widely used algorithm for fitting undirected Gaussian graphical models. However, for inference on functionals of edge values in the learned graph, standard tools lack formal statistical guarantees, such as control…

Methodology · Statistics 2025-04-01 Sofia Guglielmini , Gerda Claeskens , Snigdha Panigrahi

Importance sampling has been known as a powerful tool to reduce the variance of Monte Carlo estimator for rare event simulation. Based on the criterion of minimizing the variance of Monte Carlo estimator within a parametric family, we…

Methodology · Statistics 2013-02-11 Cheng-Der Fuh , Huei-Wen Teng , Ren-Her Wang

We consider estimating the marginal likelihood in settings with independent and identically distributed (i.i.d.) data. We propose estimating the predictive distributions in a sequential factorization of the marginal likelihood in such…

Machine Learning · Statistics 2019-11-19 Scott A. Cameron , Hans C. Eggers , Steve Kroon

Additive regression models have a long history in multivariate nonparametric regression. They provide a model in which each regression function depends only on a single explanatory variable allowing to obtain estimators at the optimal…

Methodology · Statistics 2015-09-16 Graciela Boente , Alejandra Martinez

It is common practice to use Laplace approximations to compute marginal likelihoods in Bayesian versions of generalised linear models (GLM). Marginal likelihoods combined with model priors are then used in different search algorithms to…

Methodology · Statistics 2022-02-01 Jon Lachmann , Geir Storvik , Florian Frommlet , Aliaksadr Hubin

We study a marginal empirical likelihood approach in scenarios when the number of variables grows exponentially with the sample size. The marginal empirical likelihood ratios as functions of the parameters of interest are systematically…

Statistics Theory · Mathematics 2013-11-07 Jinyuan Chang , Cheng Yong Tang , Yichao Wu

We propose Subsampling MCMC, a Markov Chain Monte Carlo (MCMC) framework where the likelihood function for $n$ observations is estimated from a random subset of $m$ observations. We introduce a highly efficient unbiased estimator of the…

Methodology · Statistics 2018-12-31 Matias Quiroz , Robert Kohn , Mattias Villani , Minh-Ngoc Tran

We consider marginal log-linear models for parameterizing distributions on multidimensional contingency tables. These models generalize ordinary log-linear and multivariate logistic models, besides several others. First, we obtain some…

Statistics Theory · Mathematics 2019-10-25 S. Ghosh , P. Vellaisamy

Marginal imputation, which consists of imputing each item requiring imputation separately, is often used in surveys. This type of imputation procedures leads to asymptotically unbiased estimators of simple parameters such as population…

Methodology · Statistics 2015-11-04 Hélène Chaput , Guillaume Chauvet , David Haziza , Laurianne Salembier , Julie Solard

Most solved dynamic structural macrofinance models are non-linear and/or non-Gaussian state-space models with high-dimensional and complex structures. We propose an annealed controlled sequential Monte Carlo method that delivers numerically…

Computation · Statistics 2022-01-05 Andras Fulop , Jeremy Heng , Junye Li

We consider the problem of parametric statistical inference when likelihood computations are prohibitively expensive but sampling from the model is possible. Several so-called likelihood-free methods have been developed to perform inference…

Machine Learning · Statistics 2020-09-14 Owen Thomas , Ritabrata Dutta , Jukka Corander , Samuel Kaski , Michael U. Gutmann

We introduce a novel function-on-function linear quantile regression model to characterize the entire conditional distribution of a functional response for a given functional predictor. Tensor cubic $B$-splines expansion is used to…

Methodology · Statistics 2025-04-01 Ufuk Beyaztas , Han Lin Shang , Semanur Saricam

In this manuscript, we consider a finite multivariate nonparametric mixture model where the dependence between the marginal densities is modeled using the copula device. Pseudo EM stochastic algorithms were recently proposed to estimate all…

Computation · Statistics 2022-12-14 Michael Levine , Gildas Mazo

Observations which are realizations from some continuous process are frequent in sciences, engineering, economics, and other fields. We consider linear models, with possible random effects, where the responses are random functions in a…

Statistics Theory · Mathematics 2016-11-30 Giacomo Aletti , Caterina May , Chiara Tommasi

The validity of estimation and smoothing parameter selection for the wide class of generalized additive models for location, scale and shape (GAMLSS) relies on the correct specification of a likelihood function. Deviations from such…

Methodology · Statistics 2019-11-14 William H. Aeberhard , Eva Cantoni , Giampiero Marra , Rosalba Radice