English
Related papers

Related papers: Estimating Marginal Likelihoods in Likelihood-Free…

200 papers

When the sample path of a Hawkes process is observed discretely, such that only the total event counts in disjoint time intervals are known, the likelihood function becomes intractable. To overcome the challenge of likelihood-based…

Methodology · Statistics 2025-06-24 Jason J. Lambe , Feng Chen , Tom Stindl , Tsz-Kit Jeffrey Kwan

Estimating copulas with discrete marginal distributions is challenging, especially in high dimensions, because computing the likelihood contribution of each observation requires evaluating $2^{J}$ terms, with $J$ the number of discrete…

Methodology · Statistics 2018-11-12 D. Gunawan , M. -N. Tran , K. Suzuki , J. Dick , R. Kohn

Many inference problems involve inferring the number $N$ of components in some region, along with their properties $\{\mathbf{x}_i\}_{i=1}^N$, from a dataset $\mathcal{D}$. A common statistical example is finite mixture modelling. In the…

Computation · Statistics 2015-01-15 Brendon J. Brewer

Symbolic data analysis (SDA) aggregates large individual-level datasets into a small number of distributional summaries, such as random rectangles or random histograms. The inference is carried out using these summaries in place of the…

Methodology · Statistics 2026-04-02 Yu Yang , Matias Quiroz , Boris Beranger , Robert Kohn , Scott A. Sisson

Likelihood-free methods are an established approach for performing approximate Bayesian inference for models with intractable likelihood functions. However, they can be computationally demanding. Bayesian synthetic likelihood (BSL) is a…

Computation · Statistics 2020-02-04 Jacob W. Priddle , Scott A. Sisson , David T. Frazier , Christopher Drovandi

Neural networks are being extensively used for modelling data, especially in the case where no likelihood can be formulated. Although in the case of X-ray spectral fitting, the likelihood is known, we aim to investigate the neural networks…

Instrumentation and Methods for Astrophysics · Physics 2024-02-22 Didier Barret , Simon Dupourqué

It is common practice to use Laplace approximations to compute marginal likelihoods in Bayesian versions of generalised linear models (GLM). Marginal likelihoods combined with model priors are then used in different search algorithms to…

Methodology · Statistics 2022-02-01 Jon Lachmann , Geir Storvik , Florian Frommlet , Aliaksadr Hubin

Likelihood-free inference provides a framework for performing rigorous Bayesian inference using only forward simulations, properly accounting for all physical and observational effects that can be successfully included in the simulations.…

Cosmology and Nongalactic Astrophysics · Physics 2019-07-24 Justin Alsing , Tom Charnock , Stephen Feeney , Benjamin Wandelt

In machine learning, likelihood-free inference refers to the task of performing an analysis driven by data instead of an analytical expression. We discuss the application of Neural Spline Flows, a neural density estimation algorithm, to the…

High Energy Physics - Phenomenology · Physics 2020-07-01 Sebastian Pina-Otey , Federico Sánchez , Vicens Gaitan , Thorsten Lux

To check the accuracy of Bayesian computations, it is common to use rank-based simulation-based calibration (SBC). However, SBC has drawbacks: The test statistic is somewhat ad-hoc, interactions are difficult to examine, multiple testing is…

Machine Learning · Statistics 2023-10-31 Yuling Yao , Justin Domke

A major challenge in sample-based inference (SBI) for Bayesian neural networks is the size and structure of the networks' parameter space. Our work shows that successful SBI is possible by embracing the characteristic relationship between…

Machine Learning · Computer Science 2024-05-29 Emanuel Sommer , Lisa Wimmer , Theodore Papamarkou , Ludwig Bothmann , Bernd Bischl , David Rügamer

We propose a method to improve the efficiency and accuracy of amortized Bayesian inference by leveraging universal symmetries in the joint probabilistic model of parameters and data. In a nutshell, we invert Bayes' theorem and estimate the…

Machine Learning · Computer Science 2024-07-24 Marvin Schmitt , Desi R. Ivanova , Daniel Habermann , Ullrich Köthe , Paul-Christian Bürkner , Stefan T. Radev

Nested error regression models are useful tools for analysis of grouped data, especially in the case of small area estimation. This paper suggests a nested error regression model using uncertain random effects in which the random effect in…

Methodology · Statistics 2017-02-28 Shonosuke Sugasawa , Tatsuya Kubokawa

RNA-Seq data characteristically exhibits large variances, which need to be appropriately accounted for in the model. We first explore the effects of this variability on the maximum likelihood estimator (MLE) of the overdispersion parameter…

Methodology · Statistics 2015-12-03 Luis Leon-Novelo , Claudio Fuentes , Sarah Emerson

In this paper we propose a new sampling-free approach to solve Bayesian model inversion problems that is an extension of the previously proposed spectral likelihood expansions (SLE) method. Our approach, called stochastic spectral…

Computation · Statistics 2021-04-21 P. -R. Wagner , S. Marelli , B. Sudret

Training an energy-based model (EBM) with maximum likelihood is challenging due to the intractable normalisation constant. Traditional methods rely on expensive Markov chain Monte Carlo (MCMC) sampling to estimate the gradient of logartihm…

Machine Learning · Computer Science 2025-03-11 Hugo Senetaire , Paul Jeha , Pierre-Alexandre Mattei , Jes Frellsen

Selective inference aims at providing valid inference after a data-driven selection of models or hypotheses. It is essential to avoid overconfident results and replicability issues. While significant advances have been made in this area for…

Methodology · Statistics 2025-03-14 Matteo D'Alessandro , Magne Thoresen

We study Bayesian inference methods for solving linear inverse problems, focusing on hierarchical formulations where the prior or the likelihood function depend on unspecified hyperparameters. In practice, these hyperparameters are often…

Numerical Analysis · Mathematics 2018-08-01 Qingping Zhou , Wenqing Liu , Jinglai Li , Youssef M. Marzouk

Bayesian Neural Networks (BNNs) place priors over the parameters in a neural network. Inference in BNNs, however, is difficult; all inference methods for BNNs are approximate. In this work, we empirically compare the quality of predictive…

Machine Learning · Computer Science 2019-06-25 Jiayu Yao , Weiwei Pan , Soumya Ghosh , Finale Doshi-Velez

We consider a semiparametric generalized linear model and study estimation of both marginal and quantile effects in this model. We propose an approximate maximum likelihood estimator, and rigorously establish the consistency, the asymptotic…

Methodology · Statistics 2022-04-06 Seong-ho Lee , Yanyuan Ma , Elvezio Ronchetti