English
Related papers

Related papers: Statistical Inference and Exact Saddle Point Appro…

200 papers

Approximate Bayesian Computation is a family of likelihood-free inference techniques that are well-suited to models defined in terms of a stochastic generating mechanism. In a nutshell, Approximate Bayesian Computation proceeds by computing…

Computation · Statistics 2010-07-28 Michael Blum

In this paper, a Bayesian inference technique based on Taylor series approximation of the logarithm of the likelihood function is presented. The proposed approximation is devised for the case, where the prior distribution belongs to the…

Machine Learning · Computer Science 2015-10-06 Tohid Ardeshiri , Umut Orguner , Fredrik Gustafsson

We formulate, and present a numerical method for solving, an inverse problem for inferring parameters of a deterministic model from stochastic observational data (quantities of interest). The solution, given as a probability measure, is…

Numerical Analysis · Mathematics 2021-05-04 T. Butler , J. D. Jakeman , T. Wildey

Bayesian synthetic likelihood (BSL) is now an established method for conducting approximate Bayesian inference in models where, due to the intractability of the likelihood function, exact Bayesian approaches are either infeasible or…

Methodology · Statistics 2020-06-12 David T. Frazier , Christopher Drovandi

The methods of statistical physics are widely used for modelling complex networks. Building on the recently proposed Equilibrium Expectation approach, we derive a simple and efficient algorithm for maximum likelihood estimation (MLE) of…

Computation · Statistics 2020-02-12 Alexander Borisenko , Maksym Byshkin , Alessandro Lomi

This paper focuses on stochastic saddle point problems with decision-dependent distributions. These are problems whose objective is the expected value of a stochastic payoff function and whose data distribution drifts in response to…

Optimization and Control · Mathematics 2022-11-15 Killian Wood , Emiliano Dall'Anese

We propose a novel approach for density estimation with exponential families for the case when the true density may not fall within the chosen family. Our approach augments the sufficient statistics with features designed to accumulate…

Machine Learning · Statistics 2012-09-07 Lin Yuan , Sergey Kirshner , Robert Givan

Gaussian approximations are routinely employed in Bayesian statistics to ease inference when the target posterior is intractable. Although these approximations are asymptotically justified by Bernstein-von Mises type results, in practice…

Statistics Theory · Mathematics 2024-04-09 Daniele Durante , Francesco Pozza , Botond Szabo

We propose a general algorithm for approximating nonstandard Bayesian posterior distributions. The algorithm minimizes the Kullback-Leibler divergence of an approximating distribution to the intractable posterior distribution. Our method…

Computation · Statistics 2014-07-29 Tim Salimans , David A. Knowles

We propose a family of variational approximations to Bayesian posterior distributions, called $\alpha$-VB, with provable statistical guarantees. The standard variational approximation is a special case of $\alpha$-VB with $\alpha=1$. When…

Statistics Theory · Mathematics 2018-02-09 Yun Yang , Debdeep Pati , Anirban Bhattacharya

Variational inference has recently emerged as a popular alternative to the classical Markov chain Monte Carlo (MCMC) in large-scale Bayesian inference. The core idea is to trade statistical accuracy for computational efficiency. In this…

Machine Learning · Statistics 2023-08-08 Kush Bhatia , Nikki Lijing Kuang , Yi-An Ma , Yixin Wang

Approximate Bayesian inference on the basis of summary statistics is well-suited to complex problems for which the likelihood is either mathematically or computationally intractable. However the methods that use rejection suffer from the…

Computation · Statistics 2010-05-04 M. G. B. Blum , O. Francois

Variational inference is a general framework to obtain approximations to the posterior distribution in a Bayesian context. In essence, variational inference entails an optimization over a given family of probability distributions to choose…

Statistics Theory · Mathematics 2025-07-24 Janis Keck

Regression classes modeling more than the mean of the response have found a lot of attention in the last years. Expectile regression is a special and computationally convenient case of this family of models. Expectiles offer a quantile-like…

Methodology · Statistics 2013-12-19 Elisabeth Waldmann , Fabian Sobotka , Thomas Kneib

The Collective Graphical Model (CGM) models a population of independent and identically distributed individuals when only collective statistics (i.e., counts of individuals) are observed. Exact inference in CGMs is intractable, and previous…

Machine Learning · Computer Science 2014-05-21 Li-Ping Liu , Daniel Sheldon , Thomas G. Dietterich

We provide the first stochastic convergence rates for a family of adaptive quadrature rules used to normalize the posterior distribution in Bayesian models. Our results apply to the uniform relative error in the approximate posterior…

Methodology · Statistics 2022-10-27 Blair Bilodeau , Alex Stringer , Yanbo Tang

Exponential random graph models are extremely difficult models to handle from a statistical viewpoint, since their normalising constant, which depends on model parameters, is available only in very trivial cases. We show how inference can…

Applications · Statistics 2010-09-30 Alberto Caimo , Nial Friel

Statistical Inference is the process of determining a probability distribution over the space of parameters of a model given a data set. As more data becomes available this probability distribution becomes updated via the application of…

Disordered Systems and Neural Networks · Physics 2022-04-28 David S. Berman , Jonathan J. Heckman , Marc Klinger

Bayesian inference methods are useful in infectious diseases modeling due to their capability to propagate uncertainty, manage sparse data, incorporate latent structures, and address high-dimensional parameter spaces. However, parameter…

Methodology · Statistics 2025-04-29 Xiahui Li , Fergus Chadwick , Ben Swallow

Statistical inference can be seen as information processing involving input information and output information that updates belief about some unknown parameters. We consider the Bayesian framework for making inferences about dynamical…

Statistics Theory · Mathematics 2022-01-17 Artur O. Lopes , Silvia R. C. Lopes , Paulo Varandas