English
Related papers

Related papers: An importance sampling approach for reliable and e…

200 papers

We consider Bayesian inference for large scale inverse problems, where computational challenges arise from the need for repeated evaluations of an expensive forward model. This renders most Markov chain Monte Carlo approaches infeasible,…

Numerical Analysis · Mathematics 2022-08-12 Daniel Zhengyu Huang , Jiaoyang Huang , Sebastian Reich , Andrew M. Stuart

Approximate probabilistic inference algorithms are central to many fields. Examples include sequential Monte Carlo inference in robotics, variational inference in machine learning, and Markov chain Monte Carlo inference in statistics. A key…

Machine Learning · Statistics 2017-11-07 Marco F. Cusumano-Towner , Vikash K. Mansinghka

Bayesian inference in deep neural networks is challenging due to the high-dimensional, strongly multi-modal parameter posterior density landscape. Markov chain Monte Carlo approaches asymptotically recover the true posterior but are…

Inference for mechanistic models is challenging because of nonlinear interactions between model parameters and a lack of identifiability. Here we focus on a specific class of mechanistic models, which we term stable differential equations.…

Computation · Statistics 2017-12-13 Philip Maybank , Ingo Bojak , Richard G. Everitt

Structural equation models are commonly used to capture the relationship between sets of observed and unobservable variables. Traditionally these models are fitted using frequentist approaches but recently researchers and practitioners have…

Methodology · Statistics 2023-02-22 Khue-Dung Dang , Luca Maestrini

Fitting models to data to obtain distributions of consistent parameter values is important for uncertainty quantification, model comparison, and prediction. Standard Markov chain Monte Carlo (MCMC) approaches for fitting ordinary…

Computation · Statistics 2025-09-05 Chris Chi , Jonathan Weare , Aaron R. Dinner

Often the regression function is specified by a system of ordinary differential equations (ODEs) involving some unknown parameters. Typically analytical solution of the ODEs is not available, and hence likelihood evaluation at many…

Statistics Theory · Mathematics 2016-02-23 Prithwish Bhaumik , Subhashis Ghosal

Most ordinary differential equation (ODE) models used to describe biological or physical systems must be solved approximately using numerical methods. Perniciously, even those solvers which seem sufficiently accurate for the forward…

Bayesian parameter inference for complex stochastic simulators is challenging due to intractable likelihood functions. Existing simulation-based inference methods often require large number of simulations and become costly to use in…

Machine Learning · Computer Science 2026-04-06 Vasilis Gkolemis , Christos Diou , Michael U. Gutmann

In many fields of application, dynamic processes that evolve through time are well described by systems of ordinary differential equations (ODEs). The analytical solution of the ODEs is often not available and different methods have been…

Methodology · Statistics 2017-07-19 Saverio Ranciati , Cinzia Viroli , Ernst Wit

Doubly intractable distributions arise in many settings, for example in Markov models for point processes and exponential random graph models for networks. Bayesian inference for these models is challenging because they involve intractable…

Computation · Statistics 2019-04-03 Jaewoo Park , Murali Haran

Closed-form, interpretable mathematical models have been instrumental for advancing our understanding of the world; with the data revolution, we may now be in a position to uncover new such models for many systems from physics to the social…

The design of reliable indicators to anticipate critical transitions in complex systems is an im portant task in order to detect a coming sudden regime shift and to take action in order to either prevent it or mitigate its consequences. We…

Data Analysis, Statistics and Probability · Physics 2022-12-14 Martin Heßler , Oliver Kamps

We consider Bayesian analysis of a class of multiple changepoint models. While there are a variety of efficient ways to analyse these models if the parameters associated with each segment are independent, there are few general approaches…

Computation · Statistics 2009-10-19 Paul Fearnhead , Zhen Liu

Sample-based Bayesian inference provides a route to uncertainty quantification in the geosciences, and inverse problems in general, though is very computationally demanding in the naive form that requires simulating an accurate computer…

Computation · Statistics 2019-04-12 Tiangang Cui , Colin Fox , Michael J O'Sullivan

Often the regression function appearing in fields like economics, engineering, biomedical sciences obeys a system of higher order ordinary differential equations (ODEs). The equations are usually not analytically solvable. We are interested…

Statistics Theory · Mathematics 2015-05-19 Prithwish Bhaumik , Subhashis Ghosal

We propose a very fast approximate Markov Chain Monte Carlo (MCMC) sampling framework that is applicable to a large class of sparse Bayesian inference problems, where the computational cost per iteration in several models is of order…

Computation · Statistics 2021-08-17 Yves Atchadé , Liwei Wang

There is resurging interest, in statistics and machine learning, in solvers for ordinary differential equations (ODEs) that return probability measures instead of point estimates. Recently, Conrad et al. introduced a sampling-based class of…

Numerical Analysis · Computer Science 2018-11-06 Hans Kersting , Philipp Hennig

The Bayesian approach to data analysis provides a powerful way to handle uncertainty in all observations, model parameters, and model structure using probability theory. Probabilistic programming languages make it easier to specify and fit…

Variational inference has become an increasingly attractive fast alternative to Markov chain Monte Carlo methods for approximate Bayesian inference. However, a major obstacle to the widespread use of variational methods is the lack of…

Machine Learning · Statistics 2020-03-03 Jonathan H. Huggins , Mikołaj Kasprzak , Trevor Campbell , Tamara Broderick