English
Related papers

Related papers: Sequential Monte Carlo with Highly Informative Obs…

200 papers

Bayesian inference allows us to define a posterior distribution over the weights of a generic neural network (NN). Exact posteriors are usually intractable, in which case approximations can be employed. One such approximation - variational…

Machine Learning · Computer Science 2026-01-30 Andrew Millard , Joshua Murphy , Peter Green , Simon Maskell

Inference-time methods that aggregate and prune multiple samples have emerged as a powerful paradigm for steering large language models, yet we lack any principled understanding of their accuracy-cost tradeoffs. In this paper, we introduce…

Pricing options is an important problem in financial engineering. In many scenarios of practical interest, financial option prices associated to an underlying asset reduces to computing an expectation w.r.t.~a diffusion process. In general,…

Computation · Statistics 2016-08-12 Deborshee Sen , Ajay Jasra , Yan Zhou

Monte Carlo methods are widely used to estimate observables in many-body quantum systems. However, conventional sampling schemes often require a large number of samples to achieve sufficient accuracy. In this work we propose the…

Quantum Physics · Physics 2026-01-29 Wenxuan Zhang , Dingzu Wang , Dario Poletti

This paper proposes a Sequential Monte Carlo approach for the Bayesian estimation of mixed causal and noncausal models. Unlike previous Bayesian estimation methods developed for these models, Sequential Monte Carlo offers extensive…

Econometrics · Economics 2025-01-08 Gianluca Cubadda , Francesco Giancaterini , Stefano Grassi

Monte Carlo integration is a powerful tool for scientific and statistical computation, but faces significant challenges when the integrand is a multi-modal distribution, even when the mode locations are known. This work introduces novel…

Methodology · Statistics 2025-03-11 Fei Ding , Shiyuan He , David E. Jones , Xiao-Li Meng

Markov Chain Monte Carlo (MCMC) methods have become a cornerstone of many modern scientific analyses by providing a straightforward approach to numerically estimate uncertainties in the parameters of a model using a sequence of random…

Other Statistics · Statistics 2020-03-10 Joshua S. Speagle

Monte Carlo experiments produce samples in order to estimate features of a given distribution. However, simultaneous estimation of means and quantiles has received little attention, despite being common practice. In this setting we…

Computation · Statistics 2020-04-24 Nathan Robertson , James M. Flegal , Dootika Vats , Galin L. Jones

We introduce a new method to price American-style options on underlying investments governed by stochastic volatility (SV) models. The method does not require the volatility process to be observed. Instead, it exploits the fact that the…

Computational Finance · Quantitative Finance 2012-07-26 Bhojnarine R. Rambharat , Anthony E. Brockwell

Monte Carlo simulation is an unbiased numerical tool for studying classical and quantum many-body systems. One of its bottlenecks is the lack of general and efficient update algorithm for large size systems close to phase transition or with…

Strongly Correlated Electrons · Physics 2017-01-11 Junwei Liu , Yang Qi , Zi Yang Meng , Liang Fu

Bayesian max-margin models have shown superiority in various practical applications, such as text categorization, collaborative prediction, social network link prediction and crowdsourcing, and they conjoin the flexibility of Bayesian…

Machine Learning · Statistics 2016-10-19 Wenbo Hu , Jun Zhu , Bo Zhang

We consider the generic problem of performing sequential Bayesian inference in a state-space model with observation process y, state process x and fixed parameter theta. An idealized approach would be to apply the iterated batch importance…

Computation · Statistics 2012-01-30 Nicolas Chopin , Pierre E. Jacob , Omiros Papaspiliopoulos

In image processing, solving inverse problems is the task of finding plausible reconstructions of an image that was corrupted by some (usually known) degradation operator. Commonly, this process is done using a generative image model that…

Image and Video Processing · Electrical Eng. & Systems 2025-08-22 Idan Achituve , Hai Victor Habi , Amir Rosenfeld , Arnon Netzer , Idit Diamant , Ethan Fetaya

Bayesian inversions followed by estimations of rare event probabilities are often needed to analyse groundwater hazards. Instead of focusing on the posterior distribution of model parameters, the main interest lies then in the distribution…

Applications · Statistics 2024-01-25 Lea Friedli , Niklas Linde

We consider the problem of optimizing a real-valued continuous function $f$ using a Bayesian approach, where the evaluations of $f$ are chosen sequentially by combining prior information about $f$, which is described by a random process…

Optimization and Control · Mathematics 2011-11-22 Romain Benassi , Julien Bect , Emmanuel Vazquez

Traditionally, the field of computational Bayesian statistics has been divided into two main subfields: variational methods and Markov chain Monte Carlo (MCMC). In recent years, however, several methods have been proposed based on combining…

Computation · Statistics 2017-04-19 Cheng Zhang , Babak Shahbaba , Hongkai Zhao

Long Short-Term Memory (LSTM) is one of the most powerful sequence models. Despite the strong performance, however, it lacks the nice interpretability as in state space models. In this paper, we present a way to combine the best of both…

Machine Learning · Computer Science 2017-12-04 Xun Zheng , Manzil Zaheer , Amr Ahmed , Yuan Wang , Eric P Xing , Alexander J Smola

We introduce a new class of sequential Monte Carlo methods which reformulates the essence of the nested sampling method of Skilling (2006) in terms of sequential Monte Carlo techniques. Two new algorithms are proposed, nested sampling via…

Smoothing in state-space models amounts to computing the conditional distribution of the latent state trajectory, given observations, or expectations of functionals of the state trajectory with respect to this distributions. For models that…

Computation · Statistics 2010-11-10 Jimmy Olsson , Tobias Rydén

Recent work has suggested using Monte Carlo methods based on piecewise deterministic Markov processes (PDMPs) to sample from target distributions of interest. PDMPs are non-reversible continuous-time processes endowed with momentum, and…

Machine Learning · Statistics 2024-06-28 Paul Fearnhead , Sebastiano Grazzi , Chris Nemeth , Gareth O. Roberts