English
Related papers

Related papers: Limit theorems for cloning algorithms

200 papers

We introduce a powerful and flexible MCMC algorithm for stochastic simulation. The method builds on a pseudo-marginal method originally introduced in [Genetics 164 (2003) 1139--1160], showing how algorithms which are approximations to an…

Statistics Theory · Mathematics 2009-04-01 Christophe Andrieu , Gareth O. Roberts

Recently there have been exciting developments in Monte Carlo methods, with the development of new MCMC and sequential Monte Carlo (SMC) algorithms which are based on continuous-time, rather than discrete-time, Markov processes. This has…

Computation · Statistics 2020-09-29 Paul Fearnhead , Joris Bierkens , Murray Pollock , Gareth O Roberts

Sequential Monte Carlo techniques are useful for state estimation in non-linear, non-Gaussian dynamic models. These methods allow us to approximate the joint posterior distribution using sequential importance sampling. In this framework,…

Computation · Statistics 2012-07-09 Mike Klaas , Nando de Freitas , Arnaud Doucet

Sequential Monte Carlo methods, also known as particle methods, are a popular set of techniques for approximating high-dimensional probability distributions and their normalizing constants. These methods have found numerous applications in…

Computation · Statistics 2021-06-23 Jeremy Heng , Adrian N. Bishop , George Deligiannidis , Arnaud Doucet

A novel procedure is described for accelerating the convergence of Markov chain Monte Carlo computations. The algorithm uses an adaptive bootstrap technique to generate candidate steps in the Markov Chain. It is efficient for symmetric,…

Numerical Analysis · Computer Science 2010-12-13 Greg Kochanski , Burton S. Rosner

Space filling designs are central to studying complex systems in various areas of science. They are used for obtaining an overall understanding of the behaviour of the response over the input space, model construction and uncertainty…

Methodology · Statistics 2016-08-10 Shirin Golchi , Jason L. Loeppky

We present powerful new analysis techniques to constrain effective field theories at the LHC. By leveraging the structure of particle physics processes, we extract extra information from Monte-Carlo simulations, which can be used to train…

High Energy Physics - Phenomenology · Physics 2018-09-19 Johann Brehmer , Kyle Cranmer , Gilles Louppe , Juan Pavez

This simple note lays out a few observations which are well known in many ways but may not have been said in quite this way before. The basic idea is that when comparing two different Markov chains it is useful to couple them is such a way…

Probability · Mathematics 2017-11-16 James E. Johndrow , Jonathan C. Mattingly

Approximate inference in dynamic systems is the problem of estimating the state of the system given a sequence of actions and partial observations. High precision estimation is fundamental in many applications like diagnosis, natural…

Artificial Intelligence · Computer Science 2012-06-18 Hannaneh Hajishirzi , Eyal Amir

There is a growing cross-disciplinary effort in the broad domain of optimization and learning with streams of data, applied to settings where traditional batch optimization techniques cannot produce solutions at time scales that match the…

Optimization and Control · Mathematics 2021-11-29 Emiliano Dall'Anese , Andrea Simonetto , Stephen Becker , Liam Madden

We study coarsening phenomena in three different simple exclusion processes with quenched disordered jump rates. In the case of the totally asymmetric process, an earlier phenomenological description is improved, yielding for the time…

Disordered Systems and Neural Networks · Physics 2015-06-05 R. Juhász , G. Ódor

As an alternative to the well-known methods of "chaining" and "bracketing" that have been developed in the study of random fields, a new method, which is based on a stochastic maximal inequality derived by using It\^o's formula and on a new…

Probability · Mathematics 2016-02-12 Yoichi Nishiyama

Automatic differentiation (AD) has driven recent advances in machine learning, including deep neural networks and Hamiltonian Markov Chain Monte Carlo methods. Partially observed nonlinear stochastic dynamical systems have proved resistant…

Methodology · Statistics 2024-07-04 Kevin Tan , Giles Hooker , Edward L. Ionides

Closed-form stochastic filtering equations can be derived in a general setting where probability distributions are replaced by some specific outer measures. In this article, we study how the principles of the sequential Monte Carlo method…

Methodology · Statistics 2018-05-07 Jeremie Houssineau , Branko Ristic

We describe stochastic calculus in the context of processes that are driven by an adapted point process of locally finite intensity and are differentiable between jumps. This includes Markov chains as well as non-Markov processes. By…

Probability · Mathematics 2016-07-26 Eric Foxall

Stochastic approximation algorithm is a useful technique which has been exploited successfully in probability theory and statistics for a long time. The step sizes used in stochastic approximation are generally taken to be deterministic and…

Probability · Mathematics 2019-09-25 Ujan Gangopadhyay , Krishanu Maulik

Sequential Monte Carlo (SMC) methods are a class of techniques to sample approximately from any sequence of probability distributions using a combination of importance sampling and resampling steps. This paper is concerned with the…

Statistics Theory · Mathematics 2012-03-05 Pierre Del Moral , Arnaud Doucet , Ajay Jasra

Constraints can be interpreted in a broad sense as any kind of explicit restriction over the parameters. While some constraints are defined directly on the parameter space, when they are instead defined by known behaviour on the model,…

Methodology · Statistics 2015-02-27 Shirin Golchi , David A. Campbell

Computing the exact likelihood of data in large Bayesian networks consisting of thousands of vertices is often a difficult task. When these models contain many deterministic conditional probability tables and when the observed values are…

Computation · Statistics 2012-06-26 Ydo Wexler , Dan Geiger

With rapid growth in the amount of unstructured data produced by memory-intensive applications, large scale data analytics has recently attracted increasing interest. Processing, managing and analyzing this huge amount of data poses several…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-08-29 Farshid Farhat , Diman Zad Tootaghaj , Mohammad Arjomand