English
Related papers

Related papers: A divide and conquer sequential Monte Carlo approa…

200 papers

We consider the numerical approximation of the filtering problem in high dimensions, that is, when the hidden state lies in $\mathbb{R}^d$ with $d$ large. For low dimensional problems, one of the most popular numerical procedures for…

Computation · Statistics 2014-12-12 Alex Beskos , Dan Crisan , Ajay Jasra , Kengo Kamatani , Yan Zhou

We propose sequential Monte Carlo (SMC) methods for sampling the posterior distribution of state-space models under highly informative observation regimes, a situation in which standard SMC methods can perform poorly. A special case is…

Computation · Statistics 2015-07-10 Pierre Del Moral , Lawrence M. Murray

We analyse the performance of a recursive Monte Carlo method for the Bayesian estimation of the static parameters of a discrete--time state--space Markov model. The algorithm employs two layers of particle filters to approximate the…

Computation · Statistics 2016-03-31 Dan Crisan , Joaquin Miguez

We present a probabilistic divide-and-conquer (PDC) method for \emph{exact} sampling of conditional distributions of the form $\mathcal{L}( {\bf X}\, |\, {\bf X} \in E)$, where ${\bf X}$ is a random variable on $\mathcal{X}$, a complete,…

Probability · Mathematics 2016-09-15 Stephen DeSalvo

Standard planners for sequential decision making (including Monte Carlo planning, tree search, dynamic programming, etc.) are constrained by an implicit sequential planning assumption: The order in which a plan is constructed is the same in…

In big data context, traditional MCMC methods, such as Metropolis-Hastings algorithms and hybrid Monte Carlo, scale poorly because of their need to evaluate the likelihood over the whole data set at each iteration. In order to resurrect…

Computation · Statistics 2017-06-20 Changye Wu , Christian P. Robert

Divide and Conquer (DC) is conceptually well suited to high-dimensional optimization by decomposing a problem into multiple small-scale sub-problems. However, appealing performance can be seldom observed when the sub-problems are…

Artificial Intelligence · Computer Science 2018-07-12 Peng Yang , Ke Tang , Xin Yao

A key challenge when designing particle filters in high-dimensional state spaces is the construction of a proposal distribution that is close to the posterior distribution. Recent advances in particle flow filters provide a promising avenue…

Methodology · Statistics 2017-06-30 Yunpeng Li , Mark Coates

Divide-and-conquer methods use large-sample approximations to provide frequentist guarantees when each block of data is both small enough to facilitate efficient computation and large enough to support approximately valid inferences. When…

Methodology · Statistics 2025-04-01 Emily C. Hector , Leonardo Cella , Ryan Martin

We propose a general method for distributed Bayesian model choice, using the marginal likelihood, where a data set is split in non-overlapping subsets. These subsets are only accessed locally by individual workers and no data is shared…

Computation · Statistics 2022-10-18 Alexander Buchholz , Daniel Ahfock , Sylvia Richardson

State estimation is crucial for the performance and safety of numerous robotic applications. Among the suite of estimation techniques, particle filters have been identified as a powerful solution due to their non-parametric nature. Yet, in…

Robotics · Computer Science 2024-04-23 Akhilan Boopathy , Aneesh Muppidi , Peggy Yang , Abhiram Iyer , William Yue , Ila Fiete

We provide a comprehensive characterisation of the theoretical properties of the divide-and-conquer sequential Monte Carlo (DaC-SMC) algorithm. We firmly establish it as a well-founded method by showing that it possesses the same basic…

Methodology · Statistics 2023-07-04 Juan Kuntz , Francesca R. Crucinio , Adam M. Johansen

We extend a recently developed method to solve semi-linear PDEs to the case of a degenerated diffusion. Being a pure Monte Carlo method it does not suffer from the so called curse of dimensionality and it can be used to solve problems that…

Probability · Mathematics 2018-05-15 Xavier Warin

This work is concerned with approximating matrix functions for banded matrices, hierarchically semiseparable matrices, and related structures. We develop a new divide-and-conquer method based on (rational) Krylov subspace methods for…

Numerical Analysis · Mathematics 2021-07-12 Alice Cortinovis , Daniel Kressner , Stefano Massei

Sequential Monte Carlo methods are typically not straightforward to implement on parallel architectures. This is because standard resampling schemes involve communication between all particles. The $\alpha$-sequential Monte Carlo method was…

Statistics Theory · Mathematics 2022-02-21 Deborshee Sen

Splitting methods have emerged as powerful tools to address complex problems by decomposing them into smaller solvable components. In this work, we develop a general approach to forward-backward splitting methods for solving monotone…

Optimization and Control · Mathematics 2026-04-20 Minh N. Dao , Matthew K. Tam , Thang D. Truong

The key requirement for harnessing the quantum properties of light is the capability to detect and count individual photons. Of particular interest are photon-number-resolving detectors, which allow one to determine whether a state of light…

Divide-and-conquer strategies for Monte Carlo algorithms are an increasingly popular approach to making Bayesian inference scalable to large data sets. In its simplest form, the data are partitioned across multiple computing cores and a…

Computation · Statistics 2022-08-09 Callum Vyner , Christopher Nemeth , Chris Sherlock

In big data analysis, a simple task such as linear regression can become very challenging as the variable dimension $p$ grows. As a result, variable screening is inevitable in many scientific studies. In recent years, randomized algorithms…

Methodology · Statistics 2019-02-13 Yu-Hsiang Cheng , Tzee-Ming Huang , Su-Yun Huang

Sequential Monte Carlo methods have been a major breakthrough in the field of numerical signal processing for stochastic dynamical state-space systems with partial and noisy observations. However, these methods still present certain…

Applications · Statistics 2023-12-14 Samuel Nyobe , Fabien Campillo , Serge Moto , Vivien Rossi