English
Related papers

Related papers: Online Semiparametric Regression via Sequential Mo…

200 papers

Monte Carlo sampling has become a major vehicle for approximate inference in Bayesian networks. In this paper, we investigate a family of related simulation approaches, known collectively as quasi-Monte Carlo methods based on deterministic…

Artificial Intelligence · Computer Science 2013-01-18 Jian Cheng , Marek J. Druzdzel

Gaussian process is a very promising novel technology that has been applied to both the regression problem and the classification problem. While for the regression problem it yields simple exact solutions, this is not the case for the…

Machine Learning · Statistics 2013-10-18 Amir F. Atiya , Hatem A. Fayed , Ahmed H. Abdel-Gawad

In this paper we consider a fractional stochastic volatility model, that is a model in which the volatility may exhibit a long-range dependent or a rough/antipersistent behavior. We propose a dynamic sequential Monte Carlo methodology that…

Methodology · Statistics 2017-02-28 Alexandra Chronopoulou , Konstantinos Spiliopoulos

Sequential Monte Carlo methods are a powerful framework for approximating the posterior distribution of a state variable in a sequential manner. They provide an attractive way of analyzing dynamic systems in real-time, taking into account…

Populations and Evolution · Quantitative Biology 2024-08-29 Dhorasso Temfack , Jason Wyse

As a powerful Bayesian non-parameterized algorithm, the Gaussian process (GP) has performed a significant role in Bayesian optimization and signal processing. GPs have also advanced online decision-making systems because their posterior…

Machine Learning · Computer Science 2022-10-27 Tianyu Liu , Jie Lu , Zheng Yan , Guangquan Zhang

Statisticians often use Monte Carlo methods to approximate probability distributions, primarily with Markov chain Monte Carlo and importance sampling. Sequential Monte Carlo samplers are a class of algorithms that combine both techniques to…

Computation · Statistics 2022-06-20 Chenguang Dai , Jeremy Heng , Pierre E. Jacob , Nick Whiteley

We present a sequential Monte Carlo sampler variant of the partial rejection control algorithm, and show that this variant can be considered as a sequential Monte Carlo sampler with a modified mutation kernel. We prove that the new sampler…

Computation · Statistics 2009-11-11 G. W. Peters , Y. Fan , S. A. Sisson

We provide a framework which admits a number of ``marginal'' sequential Monte Carlo (SMC) algorithms as particular cases -- including the marginal particle filter [Klaas et al., 2005, in: Proceedings of Uncertainty in Artificial…

Computation · Statistics 2023-03-08 Francesca R. Crucinio , Adam M. Johansen

Partial Bayesian neural networks (pBNNs) have been shown to perform competitively with fully Bayesian neural networks while only having a subset of the parameters be stochastic. Using sequential Monte Carlo (SMC) samplers as the inference…

Machine Learning · Computer Science 2026-01-30 Andrew Millard , Joshua Murphy , Simon Maskell , Zheng Zhao

Phylogenetics, the inference of evolutionary trees from molecular sequence data such as DNA, is an enterprise that yields valuable evolutionary understanding of many biological systems. Bayesian phylogenetic algorithms, which approximate a…

Populations and Evolution · Quantitative Biology 2016-10-27 Vu Dinh , Aaron E. Darling , Frederick A. Matsen

Bayesian data analysis is widely used across many disciplines, and representative examples in materials science include spectral analysis and sparse modeling. In such applications, the underlying models often become complex and yield…

Information Theory · Computer Science 2026-03-04 Tomohiro Nabika , Kenji Nagata , Shun Katakami , Masaichiro Mizumaki , Masato Okada

We propose a new framework for how to use sequential Monte Carlo (SMC) algorithms for inference in probabilistic graphical models (PGM). Via a sequential decomposition of the PGM we find a sequence of auxiliary distributions defined on a…

Methodology · Statistics 2014-10-07 Christian A. Naesseth , Fredrik Lindsten , Thomas B. Schön

Latent space models are popular for analyzing dynamic network data. We propose a variational approach to estimate the model parameters as well as the latent positions of the nodes in the network. The variational approach is much faster than…

Methodology · Statistics 2021-06-01 Yan Liu , Yuguo Chen

The increased demand for online prediction and the growing availability of large data sets drives the need for computationally efficient models. While exact Gaussian process regression shows various favorable theoretical properties…

Machine Learning · Computer Science 2021-08-02 Armin Lederer , Alejandro Jose Ordonez Conejo , Korbinian Maier , Wenxin Xiao , Jonas Umlauft , Sandra Hirche

We propose a novel class of Sequential Monte Carlo (SMC) algorithms, appropriate for inference in probabilistic graphical models. This class of algorithms adopts a divide-and-conquer approach based upon an auxiliary tree-structured…

Recent advances in stochastic gradient variational inference have made it possible to perform variational Bayesian inference with posterior approximations containing auxiliary random variables. This enables us to explore a new synthesis of…

Computation · Statistics 2015-05-20 Tim Salimans , Diederik P. Kingma , Max Welling

The emerging field of learning-augmented online algorithms uses ML techniques to predict future input parameters and thereby improve the performance of online algorithms. Since these parameters are, in general, real-valued functions, a…

Machine Learning · Computer Science 2022-05-26 Keerti Anand , Rong Ge , Amit Kumar , Debmalya Panigrahi

Distributed computing offers a high degree of flexibility to accommodate modern learning constraints and the ever increasing size of datasets involved in massive data issues. Drawing inspiration from the theory of distributed computation…

Statistics Theory · Mathematics 2014-07-17 Gérard Biau , Ryad Zenine

Approximate inference in probabilistic graphical models (PGMs) can be grouped into deterministic methods and Monte-Carlo-based methods. The former can often provide accurate and rapid inferences, but are typically associated with biases…

Machine Learning · Statistics 2019-01-09 Fredrik Lindsten , Jouni Helske , Matti Vihola

Monte Carlo sampling is a powerful toolbox of algorithmic techniques widely used for a number of applications wherein some noisy quantity, or summary statistic thereof, is sought to be estimated. In this paper, we survey the literature for…