English
Related papers

Related papers: Importance sampling for partially observed tempora…

200 papers

In this paper, we consider an importance sampling problem for a certain rare-event simulations involving the behavior of a diffusion process pertaining to a chain of distributed systems with random perturbations. We also assume that the…

Optimization and Control · Mathematics 2020-08-26 Getachew K. Befekadu

We introduce and test an algorithm that adaptively estimates large deviation functions characterizing the fluctuations of additive functionals of Markov processes in the long-time limit. These functions play an important role for predicting…

Statistical Mechanics · Physics 2023-03-30 Grégoire Ferré , Hugo Touchette

In this paper, we consider the problem of numerical investigation of the counting statistics for a class of one-dimensional systems. Importance sampling, the cornerstone technique usually implemented for such problems, critically hinges on…

Statistical Mechanics · Physics 2024-08-12 Ivan N. Burenev , Satya N. Majumdar , Alberto Rosso

We present a two-stage Metropolis-Hastings algorithm for sampling probabilistic models, whose log-likelihood is computationally expensive to evaluate, by using a surrogate Gaussian Process (GP) model. The key feature of the approach, and…

Machine Learning · Statistics 2021-09-29 Alessio Benavoli , Jason Wyse , Arthur White

The Hawkes process is a widely used model in many areas, such as finance, seismology, neuroscience, epidemiology, and social sciences. Estimation of the Hawkes process from continuous observations of a sample path is relatively…

Methodology · Statistics 2024-01-23 Feng Chen , Jeffrey Kwan , Tom Stindl

This study aims to estimate the parameters of a stochastic exposed-infected epidemiological model for the transmission dynamics of notifiable infectious diseases, based on observations related to isolated cases counts only. We use the…

Applications · Statistics 2024-04-15 Ibrahim Bouzalmat , Benoîte de Saporta , Solym M. Manou-Abi

We consider estimating the marginal likelihood in settings with independent and identically distributed (i.i.d.) data. We propose estimating the predictive distributions in a sequential factorization of the marginal likelihood in such…

Machine Learning · Statistics 2019-11-19 Scott A. Cameron , Hans C. Eggers , Steve Kroon

Markov Chain Monte Carlo methods are widely used in signal processing and communications for statistical inference and stochastic optimization. In this work, we introduce an efficient adaptive Metropolis-Hastings algorithm to draw samples…

Computation · Statistics 2016-03-17 David Luengo , Luca Martino

Motivated by the problem of exploring discrete but very complex state spaces in Bayesian models, we propose a novel Markov Chain Monte Carlo search algorithm: the taxicab sampler. We describe the construction of this sampler and discuss how…

Methodology · Statistics 2022-10-04 Vincent Geels , Matthew Pratola , Radu Herbei

Monte-Carlo techniques are standard numerical tools for exploring non-Gaussian and multivariate likelihoods. Many variants of the original Metropolis-Hastings algorithm have been proposed to increase the sampling efficiency. Motivated by…

Cosmology and Nongalactic Astrophysics · Physics 2024-10-31 Maximilian Philipp Herzog , Heinrich von Campe , Rebecca Maria Kuntz , Lennart Röver , Björn Malte Schäfer

We introduce a theoretical and practical framework for efficient importance sampling of mini-batch samples for gradient estimation from single and multiple probability distributions. To handle noisy gradients, our framework dynamically…

Machine Learning · Computer Science 2025-01-29 Corentin Salaün , Xingchang Huang , Iliyan Georgiev , Niloy J. Mitra , Gurprit Singh

This work proposes a novel method through which local information about the target density can be used to construct an efficient importance sampler. The backbone of the proposed method is the Incremental Mixture Importance Sampling (IMIS)…

Computation · Statistics 2016-11-22 Matteo Fasiolo , Flávio Eler de Melo , Simon Maskell

Markov jump processes (MJPs) are continuous-time stochastic processes widely used in a variety of applied disciplines. Inference for MJPs typically proceeds via Markov chain Monte Carlo, the state-of-the-art being a uniformization-based…

Computation · Statistics 2020-04-14 Boqian Zhang , Vinayak Rao

Hierarchical Bayesian models can be especially useful in precision medicine settings, where clinicians are interested in estimating the patient-level latent variables associated with an individual's current health state and its trajectory.…

Applications · Statistics 2015-10-30 Aaron J Fisher , R Yates Coley , Scott L Zeger

In Bayesian optimization, accounting for the importance of the output relative to the input is a crucial yet challenging exercise, as it can considerably improve the final result but often involves inaccurate and cumbersome entropy…

Machine Learning · Computer Science 2020-12-30 Antoine Blanchard , Themistoklis Sapsis

Importance sampling is a widely used technique to estimate properties of a distribution. This paper investigates trading-off some bias for variance by adaptively winsorizing the importance sampling estimator. The novel winsorizing…

Computation · Statistics 2021-02-10 Paulo Orenstein

Monte Carlo approaches have recently been proposed to quantify connectivity in neuronal networks. The key problem is to sample from the conditional distribution of a single neuronal spike train, given the activity of the other neurons in…

Applications · Statistics 2011-12-01 Yuriy Mishchenko , Liam Paninski

We present a novel framework for performing statistical sampling, expectation estimation, and partition function approximation using \emph{arbitrary} heuristic stochastic processes defined over discrete state spaces. Using a highly parallel…

Computation · Statistics 2015-12-04 Firas Hamze , Evgeny Andryash

The missing data issue often complicates the task of estimating generalized linear models (GLMs). We describe why the pseudo-marginal Metropolis-Hastings algorithm, used in this setting, is an effective strategy for parameter estimation.…

Methodology · Statistics 2019-07-23 Taylor R. Brown , Timothy L. McMurry , Alexander Langevin

We introduce Path-ZVA: an efficient simulation technique for estimating the probability of reaching a rare goal state before a regeneration state in a (discrete-time) Markov chain. Standard Monte Carlo simulation techniques do not work well…

Probability · Mathematics 2018-07-02 Daniel Reijsbergen , Pieter-Tjerk de Boer , Werner Scheinhardt , Sandeep Juneja