English
Related papers

Related papers: Importance Sampling for Pathwise Sensitivity of St…

200 papers

This paper presents a new parameter estimation algorithm for the adaptive control of a class of time-varying plants. The main feature of this algorithm is a matrix of time-varying learning rates, which enables parameter estimation error…

Optimization and Control · Mathematics 2021-11-18 Joseph E. Gaudio , Anuradha M. Annaswamy , Eugene Lavretsky , Michael A. Bolender

We present an efficient finite difference method for the computation of parameter sensitivities that is applicable to a wide class of continuous time Markov chain models. The estimator for the method is constructed by coupling the perturbed…

Numerical Analysis · Mathematics 2012-05-14 David F. Anderson

In this work, we explore modeling change points in time-series data using neural stochastic differential equations (neural SDEs). We propose a novel model formulation and training procedure based on the variational autoencoder (VAE)…

Machine Learning · Computer Science 2025-06-16 Yousef El-Laham , Zhongchang Sun , Haibei Zhu , Tucker Balch , Svitlana Vyetrenko

In many applications, Bayesian inverse problems can give rise to probability distributions which contain complexities due to the Hessian varying greatly across parameter space. This complexity often manifests itself as lower dimensional…

Computation · Statistics 2020-07-28 Simon L. Cotter , Ioannis G. Kevrekidis , Paul Russell

This paper investigates the use of stratified sampling as a variance reduction technique for approximating integrals over large dimensional spaces. The accuracy of this method critically depends on the choice of the space partition, the…

Probability · Mathematics 2009-09-15 Pierre Etoré , Gersende Fort , Benjamin Jourdain , Eric Moulines

This paper considers importance sampling for estimation of rare-event probabilities in a specific collection of Markovian jump processes used for e.g. modelling of credit risk. Previous attempts at designing importance sampling algorithms…

Probability · Mathematics 2021-12-02 Boualem Djehiche , Henrik Hult , Pierre Nyquist

Importance sampling (IS) is a widely used simulation method for estimating rare event probabilities. In IS, the relative variance of an estimator is the most common measure of estimator accuracy, and the focus of existing literature is on…

Statistics Theory · Mathematics 2026-01-05 Julie Choi , Peter Glynn

The scalar auxiliary variable (SAV) approach is a highly efficient method widely used for solving gradient flow systems. This approach offers several advantages, including linearity, unconditional energy stability, and ease of…

Numerical Analysis · Mathematics 2024-07-26 Jinpeng Zhang , Xiaoping Wang

We introduce a novel paradigm for learning non-parametric drift and diffusion functions for stochastic differential equation (SDE). The proposed model learns to simulate path distributions that match observations with non-uniform time…

Machine Learning · Statistics 2018-08-01 Cagatay Yildiz , Markus Heinonen , Jukka Intosalmi , Henrik Mannerström , Harri Lähdesmäki

We consider systems of slow--fast diffusions with small noise in the slow component. We construct provably logarithmic asymptotically optimal importance schemes for the estimation of rare events based on the moderate deviations principle.…

Probability · Mathematics 2020-01-07 Matthew R. Morse , Konstantinos Spiliopoulos

This paper describes a forward algorithm and an adjoint algorithm for computing sensitivity derivatives in chaotic dynamical systems, such as the Lorenz attractor. The algorithms compute the derivative of long time averaged "statistical"…

Computational Physics · Physics 2013-10-25 Qiqi Wang

Although stochastic models driven by latent Markov processes are widely used, the classical importance sampling methods based on the exponential tilting for these models suffers from the difficulties in computing the eigenvalues and…

Computation · Statistics 2025-10-14 Cheng-Der Fuh , Yanwei Jia , Steven Kou

Deterministic compartmental models are predominantly used in the modeling of infectious diseases, though stochastic models are considered more realistic, yet are complicated to estimate due to missing data. In this paper we present a novel…

Computation · Statistics 2022-06-22 Shuying Wang , Stephen G. Walker

We introduce and test an algorithm that adaptively estimates large deviation functions characterizing the fluctuations of additive functionals of Markov processes in the long-time limit. These functions play an important role for predicting…

Statistical Mechanics · Physics 2023-03-30 Grégoire Ferré , Hugo Touchette

Sensitivity analysis (SA) is an important aspect of process automation. It often aims to identify the process inputs that influence the process output's variance significantly. Existing SA approaches typically consider the input-output…

Methodology · Statistics 2020-06-09 Zhanlin Liu , Ashis G. Banerjee , Youngjun Choe

Importance weighting is a general way to adjust Monte Carlo integration to account for draws from the wrong distribution, but the resulting estimate can be highly variable when the importance ratios have a heavy right tail. This routinely…

Computation · Statistics 2024-04-12 Aki Vehtari , Daniel Simpson , Andrew Gelman , Yuling Yao , Jonah Gabry

Early warning indicators often suffer from the shortness and coarse-graining of real-world time series. Furthermore, the typically strong and correlated noise contributions in real applications are severe drawbacks for statistical measures.…

Data Analysis, Statistics and Probability · Physics 2026-03-03 Martin Heßler , Oliver Kamps

The Hamiltonian Monte Carlo (HMC) method has been recognized as a powerful sampling tool in computational statistics. We show that performance of HMC can be significantly improved by incorporating importance sampling and an irreversible…

Computation · Statistics 2019-07-26 Tijana Radivojević , Elena Akhmatskaya

This article concerns the predictive modeling for spatio-temporal data as well as model interpretation using data information in space and time. We develop a novel approach based on supervised dimension reduction for such data in order to…

Methodology · Statistics 2021-11-09 Heng-Hui Lue , ShengLi Tzeng

In this paper, we study the system identification problem for sparse linear time-invariant systems. We propose a sparsity promoting block-regularized estimator to identify the dynamics of the system with only a limited number of input-state…

Systems and Control · Computer Science 2018-08-28 Salar Fattahi , Somayeh Sojoudi