English
Related papers

Related papers: Efficient large deviation estimation based on impo…

200 papers

Many statistical applications involve models for which it is difficult to evaluate the likelihood, but from which it is relatively easy to sample. Approximate Bayesian computation is a likelihood-free method for implementing Bayesian…

Methodology · Statistics 2017-11-29 Wentao Li , Paul Fearnhead

We consider estimating the transition probability matrix of a finite-state finite-observation alphabet hidden Markov model with known observation probabilities. The main contribution is a two-step algorithm; a method of moments estimator…

Systems and Control · Computer Science 2017-11-22 Robert Mattila , Cristian R. Rojas , Vikram Krishnamurthy , Bo Wahlberg

We consider the problem of efficient simulation estimation of the density function at the tails, and the probability of large deviations for a sum of independent, identically distributed, light-tailed and non-lattice random vectors. The…

Probability · Mathematics 2017-04-26 Santanu Dey , Sandeep Juneja , Ankush Agarwal

This study presents an importance sampling formulation based on adaptively relaxing parameters from the indicator function and/or the probability density function. The formulation embodies the prevalent mathematical concept of relaxing a…

Applications · Statistics 2024-04-11 Jianhua Xian , Ziqi Wang

Naive approaches to amortized inference in probabilistic programs with unbounded loops can produce estimators with infinite variance. This is particularly true of importance sampling inference in programs that explicitly include rejection…

We develop generic and efficient importance sampling estimators for Monte Carlo evaluation of prices of single- and multi-asset European and path-dependent options in asset price models driven by L\'evy processes, extending earlier works…

Risk Management · Quantitative Finance 2016-08-17 Adrien Genin , Peter Tankov

We study the distributional properties of the linear discriminant function under the assumption of normality by comparing two groups with the same covariance matrix but different mean vectors. A stochastic representation for the…

Statistics Theory · Mathematics 2017-05-09 Taras Bodnar , Stepan Mazur , Edward Ngailo , Nestor Parolya

Parametric estimation for diffusion processes is considered for high frequency observations over a fixed time interval. The processes solve stochastic differential equations with an unknown parameter in the diffusion coefficient. We find…

Methodology · Statistics 2017-04-03 Nina Munkholt Jakobsen , Michael Sørensen

It is well known that symplectic methods have been rigorously shown to be superior to non-symplectic ones especially in long-time computation, when applied to deterministic Hamiltonian systems. In this paper, we attempt to study the…

Numerical Analysis · Mathematics 2026-03-06 Chuchu Chen , Jialin Hong , Diancong Jin , Liying Sun

Consider the task of generating samples from a tilted distribution of a random vector whose underlying distribution is unknown, but samples from it are available. This finds applications in fields such as finance and climate science, and in…

We study maximum-likelihood-type estimation for diffusion processes when the coefficients are nonrandom and observation occurs in nonsynchronous manner. The problem of nonsynchronous observations is important when we consider the analysis…

Statistics Theory · Mathematics 2022-07-04 Teppei Ogihara

Large deviation functions contain information on the stability and response of systems driven into nonequilibrium steady states, and in such a way are similar to free energies for systems at equilibrium. As with equilibrium free energies,…

Statistical Mechanics · Physics 2018-04-25 Ushnish Ray , Garnet Kin-Lic Chan , David T. Limmer

Large deviation functions are an essential tool in the statistics of rare events. Often they can be obtained by contraction from a so-called level 2 large deviation {\em functional} characterizing the empirical density of the underlying…

Statistical Mechanics · Physics 2016-08-24 Johannes Hoppenau , Daniel Nickelsen , Andreas Engel

Importance sampling is a popular variance reduction method for Monte Carlo estimation, where a notorious question is how to design good proposal distributions. While in most cases optimal (zero-variance) estimators are theoretically…

Statistics Theory · Mathematics 2021-02-22 Carsten Hartmann , Lorenz Richter

This paper investigates asymptotically optimal importance sampling (IS) schemes for pricing European call options under the Heston stochastic volatility model. We focus on two distinct rare-event regimes where standard Monte Carlo methods…

Mathematical Finance · Quantitative Finance 2025-11-26 Yun-Feng Tu , Chuan-Hsiang Han

Importance sampling is often used in machine learning when training and testing data come from different distributions. In this paper we propose a new variant of importance sampling that can reduce the variance of importance sampling-based…

Machine Learning · Computer Science 2016-11-11 Philip S. Thomas , Emma Brunskill

Importance sampling is widely used to improve the efficiency of deep neural network (DNN) training by reducing the variance of gradient estimators. However, efficiently assessing the variance reduction relative to uniform sampling remains…

Machine Learning · Computer Science 2025-11-19 Takuro Kutsuna

We consider the problem of estimating an expected outcome from a stochastic simulation model. Our goal is to develop a theoretical framework on importance sampling for such estimation. By investigating the variance of an importance sampling…

Methodology · Statistics 2019-09-27 Yen-Chi Chen , Youngjun Choe

Importance sampling, which involves sampling from a probability density function (PDF) proportional to the product of an importance weight function and a base PDF, is a powerful technique with applications in variance reduction, biased or…

Machine Learning · Computer Science 2025-02-10 Heasung Kim , Taekyun Lee , Hyeji Kim , Gustavo de Veciana

Machine learning optimization often depends on stochastic gradient descent, where the precision of gradient estimation is vital for model performance. Gradients are calculated from mini-batches formed by uniformly selecting data samples…

Machine Learning · Computer Science 2025-01-29 Corentin Salaün , Xingchang Huang , Iliyan Georgiev , Niloy J. Mitra , Gurprit Singh