English
Related papers

Related papers: Importance sampling for slow-fast diffusions based…

200 papers

For statistics of rare events in systems obeying a large-deviation principle, the rate function is a key quantity. When numerically estimating the rate function one is always restricted to finite system sizes. Thus, if the interest is in…

Data Analysis, Statistics and Probability · Physics 2024-12-06 Peter Werner , Alexander K. Hartmann

Solving decision problems in complex, stochastic environments is often achieved by estimating the expected outcome of decisions via Monte Carlo sampling. However, sampling may overlook rare, but important events, which can severely impact…

Machine Learning · Statistics 2023-05-16 Lachlan Gibson , Marcus Hoerger , Dirk Kroese

Score-based diffusion models, while achieving minimax optimality for sampling, are often hampered by slow sampling speeds due to the high computational burden of score function evaluations. Despite the recent remarkable empirical advances…

Machine Learning · Computer Science 2025-02-27 Gen Li , Changxiao Cai

Diffusion models, which convert noise into new data instances by learning to reverse a diffusion process, have become a cornerstone in contemporary generative modeling. In this work, we develop non-asymptotic convergence theory for a…

Machine Learning · Computer Science 2024-08-06 Gen Li , Yuting Wei , Yuejie Chi , Yuxin Chen

Moderate deviation principles for empirical measure processes associated with weakly interacting Markov processes are established. Two families of models are considered: the first corresponds to a system of interacting diffusions whereas…

Probability · Mathematics 2015-10-09 Amarjit Budhiraja , Ruoyu Wu

We propose a general and scalable approximate sampling strategy for probabilistic models with discrete variables. Our approach uses gradients of the likelihood function with respect to its discrete inputs to propose updates in a…

Machine Learning · Computer Science 2021-06-08 Will Grathwohl , Kevin Swersky , Milad Hashemi , David Duvenaud , Chris J. Maddison

In rare-event simulation, an importance sampling (IS) estimator is regarded as efficient if its relative error, namely the ratio between its standard deviation and mean, is sufficiently controlled. It is widely known that when a rare-event…

Statistics Theory · Mathematics 2022-10-31 Yuanlu Bai , Zhiyuan Huang , Henry Lam , Ding Zhao

The large deviation principle in the small noise limit is derived for solutions of possibly degenerate It\^o stochastic differential equations with predictable coefficients, which may depend also on the large deviation parameter. The result…

Probability · Mathematics 2015-01-06 Alberto Chiarini , Markus Fischer

Assessing the risk of low-probability high-impact transient instability (TI) events is crucial for ensuring robust and stable power system operation under high uncertainty. However, direct Monte Carlo (DMC) simulation for rare TI event…

Systems and Control · Electrical Eng. & Systems 2025-03-05 Jingyu Liu , Xiaoting Wang , Xiaozhe Wang

In this paper, we propose a sampling-based planning and optimal control method of nonlinear systems under non-differentiable constraints. Motivated by developing scalable planning algorithms, we consider the optimal motion plan to be a…

Systems and Control · Computer Science 2016-12-19 Jie Fu

For complex latent variable models, the likelihood function is not available in closed form. In this context, a popular method to perform parameter estimation is Importance Weighted Variational Inference. It essentially maximizes the…

Statistics Theory · Mathematics 2025-01-16 Badr-Eddine Cherief-Abdellatif , Randal Douc , Arnaud Doucet , Hugo Marival

In this work, we propose a smart idea to couple importance sampling and Multilevel Monte Carlo (MLMC). We advocate a per level approach with as many importance sampling parameters as the number of levels, which enables us to compute the…

Probability · Mathematics 2017-07-10 Ahmed Kebaier , Jérôme Lelong

Improving efficiency of importance sampler is at the center of research in Monte Carlo methods. While adaptive approach is usually difficult within the Markov Chain Monte Carlo framework, the counterpart in importance sampling can be…

Methodology · Statistics 2007-12-11 Heng Lian

The variance reduction established by importance sampling strongly depends on the choice of the importance sampling distribution. A good choice is often hard to achieve especially for high-dimensional integration problems. Nonparametric…

Methodology · Statistics 2010-06-10 Jan C. Neddermeyer

State-of-the-art methods for rare event simulation of non-Markovian models face practical or theoretical limits if observing the event of interest requires prior knowledge or information on the timed behavior of the system. In this paper,…

Logic in Computer Science · Computer Science 2025-06-25 Gabriel Dengler , Carlos E. Budde , Laura Carnevali , Arnd Hartmanns

Monte Carlo methods represent the "de facto" standard for approximating complicated integrals involving multidimensional target distributions. In order to generate random realizations from the target distribution, Monte Carlo techniques use…

Computation · Statistics 2022-01-21 L. Martino , V. Elvira , D. Luengo , J. Corander

Anomaly detection has many important applications, such as monitoring industrial equipment. Despite recent advances in anomaly detection with deep-learning methods, it is unclear how existing solutions would perform under…

Sound · Computer Science 2022-04-06 Bingqing Chen , Luca Bondi , Samarjit Das

The problem of the estimation of relevance to a set of histograms generated by samples of a discrete time process is discussed on the base of the variational principles proposed in the previous paper [1]. Some conditions for dimension…

Optimization and Control · Mathematics 2018-05-28 M. A. Antonets

This paper investigates asymptotically optimal importance sampling (IS) schemes for pricing European call options under the Heston stochastic volatility model. We focus on two distinct rare-event regimes where standard Monte Carlo methods…

Mathematical Finance · Quantitative Finance 2025-11-26 Yun-Feng Tu , Chuan-Hsiang Han

The statistical problem of parameter estimation in partially observed hypoelliptic diffusion processes is naturally occurring in many applications. However, due to the noise structure, where the noise components of the different coordinates…

Methodology · Statistics 2018-11-13 Susanne Ditlevsen , Adeline Samson