English
Related papers

Related papers: Large Deviations and Importance Sampling for Syste…

200 papers

We study some notions of negative dependence of a sampling scheme that can be used to derive variance bounds for the corresponding estimator or discrepancy bounds for the underlying random point set that are at least as good as the…

Numerical Analysis · Mathematics 2021-02-10 Michael Gnewuch , Marcin Wnuk , Nils Hebbinghaus

We consider a typical learning problem of point estimations for modeling of nonlinear functions or dynamical systems in which generalization, i.e., verifying a given learned model, can be embedded as an integral part of the learning process…

Optimization and Control · Mathematics 2024-08-06 Getachew K. Befekadu

We establish a large deviation principle for time dependent trajectories (paths) of the empirical density of $N$ particles with long range interactions, for homogeneous systems. This result extends the classical kinetic theory that leads to…

Statistical Mechanics · Physics 2022-01-19 Ouassim Feliachi , Freddy Bouchet

Variational inference approximates the posterior distribution of a probabilistic model with a parameterized density by maximizing a lower bound for the model evidence. Modern solutions fit a flexible approximation with stochastic gradient…

Machine Learning · Statistics 2017-07-13 Joseph Sakaya , Arto Klami

Consider a collection of particles whose state evolution is described through a system of interacting diffusions in which each particle is driven by an independent individual source of noise and also by a small amount of noise that is…

Probability · Mathematics 2021-01-01 Amarjit Budhiraja , Michael Conroy

The aim of this paper is to introduce a new Monte Carlo method based on importance sampling techniques for the simulation of stochastic differential equations. The main idea is to combine random walk on squares or rectangles methods with…

Probability · Mathematics 2010-10-22 Madalina Deaconu , Antoine Lejay

Importance sampling is a Monte Carlo method which designs estimators of expectations under a target distribution using weighted samples from a proposal distribution. When the target distribution is complex, such as multimodal distributions…

Methodology · Statistics 2026-02-04 Anas Cherradi , Yazid Janati , Alain Durmus , Sylvain Le Corff , Yohan Petetin , Julien Stoehr

Monte Carlo integration is a commonly used technique to compute intractable integrals and is typically thought to perform poorly for very high-dimensional integrals. To show that this is not always the case, we examine Monte Carlo…

Methodology · Statistics 2023-05-26 Yanbo Tang

In this paper, we analyze the finite sample complexity of stochastic system identification using modern tools from machine learning and statistics. An unknown discrete-time linear system evolves over time under Gaussian noise without…

Machine Learning · Computer Science 2019-03-22 Anastasios Tsiamis , George J. Pappas

Sampling rare events in metastable dynamical systems is often a computationally expensive task and one needs to resort to enhanced sampling methods such as importance sampling. Since we can formulate the problem of finding optimal…

Optimization and Control · Mathematics 2023-10-05 Enric Ribera Borrell , Jannes Quer , Lorenz Richter , Christof Schütte

Large deviation theory has provided important clues for the choice of importance sampling measures for Monte Carlo evaluation of exceedance probabilities. However, Glasserman and Wang [Ann. Appl. Probab. 7 (1997) 731--746] have given…

Probability · Mathematics 2007-05-23 Hock Peng Chan , Tze Leung Lai

We study the large deviation principle (LDP) for locally damped nonlinear wave equations perturbed by a bounded noise. When the noise is sufficiently non-degenerate, we establish the LDP for empirical distributions with lower bound of a…

Analysis of PDEs · Mathematics 2024-09-19 Yuxuan Chen , Ziyu Liu , Shengquan Xiang , Zhifei Zhang

In this paper, we study the asymptotic behavior of a semi-linear slow-fast stochastic partial differential equation with singular coefficients. Using the Poisson equation in Hilbert space, we first establish the strong convergence in the…

Probability · Mathematics 2021-06-09 Michael Röckner , Longjie Xie , Li Yang

Importance sampling has become an important tool for the computation of tail-based risk measures. Since such quantities are often determined mainly by rare events standard Monte Carlo can be inefficient and importance sampling provides a…

Probability · Mathematics 2013-06-29 Pierre Nyquist

In this work we determine a process-level Large Deviation Principle (LDP) for a model of interacting particles indexed by a lattice $\mathbb{Z}^d$. The connections are random, sparse and unscaled, so that the system converges in the large…

Probability · Mathematics 2024-10-01 James MacLaurin

This paper proposes a hierarchical adaptive sampling scheme for passivity characterization of large-scale linear lumped macromodels. Here, large-scale is intended both in terms of dynamic order and especially number of input/output ports.…

Computational Engineering, Finance, and Science · Computer Science 2020-11-06 Marco De Stefano , Stefano Grivet-Talocia , Torben Wendt , Cheng Yang , Christian Schuster

We propose to use deep neural networks for generating samples in Monte Carlo integration. Our work is based on non-linear independent components estimation (NICE), which we extend in numerous ways to improve performance and enable its…

Machine Learning · Computer Science 2019-09-04 Thomas Müller , Brian McWilliams , Fabrice Rousselle , Markus Gross , Jan Novák

In this paper, we introduce a mathematical apparatus that is relevant for understanding a dynamical system with small random perturbations and coupled with the so-called transmutation process -- where the latter jumps from one mode to…

Dynamical Systems · Mathematics 2017-09-15 Getachew K. Befekadu

We consider the problem of numerically estimating expectations of solutions to stochastic differential equations driven by Brownian motions in the commonly occurring small noise regime. We consider (i) standard Monte Carlo methods combined…

Numerical Analysis · Mathematics 2015-06-08 David F. Anderson , Desmond J. Higham , Yu Sun

We study the convergence behavior of the stochastic heavy-ball method with a small stepsize. Under a change of time scale, we approximate the discrete method by a stochastic differential equation that models small random perturbations of a…

Probability · Mathematics 2019-10-21 Wenqing Hu , Chris Junchi Li , Xiang Zhou