English
Related papers

Related papers: Regression Monte Carlo for Impulse Control

200 papers

Sequential Monte Carlo methods which involve sequential importance sampling and resampling are shown to provide a versatile approach to computing probabilities of rare events. By making use of martingale representations of the sequential…

Probability · Mathematics 2012-02-22 Hock Peng Chan , Tze Leung Lai

In this paper we consider a fractional stochastic volatility model, that is a model in which the volatility may exhibit a long-range dependent or a rough/antipersistent behavior. We propose a dynamic sequential Monte Carlo methodology that…

Methodology · Statistics 2017-02-28 Alexandra Chronopoulou , Konstantinos Spiliopoulos

We present a novel active learning algorithm, termed as iterative surrogate model optimization (ISMO), for robust and efficient numerical approximation of PDE constrained optimization problems. This algorithm is based on deep neural…

Optimization and Control · Mathematics 2020-12-30 Kjetil O. Lye , Siddhartha Mishra , Deep Ray , Praveen Chandrasekhar

We consider a class of stochastic impulse control problems of general stochastic processes i.e. not necessarily Markovian. Under fairly general conditions we establish existence of an optimal impulse control. We also prove existence of…

Probability · Mathematics 2008-06-18 Boualem Djehiche , Said Hamadene , Ibtissam Hdhiri

This paper focuses on the study of an original combination of the Multilevel Monte Carlo method introduced by Giles [10] and the popular importance sampling technique. To compute the optimal choice of the parameter involved in the…

Probability · Mathematics 2017-09-05 Mohamed Ben Alaya , Kaouther Hajji , Ahmed Kebaier

A change in the number of motor units that operate a particular muscle is an important indicator for the progress of a neuromuscular disease and the efficacy of a therapy. Inference for realistic statistical models of the typical data…

Methodology · Statistics 2018-04-12 Simon Taylor , Chris Sherlock , Gareth Ridall , Paul Fearnhead

Many machine learning problems can be framed in the context of estimating functions, and often these are time-dependent functions that are estimated in real-time as observations arrive. Gaussian processes (GPs) are an attractive choice for…

Machine Learning · Statistics 2023-05-09 Michael Minyi Zhang , Bianca Dumitrascu , Sinead A. Williamson , Barbara E. Engelhardt

We propose a new Monte Carlo method for efficiently sampling trajectories with fixed initial and final conditions in a system with discrete degrees of freedom. The method can be applied to any stochastic process with local interactions,…

Statistical Mechanics · Physics 2012-03-30 Thierry Mora , Aleksandra M. Walczak , Francesco Zamponi

Stochastic trajectory optimization methods like STOMP enable planning with non-differentiable costs, offering substantial flexibility over gradient-based approaches. We show that STOMP implicitly minimizes the KL divergence from a Boltzmann…

Robotics · Computer Science 2026-05-11 Hongzhe Yu , Zinuo Chang , Yongxin Chen

Variational inference approximates the posterior distribution of a probabilistic model with a parameterized density by maximizing a lower bound for the model evidence. Modern solutions fit a flexible approximation with stochastic gradient…

Machine Learning · Statistics 2017-07-13 Joseph Sakaya , Arto Klami

Time-dependent reliability analysis of nonlinear dynamical systems under stochastic excitations is a critical yet computationally demanding task. Conventional approaches, such as Monte Carlo simulation, necessitate repeated evaluations of…

Machine Learning · Statistics 2026-03-24 Shailesh Garg , Souvik Chakraborty

We re-visit the role model strategy introduced in an earlier paper, which allows one to train an estimator for degraded observations by imitating a reference estimator that has access to superior observations. We show that, while it is true…

Information Theory · Computer Science 2016-11-17 Jossy Sayir

In this paper, we consider a class of stochastic impulse control problem when there is a fixed delay $\Delta$ between the decision and execution times. The dynamics of the controlled system between two impulses is an arbitrary adapted…

Probability · Mathematics 2026-01-23 Said Hamadène , Ibtissam Hdhiri

Monte Carlo simulations have boosted the numerical study of several different physical systems and in particular, the canonical ensemble has been especially useful because of the existence of easy and efficient relaxation algorithms…

Statistical Mechanics · Physics 2019-10-29 G. Palma , A. Riveros

Sequential Monte Carlo algorithms, or Particle Filters, are Bayesian filtering algorithms which propagate in time a discrete and random approximation of the a posteriori distribution of interest. Such algorithms are based on Importance…

Computation · Statistics 2017-10-11 Roland Lamberti , Yohan Petetin , François Desbouvries , François Septier

Sequential Monte Carlo (SMC) methods are a class of techniques to sample approximately from any sequence of probability distributions using a combination of importance sampling and resampling steps. This paper is concerned with the…

Statistics Theory · Mathematics 2012-03-05 Pierre Del Moral , Arnaud Doucet , Ajay Jasra

In this paper the optimal control of alignment models composed by a large number of agents is investigated in presence of a selective action of a controller, acting in order to enhance consensus. Two types of selective controls have been…

Optimization and Control · Mathematics 2016-10-06 Giacomo Albi , Lorenzo Pareschi

Robust inference for stochastic dynamical systems is often hampered by sparse sampling and the absence of closed-form likelihoods. We introduce a Monte Carlo path-inference framework that leverages full-path statistics and bridge processes…

Statistical Mechanics · Physics 2025-10-07 Javier Aguilar , Miguel A. Muñoz , Sandro Azaele

This paper introduces the Sequential Monte Carlo Transformer, an original approach that naturally captures the observations distribution in a transformer architecture. The keys, queries, values and attention vectors of the network are…

Machine Learning · Computer Science 2020-12-16 Alice Martin , Charles Ollion , Florian Strub , Sylvain Le Corff , Olivier Pietquin

We analyse a multilevel Monte Carlo method for the approximation of distribution functions of univariate random variables. Since, by assumption, the target distribution is not known explicitly, approximations have to be used. We provide an…

Probability · Mathematics 2017-06-22 Mike B. Giles , Tigran Nagapetyan , Klaus Ritter