English
Related papers

Related papers: Blending Dynamic Programming with Monte Carlo Simu…

200 papers

Adaptive Monte Carlo methods are very efficient techniques designed to tune simulation estimators on-line. In this work, we present an alternative to stochastic approximation to tune the optimal change of measure in the context of…

Probability · Mathematics 2009-10-23 Benjamin Jourdain , Jérôme Lelong

Bootstrapping was designed to randomly resample data from a fixed sample using Monte Carlo techniques. However, the original sample itself defines a discrete distribution. Convolutional methods are well suited for discrete distributions,…

Methodology · Statistics 2021-07-19 Jared M. Clark , Richard L. Warr

Under the assumption of no-arbitrage, the pricing of American and Bermudan options can be casted into optimal stopping problems. We propose a new adaptive simulation based algorithm for the numerical solution of optimal stopping problems in…

Probability · Mathematics 2009-09-29 Daniel Egloff , Michael Kohler , Nebojsa Todorovic

Chance Constrained Markov Decision Processes maximize reward subject to a bounded probability of failure, and have been frequently applied for planning with potentially dangerous outcomes or unknown environments. Solution algorithms have…

Artificial Intelligence · Computer Science 2018-09-06 Benjamin J Ayton , Brian C Williams

Modern implementations of Hamiltonian Monte Carlo and related MCMC algorithms support sampling of probability functions that embed numerical root-finding algorithms, thereby allowing fitting of statistical models involving analytically…

Computation · Statistics 2025-06-19 Teddy Groves , Nicholas Luke Cowie , Lars Keld Nielsen

We present a method which extends Monte Carlo studies to situations that require a large dynamic range in particle number. The underlying idea is that, in order to calculate the collisional evolution of a system, some particle interactions…

Astrophysics · Physics 2009-11-13 C. W. Ormel , M. Spaans

Multi-objective evolutionary algorithms (MOEAs) have become essential tools for solving multi-objective optimization problems (MOPs), making their running time analysis crucial for assessing algorithmic efficiency and guiding practical…

Neural and Evolutionary Computing · Computer Science 2025-07-04 Han Huang , Tianyu Wang , Chaoda Peng , Tongli He , Zhifeng Hao

We present an algorithm for the simulation of the exact real-time dynamics of classical many-body systems with discrete energy levels. In the same spirit of kinetic Monte Carlo methods, a stochastic solution of the master equation is found,…

Statistical Mechanics · Physics 2016-07-20 Alejandro Mendoza-Coto , Rogelio Díaz-Méndez , Guido Pupillo

This paper considers the problem of minimizing the time average of a controlled stochastic process subject to multiple time average constraints on other related processes. The probability distribution of the random events in the system is…

Optimization and Control · Mathematics 2016-12-20 Xiaohan Wei , Hao Yu , Michael J. Neely

We consider the problem of estimating the expected outcomes of Monte Carlo processes whose outputs are described by multidimensional random variables. We tightly characterize the quantum query complexity of this problem for various choices…

Quantum Physics · Physics 2021-07-09 Arjan Cornelissen , Sofiene Jerbi

The running-time analysis of evolutionary combinatorial optimization is a fundamental topic in evolutionary computation. Its current research mainly focuses on specific algorithms for simplified problems due to the challenge posed by…

Neural and Evolutionary Computing · Computer Science 2025-01-14 Min Huang , Pengxiang Chen , Han Huang , Tonli He , Yushan Zhang , Zhifeng Hao

We consider the problem of detecting jumps in an otherwise smoothly evolving trend whilst the covariance and higher-order structures of the system can experience both smooth and abrupt changes over time. The number of jump points is allowed…

Methodology · Statistics 2023-12-27 Weichi Wu , Zhou Zhou

We introduce a new Monte Carlo method by incorporating a guided distribution function to the conventional Monte Carlo method. In this way, the efficiency of Monte Carlo methods is drastically improved. To further speed up the algorithm, we…

Computational Physics · Physics 2009-11-07 S. P. Li

We present a stepwise adaptive-timestep version of the Quantum Jump (Monte Carlo wave-function) algorithm. Our method has proved to remain robust even for problems where the integrating implementation of the Quantum Jump method is…

Quantum Physics · Physics 2019-03-27 M. Kornyik , A. Vukics

This article presents a novel approach, named MCMP (Monte Carlo Motion Planning), to the problem of motion planning under uncertainty, i.e., to the problem of computing a low-cost path that fulfills probabilistic collision avoidance…

Robotics · Computer Science 2015-06-01 Lucas Janson , Edward Schmerling , Marco Pavone

We describe an adaptive importance sampling algorithm for rare events that is based on a dual stochastic control formulation of a path sampling problem. Specifically, we focus on path functionals that have the form of cumulate generating…

Dynamical Systems · Mathematics 2019-01-30 Omar Kebiri , Lara Neureither , Carsten Hartmann

Differential Dynamic Programming (DDP) has become a well established method for unconstrained trajectory optimization. Despite its several applications in robotics and controls however, a widely successful constrained version of the…

Optimization and Control · Mathematics 2020-05-05 Yuichiro Aoyama , George Boutselis , Akash Patel , Evangelos A. Theodorou

We consider a multi-step algorithm for the computation of the historical expected shortfall such as defined by the Basel Minimum Capital Requirements for Market Risk. At each step of the algorithm, we use Monte Carlo simulations to reduce…

Computational Finance · Quantitative Finance 2020-05-27 Bruno Bouchard , Adil Reghai , Benjamin Virrion

High-quality random samples of quantum states are needed for a variety of tasks in quantum information and quantum computation. Searching the high-dimensional quantum state space for a global maximum of an objective function with many local…

Quantum Physics · Physics 2015-04-28 Yi-Lin Seah , Jiangwei Shang , Hui Khoon Ng , David John Nott , Berthold-Georg Englert

Though switched dynamical systems have shown great utility in modeling a variety of physical phenomena, the construction of an optimal control of such systems has proven difficult since it demands some type of optimal mode scheduling. In…

Optimization and Control · Mathematics 2014-02-04 Ramanarayan Vasudevan , Humberto Gonzalez , Ruzena Bajcsy , S. Shankar Sastry