English
Related papers

Related papers: A stochastic maximum principle via Malliavin calcu…

200 papers

Malliavin weight sampling (MWS) is a stochastic calculus technique for computing the derivatives of averaged system properties with respect to parameters in stochastic simulations, without perturbing the system's dynamics. It applies to…

Statistical Mechanics · Physics 2013-12-31 Patrick B. Warren , Rosalind J. Allen

The slow processes of metastable stochastic dynamical systems are difficult to access by direct numerical simulation due the sampling problem. Here, we suggest an approach for modeling the slow parts of Markov processes by approximating the…

Mathematical Physics · Physics 2012-12-03 Frank Noé , Feliks Nüske

Pricing of the lookback options using the Clark-Ocone formula for the underlying assets driven by stochastic L\'evy processes requires computing the Malliavin derivatives of their maximum or minimum on the Wiener-Poisson space and their…

Probability · Mathematics 2025-05-27 Mahdieh Tahmasebi

This study introduces computation of option sensitivities (Greeks) using the Malliavin calculus under the assumption that the underlying asset and interest rate both evolve from a stochastic volatility model and a stochastic interest rate…

Pricing of Securities · Quantitative Finance 2018-06-18 Bilgi Yilmaz

We present a probabilistic model for stochastic iterative algorithms with the use case of optimization algorithms in mind. Based on this model, we present PAC-Bayesian generalization bounds for functions that are defined on the trajectory…

Machine Learning · Computer Science 2024-08-22 Michael Sucker , Peter Ochs

We consider the optimal control problem of stochastic evolution equations in a Hilbert space under a recursive utility, which is described as the solution of a backward stochastic differential equation (BSDE). A very general maximum…

Optimization and Control · Mathematics 2024-02-06 Guomin Liu , Shanjian Tang

This paper studies an optimal control problem for continuous-time stochastic systems subject to reachability objectives specified in a subclass of metric interval temporal logic specifications, a temporal logic with real-time constraints.…

Systems and Control · Computer Science 2015-04-21 Jie Fu , Ufuk Topcu

An important but rarely-addressed option pricing question is how to choose appropriate strikes for implied volatility inputs when pricing more exotic multi-asset derivatives. By means of Malliavin Calculus we construct an optimal log-linear…

Mathematical Finance · Quantitative Finance 2018-07-18 Elisa Alòs , Michael Coulon

We investigate a stochastic optimal control problem where the controlled system is depicted as a stochastic differential delayed equation; however, at the terminal time, the state is constrained in a convex set. We firstly introduce an…

Probability · Mathematics 2017-05-12 Jiaqiang Wen , Yufeng Shi

Living systems often function with regulatory interactions, but the question of how activity, stochasticity and regulations work together for achieving different goals still remains puzzling. We propose a stochastic model of an active…

Soft Condensed Matter · Physics 2026-03-02 Tai Han , Fanlong Meng

This paper is concerned with a constrained stochastic linear-quadratic optimal control problem, in which the terminal state is fixed and the initial state is constrained to lie in a stochastic linear manifold. The controllability of…

Optimization and Control · Mathematics 2019-06-11 Xiuchun Bi , Jingrui Sun , Jie Xiong

The Pontryagin's Maximum Principle allows, in most cases, the design of optimal controls of affine nonlinear control systems by considering the sign of a smooth function. There are cases, although, where this function vanishes on a whole…

Optimization and Control · Mathematics 2013-11-12 Eduardo Oda , Pedro Aladar Tonelli

The considered optimal control problem of a stochastic power system, is to select the set of power supply vectors which infimizes the probability that the phase-angle differences of any power flow of the network, endangers the transient…

Optimization and Control · Mathematics 2024-01-31 Zhen Wang , Kaihua Xi , Aijie Cheng , Hai Xiang Lin , Jan H. van Schuppen

Conditional McKean-Vlasov control problems involve controlling McKean-Vlasov diffusions where the interaction occurs through the law of the state process conditionally on it staying in a domain. Introduced by Lions in his 2016 lectures at…

Probability · Mathematics 2025-10-09 René Carmona , Ludovic Tangpi , Kaiwen Zhang

Optimal control of stochastic nonlinear dynamical systems is a major challenge in the domain of robot learning. Given the intractability of the global control problem, state-of-the-art algorithms focus on approximate sequential optimization…

Machine Learning · Computer Science 2020-04-23 Joe Watson , Hany Abdulsamad , Jan Peters

We consider distributed-order non-local fractional optimal control problems with controls taking values on a closed set and prove a strong necessary optimality condition of Pontryagin type. The possibility that admissible controls are…

Optimization and Control · Mathematics 2021-08-10 Faical Ndairou , Delfim F. M. Torres

For a class of piecewise deterministic Markov processes we introduce a stochastic calculus which is a certain non-Gaussian counterpart to the classical Malliavin calculus. As an application we investigate the regularity of densities of…

Probability · Mathematics 2023-06-21 Jörg-Uwe Löbus

This paper investigates methods for estimating the optimal stochastic control policy for a Markov Decision Process with unknown transition dynamics and an unknown reward function. This form of model-free reinforcement learning comprises…

Machine Learning · Computer Science 2019-12-06 Brandon Trabucco , Albert Qu , Simon Li , Ganeshkumar Ashokavardhanan

In communications, unknown variables are usually modelled as random variables, and concepts such as independence, entropy and information are defined in terms of the underlying probability distributions. In contrast, control theory often…

Systems and Control · Computer Science 2014-01-14 Girish N. Nair

In this work we provide explicit conditions on the existence of optimal feedback controls for stochastic processes with regime-switching. We use the compactification method which needs less regularity conditions on the coefficients of the…

Optimization and Control · Mathematics 2020-01-14 Jinghai Shao