English
Related papers

Related papers: Dynamic Programming Principle and Hamilton-Jacobi-…

200 papers

We formulate and analyze a new method for solving optimal control problems for systems governed by Volterra integral equations. Our method utilizes discretization of the original Volterra controlled system and a novel type of dynamic…

Optimization and Control · Mathematics 2007-05-23 S. A. Belbas

We use optimal control via a distributed exterior field to steer the dynamics of an ensemble of N interacting ferromagnetic particles which are immersed into a heat bath by minimizing a quadratic functional. By using dynamic programing…

Numerical Analysis · Mathematics 2018-06-19 Max Jensen , Ananta Majee , Andreas Prohl , Christian Schellnegger

The present paper considers a stochastic optimal control problem, in which the cost function is defined through a backward stochastic differential equation with infinite horizon driven by G-Brownian motion. Then we study the regularities of…

Probability · Mathematics 2017-06-13 Mingshang Hu , Falei Wang

We study the Hamilton-Jacobi equation for undiscounted exit time control problems with general nonnegative Lagrangians using the dynamic programming approach. We prove theorems characterizing the value function as the unique…

Optimization and Control · Mathematics 2007-05-23 Michael Malisoff

This paper deals with junction conditions for Hamilton-Jacobi-Bellman (HJB) equations for finite horizon control problems on multi-domains. We consider two different cases where the final cost is continuous or lower semi-continuous. In the…

Optimization and Control · Mathematics 2017-07-21 Daria Ghilli , Zhiping Rao , Hasnaa Zidani

Considering that the decision-making environment faced by reinforcement learning (RL) agents is full of Knightian uncertainty, this paper describes the exploratory state dynamics equation in Knightian uncertainty to study the…

Optimization and Control · Mathematics 2026-01-27 Ziyu Li , Chen Fei , Weiyin Fei

An optimal control problem is considered for a stochastic differential equation containing a state-dependent regime switching, with a recursive cost functional. Due to the non-exponential discounting in the cost functional, the problem is…

Optimization and Control · Mathematics 2017-12-29 Hongwei Mei , Jiongmin Yong

We consider an optimal control problem arising in the context of economic theory of growth, on the lines of the works by Skiba (1978) and Askenazy - Le Van (1999). The economic framework of the model is intertemporal infinite horizon…

Optimization and Control · Mathematics 2014-09-05 Francesco Bartaloni

We study optimal control problems in infinite horizon when the dynamics belong to a specific class of piecewise deterministic Markov processes constrained to star-shaped networks (inspired by traffic models). We adapt the results in [H. M.…

Optimization and Control · Mathematics 2015-10-06 Dan Goreac , Magdalena Kobylanski , Miguel Martinez

We consider a dynamic portfolio optimization problem that incorporates predictable returns, instantaneous transaction costs, price impact, and stochastic volatility, extending the classical results of Garleanu and Pedersen (2013), which…

Computational Finance · Quantitative Finance 2025-07-24 Patrick Chan , Ronnie Sircar , Iosif Zimbidis

This paper studies {a} mixed singular/switching stochastic control problem for a multidimensional diffusion with multiples regimes on a bounded domain. Using probabilistic, partial differential equation (PDE) and penalization techniques, we…

Optimization and Control · Mathematics 2020-10-13 Mark Kelbert , Harold A. Moreno-Franco

This is the first in a series of papers in which we study an efficient approximation scheme for solving the Hamilton-Jacobi-Bellman equation for multi-dimensional problems in stochastic control theory. The method is a combination of a WKB…

Computational Finance · Quantitative Finance 2014-06-26 Sakda Chaiworawitkul , Patrick S. Hagan , Andrew Lesniewski

We consider a stochastic optimal control problem governed by a stochastic differential equation with delay in the control. Using a result of existence and uniqueness of a sufficiently regular mild solution of the associated…

Probability · Mathematics 2021-03-22 F. Gozzi , F. Masiero

We consider Hamilton Jacobi Bellman equations in an inifinite dimensional Hilbert space, with quadratic (respectively superquadratic) hamiltonian and with continuous (respectively lipschitz continuous) final conditions. This allows to study…

Probability · Mathematics 2013-04-10 Federica Masiero

Approximating the optimal value function $v^*$ for infinite-horizon, nonlinear, autonomous optimal control problems is both challenging and essential for synthesizing real-time optimal feedback. We develop an abstract optimal recovery…

Optimization and Control · Mathematics 2025-12-09 Tobias Ehring , Behzad Azmi , Bernard Haasdonk

An abstract framework guaranteeing the local continuous differentiability of the value function associated with optimal stabilization problems subject to abstract semilinear parabolic equations subject to a norm constraint on the controls…

Optimization and Control · Mathematics 2023-05-19 Karl Kunisch , Buddhika Priyasad

This article approaches deterministic filtering via an application of the min-plus linearity of the corresponding dynamic programming operator. This filter design method yields a set-valued state estimator for discrete-time nonlinear…

Optimization and Control · Mathematics 2012-03-14 Abhijit G. Kallapur , Srinivas Sridharan , William M. McEneaney , Ian R. Petersen

We study the optimal control of path-dependent McKean-Vlasov equations valued in Hilbert spaces motivated by non Markovian mean-field models driven by stochastic PDEs. We first establish the well-posedness of the state equation, and then we…

Optimization and Control · Mathematics 2022-12-21 Andrea Cosso , Fausto Gozzi , Idris Kharroubi , Huyên Pham , Mauro Rosestolato

This paper studies the stochastic optimal control of jump-diffusion processes and the associated fully nonlinear backward stochastic Hamilton--Jacobi--Bellman (BSHJB) equations. We establish the dynamic programming principle (DPP) via…

Optimization and Control · Mathematics 2026-05-21 Dunxiang Liang , Qingxin Meng

We consider a class of exit time stochastic control problems for diffusion processes with discounted criterion, where the controller can utilize a given amount of resource, called "fuel". In contrast to the vast majority of existing…

Optimization and Control · Mathematics 2015-01-30 Dmitry B. Rokhlin , Georgii Mironenko